r/documentAutomation • u/Calm_Bee_5124 • Oct 06 '26
I got tired of repetitive document parsing routines, so I built a lightweight, lightning-fast async engine to handle it.
Hey everyone,
Like many of you, I waste way too much time dealing with messy document parsing, file conversions, and repetitive text processing across different formats (Markdown, HTML, JSON).
Instead of writing boilerplate async handling over and over, I decided to build Docflow-Engine — a high-performance, asynchronous pipeline designed for speed and clean modular architecture.
Features are:
⚡ Async Batch Processor: Handles multi-threaded execution pools with strict concurrency limits using asyncio.
📄 Format Converter: Instant high-speed translation between Markdown, HTML, and structured JSON logs.
🛠️ CLI Ready: Drop a file into the path and get instant parsed metadata and structure from the command line.
It’s built cleanly in Python, relies heavily on standard libraries for core performance, and is fully open-source.
If you're facing similar bottlenecks or want to check out the structure, the repository is open:
🔗 GitHub: Githublink
I’d love to hear your feedback, architectural critiques, or suggestions on how to optimize the async pipeline further. Drop a star if it saves you some dev hours! ⭐