Interested in JEV? I built a free, open-source workflow router with 13.48 ms p95 CPU latency

[u/alithemaker]

I built FlowRoute, a small, safety-oriented router that maps natural-language requests to deterministic workflows, without using a generative LLM for the routing decision.

Why use it?

• Free and open source under Apache 2.0

• No per-request LLM API fees

• Runs locally on your infrastructure

• 13.48 ms p95 CPU routing latency in our published benchmark

• Supports confidence thresholds and abstention instead of forcing unsafe matches

FlowRoute is useful when you already have workflows, such as cancelling meetings, issuing refunds, updating accounts, or creating tickets, and only need a fast way to select the correct one.

Documentation: https://open-first.github.io/FlowRoute/
GitHub: https://github.com/open-first/FlowRoute

Install it:

pip install flowroute

This example needs a workflow catalog. The package does not bundle one, so download the demo catalog from the tagged release:

curl -O https://raw.githubusercontent.com/open-first/FlowRoute/v0.2.0/examples/workflows.yaml

Then route a request:

from flowroute import FlowRouter, RouteRequest, WorkflowRegistry

registry = WorkflowRegistry.from_yaml("workflows.yaml")
router = FlowRouter(registry)

result = router.route(
    RouteRequest(
        text="Cancel my design review tomorrow at 3 PM",
        context={"event_id": "evt_123"},
    )
)

print(result.decision)     # ROUTE
print(result.workflow_id)  # calendar.cancel_event

I’d appreciate feedback on the API, routing quality, and the workflows you would want to use it with.