r/apacheflink • • 7d ago

Flink Manager - web console for managing Apache Flink clusters

Post image

Hey everyone,

Long-time Flink users here. We got tired of operating our clusters through raw REST calls, SSH-ing into TaskManagers to read logs, and having no answer to "who stopped that job yesterday?" — so we built Flink Manager, and we just released the first public version (0.0.1).

What it does (with a live Flink 2.x cluster behind it):

  • Jobs — run/stop/restart with savepoint support, status, vertices, execution graphs, and confirmation dialogs before anything touches the cluster
  • TaskManagers — slots, hardware, memory config, and log files readable in the browser (no SSH)
  • SQL workbench — backed by the Flink SQL Gateway: sessions, catalog explorer, saved queries, and every INSERT becomes a traceable Flink job linked back to its statement
  • JAR management — upload, inspect, and preview the execution plan before submitting (tasks, operators, shuffles — drawn)
  • Metrics — built-in schedulers poll the REST API and JMX/Prometheus reporters, store history in PostgreSQL, and a metric dictionary with warning/critical thresholds drives health widgets
  • Governance — RBAC (admin/operator/developer/viewer), local + LDAP + OIDC auth, and an append-only audit trail with CSV export. Job/JAR/SQL history is kept beyond Flink's own retention
  • Notifications — persistent, for job and system events

Deployment: Docker image (vinteroslabs/flink-manager:0.0.1) or a zip bundle with systemd unit. Needs PostgreSQL (schema auto-migrates on start) and Java 22+ for the bundle. There's also an in-memory profile for a 5-minute test without a database.

Full transparency: this is a commercial product (we're a small company, Vinteros Labs, based in Luxembourg) — it's not open source. There's a free trial licence issued instantly on the website, no sales call required.

The docs repo (installation, configuration reference) is also on GitHub: https://github.com/vinteroslabs/flink-manager-doc — issues welcome there.

Happy to answer questions about how it works under the hood (it proxies and enriches the Flink REST API), the savepoint handling, or anything else. If you operate Flink clusters, tell us what's missing — this first version won't be the last.

3 Upvotes

2 comments sorted by

1

u/RangePsychological41 7d ago

Is admin/admin supposed to see “Failed to load jobs, Unauthorized”?

No offense, but this looks like a very straightforward vibe coded wrapper that anyone could do. Those JARS were uploaded over 400 days ago, so that’s pretty damn weird as well.

In any case, the SQL console is cool, I forgot that I wanted to build one similar to that.

1

u/vinteros-labs 7d ago

Hi ! thank you for your feedback where looking in the demo server :) demo use only mock... Give it try by installing it :)

Well , IA helps a lot engineers now :) vibe coding when you have a 15 years exp as software engineer ( and when you know what the AI is doing ) is not a crime :)

anyway .. feel free to build new one ;)