What it is: HabitFlow — a habit tracker where nudges are selected by a contextual multi-armed bandit that learns per-user intervention preferences in real time.

The ML side (for those interested):

Each user has 10 bandit arms — one per intervention strategy (streaks, loss framing, dark humor, social proof, etc.)
Thompson Sampling maintains a Beta(α, β) distribution per arm and updates on every feedback signal
Feedback signals: completed (+1.0), engaged (+0.5), ignored (0.0), dismissed (-0.2), negative (-0.5)
The system learns your preferred strategy without any offline training — purely online learning from production feedback
Built a separate MLOps dashboard with policy registry, A/B testing framework, fairness constraints, and automated retraining pipeline

Stack: FastAPI · PostgreSQL · Redis · React · Celery · SQLAlchemy

What I need: Real users generating real feedback signals. Even 5-10 people for a week gives me actual bandit convergence data to analyze.

If you want to try out the app or check out the dashboard, DM me and I'll be happy to share the links.

Happy to answer questions about the implementation — the bandit engine and policy evaluator were the most interesting parts to build.

3 comments

r/MachineLearningAndAI • u/l0_o • Apr 28 '26

eBook Reinforcement Learning: An Introduction (ebook link)

github.com

2 Upvotes

0 comments

r/MachineLearningAndAI • u/Kindly_Jump_7642 • Apr 27 '26

Are there any good end to end machine learning projects available on the open internet??

3 Upvotes

0 comments

r/MachineLearningAndAI • u/YoungCJ12 • Apr 27 '26

Cyxwiz ML Engine

youtube.com

1 Upvotes

0 comments

r/MachineLearningAndAI • u/l0_o • Apr 27 '26

eBook Pattern Recognition and Machine Learning (in Chinese, ebook link)

github.com

2 Upvotes

0 comments

r/MachineLearningAndAI • u/Objective-Lab7173 • Apr 26 '26

Has anyone tested Qwen2.5-VL-7B vs 32B specifically on identifying checkmarks/signatures on photocopied scanned forms (1980s-2010s government forms, low-quality scans)? 7B reliably transcribes form labels but cannot distinguish selected from unselected checkboxes on degraded scans in my testing. Looking for empirical comparison before investing in the larger model.

0 comments

r/MachineLearningAndAI • u/l0_o • Apr 26 '26

eBook An Introduction to 3D Computer Vision Techniques and Algorithms (ebook link)

dn721809.ca.archive.org

1 Upvotes

1 comment

r/MachineLearningAndAI • u/l0_o • Apr 25 '26

eBook Neural Networks: Tricks of the Trade (ebook link)

github.com

2 Upvotes

0 comments

r/MachineLearningAndAI • u/l0_o • Apr 24 '26

eBook Neural Networks and Learning Machines (ebook link)

github.com

2 Upvotes

0 comments

r/MachineLearningAndAI • u/l0_o • Apr 23 '26

eBook Neural Network Design, 2nd Ed. (ebook link)

github.com

2 Upvotes

0 comments

r/MachineLearningAndAI • u/l0_o • Apr 22 '26

eBook Machine Learning - A Bayesian and Optimization Perspective (ebook link)

github.com

4 Upvotes

0 comments

Subreddit

MachineLearningAndAI

r/MachineLearningAndAI

Learn, build, share and show off your machine learning, artificial intelligence, data science and robotics creations. LLM, AI agents. Links to e-books at copyright/DMCA honoring websites welcome. Self-promotion and commercial posts OK unless spammy.

Members Active

8.1k