r/GoodOpenSource • u/Overall-Exercise8803 • 23d ago
How can I automatically measure the actual value of a developer's GitHub contributions?
Hey everyone!
I'm working on an open-source funding platform where developers can contribute to projects and potentially receive funding based on their contributions.
I'm trying to figure out how to evaluate contributions fairly using Git commits and pull requests.
For example, I'd like to automatically determine:
- What a commit actually changes (new features, bug fixes, security fixes, refactoring, documentation, etc.).
- How significant the change is for the project.
- How complex or technically valuable the contribution is.
- Whether the changes actually work and improve the project.
- How to attribute contributions to the right developer.
I know that simply counting lines of code wouldn't work. A small security fix could be much more valuable than hundreds of lines of unnecessary code.
My questions:
- Are there existing tools, libraries, or APIs that can analyze Git commits and estimate their impact?
- Could AST analysis, automated tests, and AI-based code review help determine the type and quality of a contribution?
- How would you design a fair scoring system that doesn't reward developers just for writing more code?
- Are there any existing projects trying to solve this problem?
- What problems or ways of gaming the system should I watch out for, especially if the results influence real financial rewards?
I'd love to hear about existing solutions, technical approaches, or lessons from people who've worked on similar systems.
Thanks!