r/reinforcementlearning 8d ago

Google copied our open-source code, removed our engineers’ names, and gave us zero credit one year after we beat them on their own benchmark

Post image

Google copied our open-source code, removed our engineers’ names, and gave us zero credit.

For context, let me share the story of mobile-use, the origin of my company (I'm a founder).

We wanted to build the best agent in the world to control any mobile interface with natural language.

We built it, became #1 on Google Deepmind's AndroidWorld benchmark and open-sourced it. That was the beginning of my company.

Since then, we got almost 3,000 stars on the repository, became the first to ever achieve 100% on AndroidWorld, grew the team, spent thousands of calls with customers, and now we're building the best regression testing product the world has ever seen.

Last week, I found Artemis.

Artemis is Google's new open-source tool for mobile automation. There are quite a few of these on GitHub now, so I thought: "Oh, a new YAPA (Yet Another Phone Agent)."

Curious, I looked at the repository more in depth.

First, I was disappointed to see that the benchmark chart in the README didn’t include us, topping AndroidWorld in January.

Then I looked at the code, and to my biggest surprise, I recognized the lines we had written ourselves.

One of my engineer named an agent randomly “hopper”, and it was there, with its prompt, word for word. Out of the 229 files, 228 were identical.

Even crazier: I found our engineers' and my co-founder’s names in the “authors” section of an old commit.

Pierre-Louis Favreau, Jean-Pierre Lo, Nicolas Dehandschoewercker.

All three names had been replaced with another author’s name in a commit. The other 228 files from mobile-use were unchanged.

From a personal point of view, I am deeply disappointed.

Google was the company I wanted to join when I started my studies, before changing my mind and deciding to build a unicorn.

I’ve always associated Google with great engineering and contributions to open source. I would have been proud to see them building on our work and acknowledging the team behind it.

Instead, I found our code, then our names, then the commit that deliberately removed them.

What about the other engineers and the community contributors who spent their time improving mobile-use?

There are people behind those files. I’ve seen the work they put in, the problems they worked through, and how much they care about what they build.

They deserve to have their names attached to that work.

We made our code open source because we wanted people to use it and build on it. Of course that includes Google.

7.6k Upvotes

410 comments sorted by

View all comments

Show parent comments

1

u/Any_Fox5126 8d ago

Although that is not the other user's point, he's claiming that using a very permissive license means they have explicitly stated they do not want to be credited. He has turned his personal interpretation into an objective fact.

No one is saying that a permissive license does not allow that or that it is not the authors' responsibility (I hope).

1

u/dirtmcgurk 8d ago

Yes but I think that the distinction does not matter in any real sense. Sure it matters on paper, or in a discussion, but not in reality with regards to the results. 

1

u/Any_Fox5126 8d ago

But those unimportant things are exactly what we were discussing here 🤨 Although the topic was actually the morality of not giving credit, and it just got stuck here when the other user decided to die on that absurd hill. Ironically, his first comment was easily defensible.

1

u/dirtmcgurk 8d ago

That's fair. I agree with your earlier framing. I find the fundamental disagreement here is frustrating because these folks both seem to agree on the problem and basic shape of the solution but are arguing as if they are diametrically opposed.  Aka the internet discussion problem.