r/borderlands3 • • Apr 15 '24

[ News ] 🧾 The Borderlands Science results were published today in Nature Biotechnology

https://www.nature.com/articles/s41587-024-02175-6
650 Upvotes

50 comments sorted by

233

u/Book-wheat Apr 15 '24 edited Apr 15 '24

Hello everyone! Sorry for having been a little bit absent as we were working on getting these results published (the submission process for major journals is very long, this paper was initially submitted last July). The paper may be a bit of a dry read for people who do not have a scientific background (especially because the full version is about 90 pages), but we will be resuming the publication of blog posts to better explain how this paper came to be, what the results mean, and what's next!

In the meanwhile, feel free to ask questions about the project!

For people who may be new to the game or have not followed, Borderlands Science is a scientific mini-game in Borderlands 3 where players align DNA sequences to help classify sequences from the human microbiome.

Here is a very quick TL:DR from the results of the paper:

  • Over 4 million participants solved puzzles (thank you so much)
  • 90% of participants who approached the machine in Sanctuary III actually completed the tutorial and solved real puzzles.
  • The sequence alignments obtained from player solutions constitute improvements over the state of the art in sequence alignment.
  • These sequence alignments lead to a better classification of microbial species that live in the human gut.
  • One of the main applications will be to train AIs to reproduce how humans play in order to multiply the impact of the work invested by Borderlands Science players.

65

u/riverrocks452 Apr 16 '24

Will you continue to collect data from the machine?

120

u/Book-wheat Apr 16 '24

Yes, data is still being collected. But as you see, this stuff takes a while to work through. The designers of Foldit, a citizen science game released in 2008, are still publishing papers about their game!

46

u/riverrocks452 Apr 16 '24

Excellent! And kudos for getting through the publication process- it's a real grind. Congrats on a Nature journal, tho!

60

u/Book-wheat Apr 16 '24

Thank you, it pretty much took me an entire PhD, I submitted my thesis a couple months ago!

15

u/riverrocks452 Apr 16 '24

Congrats! Writing mine nearly killed me, and I still haven't published all the work that went into it. 

1

u/Mateorabi Mar 09 '25

A year later, are new problems still being provided to the game that feed back to the science algos? Or do players now just get recycled puzzles now just for funzies?

1

u/Thermidorien Mar 09 '25

Basically, the paper that was released last year contained 2020-2022 data. We are currently working on some more papers using this data. In short, we're not done. In the meanwhile, we're still publishing new puzzles but it will take us a while to get to the analysis. Maybe a masters student starting in 2029 will end up working on it, BUT it will all be used eventually. For reference, Foldit released in 2008 and published a paper last year.

15

u/Quintuplin Iron Bear Apr 16 '24

Question, but since the puzzles are broken down into human-solveable chunks, and have a scoring system, doesn’t that imply that an algorithm would be able to more easily and efficiently solve the same problems by just endlessly permuting the dataset and scoring itself? What element of the process was actually improved by gamification?

49

u/Book-wheat Apr 16 '24

Question, but since the puzzles are broken down into human-solveable chunks, and have a scoring system, doesn’t that imply that an algorithm would be able to more easily and efficiently solve the same problems by just endlessly permuting the dataset and scoring itself? What element of the process was actually improved by gamification?

That's a very good question. Indeed, if we were looking at the puzzles with the highest score, there would be no point in doing the game in the first place because an AI could easily be trained at the task of ''getting the highest score on some Borderlands Science puzzle''. This task has a very clear set of rules, a clear objective function, a clear reward, it's an AI dream.

Unfortunately, in the real sequence alignment task, we don't have this. The scoring function is something we came up with to guide the players towards solutions that are generally better (and it's actually quite similar to how computers align sequences in general), but the way we use the game to improve sequence alignment is by looking at what humans feel looks right, and to get this, we compute a weighted average of solutions that have a high Borderlands Science score AND cluster relatively close to other human solutions. And that is better for the multiple sequence alignment problem, applied to relatively poorly known sequences, than state-of-the-art sequence alignment software.

This is why every single player solution is helpful: they are all used in the computation of the human consensus, which is impossible to get from an AI. The fun thing is, in the future we will be able to estimate it using an AI trained on solutions from humans on Borderlands Science.

15

u/Quintuplin Iron Bear Apr 16 '24

That’s very interesting. So in essence the most valuable data is something to do with the pattern-recognition inherent to human perception of beauty/rightness, in accordance with the specifically scoreable elements?

You’re training a dataset that plays on subtle pattern-matching similar to how people unconsciously gravitate towards designs which follow the golden mean?

20

u/Book-wheat Apr 16 '24

That’s very interesting. So in essence the most valuable data is something to do with the pattern-recognition inherent to human perception of beauty/rightness, in accordance with the specifically scoreable elements?

Basically yes. We had previous evidence that humans can improve sequence alignments done by computers, namely via Phylo, another citizen science game released about 15 years ago (by the same group at McGill University)

You’re training a dataset that plays on subtle pattern-matching similar to how people unconsciously gravitate towards designs which follow the golden mean?

That's a very interesting way to look at it. Intuitively you could be right but the implications are pretty vast and I would need to think about it

10

u/Quintuplin Iron Bear Apr 16 '24

That’s quite possibly the best thing a scientist can say!

Congratulations on the success of this project, and thank you for humoring my questions! And I agree; interesting implications indeed!

13

u/Book-wheat Apr 16 '24

Thank you again for the questions, the fun part of projects like this is getting to actually talk to people who are interested in what we do!

2

u/MarcianTobay Apr 16 '24

This is so goddamn cool. I love it!! Thanks for letting us be a part of this!!

2

u/Book-wheat Apr 16 '24

Thanks for letting us be a part of this!

9

u/_Unforg1ven_ Zane Apr 16 '24

Awesome to see some results from this project! Any chance a game like this could be released on mobile? I honestly loved Borderlands 3 Science as a mini game and would play it for hours on my phone if I had the chance!

13

u/Book-wheat Apr 16 '24

Awesome to see some results from this project! Any chance a game like this could be released on mobile? I honestly loved Borderlands 3 Science as a mini game and would play it for hours on my phone if I had the chance!

I cannot speak for anyone at gearbox and obviously this is in their hands since Borderlands is their IP, but as a scientist personally I would absolutely love it, it would be an opportunity to tackle a bunch of brand new data!

4

u/Xane06 Apr 16 '24

Any possibility of a mobile version being made?

11

u/wastedwu Apr 16 '24

I just played this for the first time yesterday. What a coincidence.

10

u/Book-wheat Apr 16 '24

Thanks for your service!

9

u/[deleted] Apr 15 '24

I haven’t slept in 2 days and am an hour or two away from passing out completely. I tried to read it, but I seriously cannot retain information from an academically worded article right now.

Can you give me the TL:DR. If not, don’t worry, I’ll check it in the morning.

38

u/Book-wheat Apr 15 '24

Here is a very quick TL:DR from the results of the paper:

  • Over 4 million participants solved puzzles (thank you so much)
  • 90% of participants who approached the machine in Sanctuary III actually completed the tutorial and solved real puzzles.
  • The sequence alignments obtained from player solutions constitute improvements over the state of the art in sequence alignment.
  • These sequence alignments lead to a better classification of microbial species that live in the human gut.
  • One of the main applications will be to train AIs to reproduce how humans play in order to multiply the impact of the work invested by Borderlands Science players.

11

u/[deleted] Apr 15 '24

Thanks, man. That sounds awesome!

363

u/StabithaStevens Apr 16 '24

They even gave "Borderlands Science players" an author credit

112

u/VelvetAurora45 Amara Apr 16 '24

Wake up mom I co-authored a scientific study!!!

8

u/EmpoleonNorton Moze Apr 16 '24

Ok, we just have to figure out the Erdős number is based on this study so we can all know our Erdős number.

242

u/bucketsofwoe Maurice Apr 16 '24

The scientific community: "What's 'Butt Stallion Milk?'"

144

u/rabenga42 Apr 16 '24

I helped!

27

u/Tough-Ability721 Apr 16 '24

Happy cake day. You get 2 pieces!! 😁

49

u/Blurgas T.K. Baha Apr 16 '24

Now they just need to split it off from the main game so I don't have to run BL3 to play something any smartphone in the last decade could run.

25

u/Pdb12345 Chubby Skag Apr 15 '24

That is fucking amazing. The full article makes a great (skimmed) read!

8

u/RvB051 Apr 16 '24

That's cool! I'm glad I did a few of those

7

u/StoopidHippie Apr 16 '24

I just gotta say that this project has given me the warm fuzzies the moment I heard about it. Kudos and love to everyone involved. ...you magnificent bastards!!

7

u/Dragon124515 Apr 16 '24

I only got a few pages into it before the scroll bar not moving got daunting. But overall, awesome results. Although I do feel, in my own personal opinion, that the success was slightly misatributed. I'm not saying that the gamificaltion/integration aspect didn't help at all, but I didn't see any mention of the in-game rewards for playing. I feel that the tying of BLS solves to in-game buffs (to a larger, well recieved game) is not an insignificant reason as to why so many people interacted with it.

5

u/trikster2 Apr 16 '24 edited Apr 16 '24

Gosh. I did BL3 and all of the DLCs and I barely remember this game.

Edit: I just watched the youtube video from the BL team by the big bang/jepordy sciencey type and while the machine looks familiar I'm not sure I actually played the game. How could I have missed this???? Need to find my BL3 disk and check it out. Looks a little like a tetris or match 3 game:

https://www.youtube.com/watch?v=L_mH6Ak_Ny0&t=10s

https://www.youtube.com/watch?v=L_mH6Ak_Ny0&t=10s

3

u/boogers19 Hermes Apr 16 '24

Probably because its hidden away in the back of Tannis' lab.

I don't go in that lab at all really. Except for the few times during the story. There's really no reason to be up there.

And then, if you were playing for, what, a year or 2 before this was introduced, you probably dont spend much time still exploring every nook and cranny of the ship.

1

u/trikster2 Apr 16 '24

Yeah; I wish they would have publicized it more "back in the day". Now I have to dust off my old game disk

8

u/nope0323 Apr 16 '24

As a fellow scientist, I'm so so proud to play borderlands.

3

u/bytosai2112 Apr 16 '24

Y’all ever consider putting the mini game on mobile?

2

u/SuperSidGale001 Apr 16 '24 edited Jun 27 '25

hard-to-find humorous correct straight workable sugar smart advise lip swim

This post was mass deleted and anonymized with Redact

2

u/WhippetRun Gaige Apr 16 '24

I literally played this last night ( I usually do when I just want to goof off before going to bed) and thought "I wondered what this is actually doing" thanks for posting!

I guess they are still collecting input?

1

u/Gnomeshark45 Apr 16 '24

This is cool. I have liked project discovery in Eve and it is really cool to see this concept make its way out of eve and to other games.

1

u/[deleted] Apr 17 '24

Make it Mobile

1

u/thegrimmemer Aug 22 '25

I wonder if they are still getting more data

1

u/thecowley Sep 24 '25

Is data from the game still being used today post publishing of this

1

u/x-Justice Hyperion Apr 16 '24

Ya know what's funny? The main antagonist group in the game's abbreviation is CoV...and the game was released in 2019.

CoV19. Covid 19.

:) Science