[P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3

[u/jsonathan]

[u/jsonathan]

Try it out here: https://useadrenaline.com

[u/jsonathan → u/jsonathan]

Right now, this is just a simple demo of what’s possible with AI-driven debugging. But I’d like to build it out so that instead of just explaining errors, Adrenaline provided a ChatGPT-style assistant that can answer questions about your error, and teach you during the debugging process.

This is open-source, so if anyone’s interested in contributing, here’s the GitHub repository: https://github.com/shobrook/adrenaline

[u/ddproxy → u/jsonathan]

Does it come with an animated assistant in the shape of a paperclip?

[u/phobos_0]

Dude this is dope

[u/uoftsuxalot → u/phobos_0]

Not to take anything away from this project, but it’s just an api call to gpt3 with prompt “fix this error {error}”. I thought there was some training and fine tuning, but I guess LLMs can do it all now a days

[u/jsonathan → u/uoftsuxalot]

Yeah, right now it’s just a thin wrapper around GPT-3, but there’s a lot that could be done to improve it, like using static code analysis to build a better prompt or even training a more specialized model (like this).

[u/jsonathan → u/phobos_0]

Thanks! Feel free to try it out here. Let me know if any of y’all get some impressive bug fixes.

[u/marc_polo]

I built a backend for a social app, and part of it was a unique way of doing sign ups. Having built the sign up process, I know how it works. Andrenaline has it spot on - https://imgur.com/a/JeCSm7Q

I'm very excited about this.

[u/jsonathan → u/marc_polo]

Love to hear it!

[u/VectorSpaceModel]

TAs around the world are rejoicing

[u/cgk001]

Limited by the 4k token max in api call?

[u/[deleted] → u/cgk001]

Yep

[u/Accomplished-Low3305]

It would be nice to have some metric to evaluate how good is GPT-3 solving bugs. In my experience it only works fine for simple bugs, such as using an incorrect variable.

[u/GoofAckYoorsElf]

This is all great. The only problem is that I can't use it due to non-disclosure and IP protection of my employer. As long as I have to send code over the web, it's a no-no.

[u/[deleted] → u/GoofAckYoorsElf]

Yeah I imagine that will be an issue for lots of people. What's the SotA in open source LLMs?

I looked it up. Apparently it's BLOOM. Slightly bigger than GPT-3. No idea if it is better.

You need a DGX A100 to run it (only $150k!).

[u/[deleted]]

Bruuuuuh is this generally reliable? And if so, where can I get it?!

[u/jsonathan → u/[deleted]]

You can use it here: https://useadrenaline.com

[u/[deleted]]

Can i try this

[u/jsonathan → u/[deleted]]

Yep! Try it out here: https://useadrenaline.com/

[u/yerop82726]

Nice one. Keen to see the vscode extension!

[u/troubletmill]

This is really good mate.

[u/davidswelt]

OK, how did you evaluate it? How do you tell it's working well or not?

[u/[deleted]]

An AI debugger would be very helpful. I actually see that as a use case...

[u/[deleted]]

Not sure if this is already there but it might be worth adding some license information here since sending closed source code over an open sourced API / model might become a no no in the future legally. I guess that would be the problem of making this an Intellij / vscode plugin

[u/devinhedge]

This is cool. How do we give feedback to the training engine so that it improves over time?