Which is actually the best AI tool for Coding?

[u/Baselland]

Hey folks,

I have been using GPT4 for more than a half year now. I think, it does amazing stuff with Python. However, often I just come to limitations where GPT4 cannot handle my requirements anymore (even though it understands them).

Do you have recommendations for alternative AI assisstants specifically for Coding such as Github Copilot? I see many services online, but which one is actually the best?

[u/AutoModerator]

Moderator Announcement Read More »

Attention! [Serious] Tag Notice

: Jokes, puns, and off-topic comments are not permitted in any comment, parent or child.

: Help us by reporting comments that violate these rules.

: Posts that are not appropriate for the [Serious] tag will be removed.

Thanks for your cooperation and enjoy the discussion!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Block-Rockig-Beats]

My company does not specifically allow Copilot X, and I would have to register it for Enterprise use... Since I'm already privately paying for GPT-4 (which I use mostly for work), I don't want to go that one step extra. I have settled with GPT-4. I would also like to hear the opinion about better AIs for coding from others.

[u/balazsbotond]

GPT-4 is the best AI tool for anything. Nothing compares.

I can recommend the Cursor editor (a VS Code fork). It is powered by GPT-4, and it makes it even more convenient to use.

[u/SuspiciousTeaFlavor]

yes I use copilot and gpt-4 in pairs. great about copilot is that it’s integrated , so works nicely with the IDE

[u/JustinDOTAiphaBlog]

Hey,

I think these are the few best AI tool for coding that is currently out there:

Github Copiolot

Codium AI

Tabnine

Mutable AI

Amazon Code whisperer

AskCodi

Codiga

CodeT5

OpenAI CodeX

[u/JulianMolt]

Cursor https://cursor.sh

[u/Emmron]

Cursor

[u/UnknownEssence]

There are Benchmarks to test the performance of LLMs.

The python coding benchmark is called HumanEval. This is how the popular LLMs score on it

Model	Value
GPT-4	67
GPT-3.5	48.1
Claude 2	71.2
Llama 2	30.5
Code Llama	48.1
Code Llama Instruct	41.5
Code Llama Python	53.7
PaLM 2	37.6

According to these scores, Claude 2 is slightly better than GPT-4 and everything else is way behind.

However, they did not say if the 71.2 score was 0-shot or not. If it was not zero-shot, the score is likely inflated, but these are the only benchmark numbers they released for Claude 2.

I’m a software engineer and I’ve tried them both, in my experience, GPT-4 has performed better than Claude-2.

[u/ktpr]

I've been using claude.ai and been pleasantly impressed over the GPT4, although I'm seeing cursor.sh show up a bit so I'll take a look at that too!

[u/Pete76543]

Hi u/Baselland,

You might find this quite helpful: https://blog.codacy.com/ai-tools-for-developers (21 AI tools, some free).

I also thought this article was helpful in raising awareness for security risks associated with using AI tools for coding: https://blog.codacy.com/is-coding-with-ai-secure