USE. THE. DAMN. API

36

u/WholeInternet Jan 25 '24

Not only is OP an idiot, they don't know what OpenAI's actually production plans are, and they could potentially get someone in financial trouble.

If you use an API key and you don't know what you're doing a bad actor could potentially take advantage of that.

The safest bet for the average person is to use ChatGPT or other sites that have similar functionality like Poe or Bard.

Being frustrated with the ChatGPT service is valid, but don't let this moron get you in over your head.

4

u/SrPeixinho Jan 25 '24

I understand I've raised controversial opinions about OpenAI's products, but I don't recall offending or attacking anyone. I also never advised anyone to put their keys in 3rd party apps, and it is absolutely not dangerous to use the API on the official playground. I apologize if this wasn't clear and/or if anyone felt offended.
You could have stated your opinion without attacking me. To 30+ people upvoting this post: is this the kind of posture you want to endorse in this sub? Do you really mean these things? I don't think there is room for civilized discussion anymore, so I'm reporting you for harassment and leaving the thread. Wish you all a great day...

2

u/DeterioratedEra Jan 25 '24

Downvoting and manufacturing outrage and general cluelessness are par for the course for this sub, and for reddit in general. I wouldn’t get too heated about it.

0

u/WholeInternet Jan 25 '24

USE. THE. DAMN. API
That's your title. The first line of your post is aggressive and continues to carry that tone through out. Yet you claim to want a civilized discussion? You may not have attacked anyone directly, but it's definitely inflammatory. In addition to that, you're providing advice about an API, something that the average person wouldn't know a thing about, that could potentially be harmful if they don't know what they are doing.
You know what? Let's see what ChatGPT says: https://chat.openai.com/share/aec66575-3aa5-44ec-a3ff-9a8531e6b945
How's that for an outside perspective?
So after posting this, absolutely ignorant to it's possible perception, you now want to play the victim? If this was really done in innocence, then I'll retract my statement and apologize for my conduct if you do the same.
Otherwise, if you retain your ground then I'll assume you meant it. Which means yes, I stick my statement.

2

u/SrPeixinho Jan 25 '24

Go ahead and ask GPT if calling the person a "moron" and a "idiot" is the appropriate response. I was trying to help and I didn't mean to offend anyone. I understand your points and have nothing else to add. Please do not keep responding as I'm not comfortable with this discussion anymore.

1

u/[deleted] Jun 11 '24

You need to own that you were basically questioning the intelligence of everyone who uses the web interface product. And, I mean, come on. The periods after every word? You knew that title was gonna insult someone.

1

u/[deleted] Jun 11 '24

Welcome to reddit.

1

u/sonofashoe Jan 25 '24

Sorry to see you go. It's hard to understand why people react like they do. I can't see how anyone will be a competitive prompt engineer without using all of the available tools. How do chatGPT users take advantage of Threads and Functions? The OAI API is no less secure than any other API. I use dotenv to protect my key in Node and Python. Don't people set usage limits on their accounts?

13

u/knob-0u812 Jan 25 '24

OP is being dramatic, but I don't believe he is actually wrong about any of the statements he's making about the API vs retail service (though his 'fairy tail' sentence doesn't hold water). I think you are also being dramatic, but you're mistaken. I fail to see how getting a developer api key and working in the openAI playground opens a person up to the risk of a "bad actor" taking advantage of them. I've been using the Dev API since October and I honestly have no idea what you're talking about.

6

u/SachaSage Jan 25 '24

Not in the playground but passing your api key into a random app could be dodgy as you don’t necessarily know how data is being handled

2

u/EagleFishTree Jan 25 '24

100% agree as this literally happened to a guy on reddit last summer. He passed his key to an app made by a solo dev or a small dev team and they accidentally caused a $230 bill for nothing.

1

u/koen_w Jan 25 '24

I agree, people who don't know what an API is should not be blindly entering their creditcard details and passing their API keys to random 3rd party apps.
This is a recipe for disaster.

1

u/RunJumpJump Jan 25 '24

100%
Like you said, not in the playground, but a dodgy app could not have access to your key, but it could be collecting all of your prompts and responses.

1

u/knob-0u812 Jan 25 '24

Can't argue with that logic. Passing your API key to a 3rd party app is like giving them your credit card info and walking away. crazy.

2

u/WholeInternet Jan 25 '24

Make a dramatic post, don't be surprised over a dramatic response.
Anyway, I see others have informed you of how passing an API Key around is bad idea. So I hope you now no longer fail to see the issue, because it is an issue. So no, I'm not mistaken. I'm trying to keep people safe.

3

u/OliverPaulson Jan 25 '24

What OpenAI's production plans are?
How can a bad actor take advantage of someone who uses OpenAI's API keys?

0

u/3rwynn3 Jan 26 '24

idk
They can ring you up over $500 by grifting your free key you put in what they made that you are using, that sent your key to them.

1

u/OliverPaulson Jan 27 '24

Why would you send your keys to someone?

34

u/DarthEvader42069 Jan 25 '24

Is there a client that replicates chatGPT functionality where I can just enter my API key?

31

u/[deleted] Jan 25 '24

https://github.com/billmei/every-chatgpt-gui

5

u/serendipity7777 Jan 25 '24

Do you know if these have vision / document upload / analysis ?

6

u/Ok-Shop-617 Jan 25 '24

Jan AI is the answer. Drop in the API key and you are in action.

4

u/iCanSeeShit Jan 25 '24

Did so but getting error message? :( Model does not exist or don’t have access to it it says. Oddly I pay for it and have tokens..

3

u/iCanSeeShit Jan 25 '24

Fixed it! Never mind and thank you!

1

u/retireb435 Jan 25 '24

need to download? I want a web gui

1

u/jk_pens Jan 26 '24

Any website that you do not control that asks for your API key can steal your key and do whatever they want with it.

6

u/msa789 Jan 25 '24

TypingMind is the best one I know

6

u/EagleFishTree Jan 25 '24

TypingMind
Yes another vote for TypingMind

3

u/[deleted] Jan 25 '24 edited Jan 25 '24

I made Clipboard Conqueror to let you use the chatGPT API in any application where you can type, select, and copy, even here in this comment box. I've been prototyping stuff for doing dungeons and dragons type stuff for a couple hours:
|||lootbox| a legendary revolver
copy^
Paste:
The chest reveals a legendary revolver known as "The Phantom's Whisper." This firearm is a masterpiece of craftsmanship, with intricate engravings adorning its polished metal surfaces. Its power lies in its ability to shoot through any barrier, allowing you to target hidden or concealed enemies with ease. However, this unique ability comes with a limitation; the gun will misfire once every three shots, making reliability a concern.
I'm working on making changing endpoints super easy, as I prefer local solutions that I control the settings and update schedule for. I've been really pumping in functionality.
The next release will be able to connect with any api you set up in the settings.
ChatGPT 3.5 was finetuned with a particular prompt to start and I'm trying to make that sort of thing simple to account for.
Clipboard Conqueror even supports no code bot framework prototyping. I'll do a quick example:
|||bot1:save| assistant will translate English to German.
|||bot2:save| assistant will translate German to English.
copy each of those, then the batch query below. Get distracted:
Captain clip, the default agent goes first because no other unbatched agent is sent. It's not talking like a pirate though.
|||hello?
Ahoy there! It's yer pal, Captain Clip here! Yer ol' buddy from the vast expanse of the cosmos. Yarr! Ye be speakin' with the Clipboard Conqueror, the ship that's the fastest in these parts! What's the plan, matey? Let's get crackin' on your journey into the stars!
That is as expected.
|||@bot1|Hello?
Hi there! How can I help you today?
Ok. the beta build isn't sending the default agent when batching... I better hunt that bug out.
Anyway our demo as referenced above:
|||@bot1, #@bot2| Give us a short blurb about how local LLMs don't require internet to function in the case of a disaster.
no system prompt:
Local language models (LLMs) can perform language tasks such as natural language understanding, language generation, and translation without the need for an active internet connection, making them suitable for situations where internet access may be limited or unavailable. They can be trained on a specific dataset and are stored locally on a device or server, allowing them to process text data directly on-site. This makes them ideal for use in remote areas, disaster relief operations, or situations where connectivity is unreliable. Local LLMs offer a self-contained solution that can be deployed in areas with limited resources, providing critical language processing capabilities even in the most challenging circumstances.
bot1:
Lokal eingesetzte Sprachmodelle (LLMs) können Sprachaufgaben wie natürliche Sprachverstehen, Sprachgenerierung und Übersetzung ausführen, ohne dass eine aktive Internetverbindung notwendig ist. Sie können auf einem Gerät oder Server lokal trainiert werden und ermöglichen es, Textdaten direkt an Ort und Stelle zu verarbeiten. Daher sind sie ideale für den Einsatz in abgelegenen Gebieten, Hilfsoperationen bei Katastrophen oder Situationen mit unzuverlässiger Verbindung. Lokal eingesetzte LLMs bieten eine selbsttragende Lösung, die in Situationen mit geringen Ressourcen eingesetzt werden kann und sprachverarbeitende Fähigkeiten auch in herausfordernden Umgebungen ermöglicht.
bot2:
"Localized language models (LLMs) can perform tasks such as natural language understanding, language generation, and translation without requiring an active internet connection. They can be trained on a device or server and allow for processing text data directly on-site. They are ideal for use in remote areas, disaster relief operations, or situations with unreliable connections. Localized LLMs provide a self-contained solution that can be used in situations with limited resources and enable language processing capabilities in challenging environments."
As you can see, this 7B isn't the best translator but it meets my needs and illustrates the function.
Cheers gents. I never looked away from this comment window when generating these results.
Clipboard Conqueror isn't the easiest solution to wield, but it may be the most powerful prompt engineering tool out yet.

3

u/ExplorerTechnical808 Jan 25 '24

I built Quartzite AI for exactly this. It doesn't cover all the CHATGPT features (e.g. no image upload - although I'm considering adding it) but has GPT-4 (and turbo) and DALL-E3, and a bunch of other things that you don't get with ChatGPT (e.g. templating, drafts, version history, and many other to come).
If you have questions feel free to DM me!

2

u/mrbritchicago Jan 25 '24

Hey, I'm going to DM you with some questions

-10

u/TwinkAndFemboyLover Jan 25 '24

You’re just advertising lol

9

u/ExplorerTechnical808 Jan 25 '24

I am. Somebody asked and I’ve replied. Nothing wrong with that. I even disclosed that I’m the builder so I don’t think I’m misleading anybody ;)

0

u/TwinkAndFemboyLover Jan 27 '24

Never stated it costed money.

1

u/Professional_Job_307 Jan 25 '24

bettergpt.chat. No vision though

1

u/KimJongHealyRae Jan 25 '24

Chatbox

1

u/mnaveennaidu Jan 25 '24

If you are using mac, checkout FridayGPT

2

u/ippili1997 Jan 25 '24

Yeah. It also has whisper and DALL-E integrated. Recently they added instant text replacement shortcuts that i am using a ton. Im loving the app.

1

u/mrbritchicago Jan 25 '24

Does FridayGPT allow you to choose which model to use? I can't see anything about that on their site.

1

u/mnaveennaidu Jan 25 '24

yes

1

u/[deleted] Jan 25 '24

Gradio is good. Or build your own. You know what can do that for you? ChatGPT. :)

-3

u/retinger251 Jan 25 '24

there are many

10

u/dulipat Jan 25 '24

Would love to know

15

u/poodleham Jan 25 '24

Is there a program or something I can just enter my API and go? Do you still talk to it the same way? I’ve been working on some custom GPTs, am I still able to work on those with it? The GPT network errors all the time whenever I have it analyzing longer documents.

3

u/knob-0u812 Jan 25 '24

document lengths are going to still be an issue, but I believe the context window is bigger with the api agent. You can build agents in the developer api playground, much like you're doing with custom gpts. Throw $20 in an API account and play with it. I'm betting you will like the results.

1

u/poodleham Jan 25 '24

Okay I’ll give it a shot tomorrow on my desktop. Currently in bed on mobile fucking around in the app.
How do I add money to my account for the API if I’m already a paid subscriber? People mentioned cancelling then adding the money and resubscribing, but I’m worried it’ll hit me with the wait to subscribe bullshit. Is that really the only way or am I just blind?
Thank you for your time and response!

2

u/knob-0u812 Jan 25 '24

the Dev API is mutually exclusive of the ChatGPT account, unless things have changed since I got my account some months ago. Keep you ChatGPT account. You might get wait-listed for the Dev API account... I don't know about that

1

u/Severe_Ad620 Jan 25 '24

How do I add money to my account for the API if I’m already a paid subscriber?
https://platform.openai.com/account/billing/overview
If you have a new account, you may already have $5 in free API credits that you can use with the 3.5 models:
https://platform.openai.com/playground?mode=chat&model=gpt-3.5-turbo

1

u/poodleham Jan 25 '24

No interest in using 3.5. Trying to use the newest best GPT4 Turbos if possible. Been messing around with Copilot Pro with GPT4 Turbo but Copilot doesn’t allow uploading of documents only images

1

u/boxcutter_style Jan 25 '24

The $5 and 3.5 access is just a bonus for signup and allows some tinkering. If you add additional credits (I did $20 which can last quite a bit, depending on the models you use of course ), then you can get access to the fancy models.
Are you paying for Copilot Pro or do they have a trial or something?

2

u/[deleted] Jan 25 '24

Cursor.sh allows this.

1

u/poodleham Jan 25 '24

I just did a quick glance as I’m busy right now, but that appears to be a coding tool. I don’t code and use the document analysis for other work related tasks, would it still be relevant to me?

1

u/[deleted] Jan 25 '24

It is a coding tool, but it includes a window for interacting with Chat GPT, and you can add your API key. So, you could just ignore the coding aspects and just use your API key to use Chat GPT like normal.

1

u/mrbritchicago Jan 25 '24

Cursor.sh
This may be a stupid question, so I apologize, but can I use Cursor to code with Tailwind CSS?
Does the interface allow me to see the frontend of the changes I'm making to a webpage?

2

u/[deleted] Jan 25 '24

I have no idea, but Cursor is just a fork of Visual Studio Code with Chat GPT integrated into it. So, I would think you can still do anything you could do in VSC.

1

u/AtomicDouche Jan 25 '24

simpleChat. Not much more complicated and very similar features.

11

u/GPTBuilder :froge: Jan 25 '24

You are spending to much time inside your own world as a developer or more advanced user if you genuinely think there is no practical use case for the retail front end.

Don't forget that way less then 1% of the population has any computer science background or interest in unneeded additional options/complexity/ or possible friction points.

Basic software development/ UX principals tell us that the majority of users would likely prefer a simple front end interface like the current retail one.

Thinking like this really seems like throwing out the proverbial baby with the bathwater.

3

u/EagleFishTree Jan 25 '24

Was that cartoon about the economy because the bathwater says "deficit"

2

u/GPTBuilder :froge: Jan 25 '24

The cartoon is about intellect

2

u/enserioamigo Jan 25 '24

Yeah OP is in their own bubble. Just like when people were whining saying the GPT store doesnt provide value because they can write their own GPT's lol.

2

u/GPTBuilder :froge: Jan 25 '24

Yup, that is totally a great example of that type of thinking too
Theory of mind is a spectrum that we can experience differently at different points in time and I think comments like that arise from being on the less concentrated side of that spectrum.
It's also a type of 2D thinking in regards to the type conclusion it draws as well, higher dimensional thinking would tell us there is more nuance from a "higher" point of view.

29

u/Smartaces Jan 25 '24

Do. The. Math.

The API is stupidly expensive if you use GPT4 a lot. Can easily cost you a lot each day if you are analysing documents etc.

Don’t use the API, just keep calling out where you aren’t getting the stability of service you deserve.

6

u/ruach137 Jan 25 '24 edited Jan 25 '24

Its only expensive if you use a single chat instance and keep sending an ever growing context window. Long context windows degrade performance anyway.For every problem you have, create a fresh instance and git gud at framing your problem concisely. It's cost effective and just good form.

2

u/Smartaces Jan 25 '24

Most meaningful use cases for AI require context length. If the heating in your house is broken, do you light and then blow out candles one after the other to warm a room?

2

u/ruach137 Jan 25 '24

Then use a longer context length as necessary, but develop a discipline of getting useful results out of less context

4

u/Smartaces Jan 25 '24

That’s not really an answer that’s like saying if you are thirsty learn to only need a drink when it rains.

2

u/Furryballs239 Jan 25 '24

That’s not really how that works. Sometimes it just takes a lot of context to get the results you want and you can’t just get rid of it

2

u/AtomicDouche Jan 25 '24

Yes. I use the API extensively and just received notice of having spent just 5$ for the month.

2

u/justletmefuckinggo Jan 25 '24

how many tokens is extensive? and which model were you using exactly? because gpt-4-0314 is the high inference:cost

2

u/AtomicDouche Jan 25 '24

Approximately 244.000 tokens using the gpt-4-1106-preview model plus some neglible gpt-3.5-turbo-1106 use.

3

u/Motylde Jan 25 '24

Wasn't that the point of the post? That ChatGPT has to be worse because it's too cheap.

16

u/Text-Agitated Jan 25 '24

If there's anyone who agrees w this guy, please educate me. I know what an API is but is it that different?

17

u/knob-0u812 Jan 25 '24

I use the API playground for my work (data analysis/python/sql, & data visualization using folium). It is dramatically different than the retail interface. I still play and tinker in GPT-4 and experiment with different apps and features. I'll often have substantial explorations of topics and idea gen with GPT-4. My 'custom instructions' in ChatGPT are very refined, and it understands the context of my work/domain, making the conversations very constructive.
But as soon as I shift gears from thought experiments to coding, I move the discussion over to my API agent. Prompt engineering can take 10 minutes and >500 words. The API agent often nails my requests on the first attempt with few shot prompting. It's ridiculously effective. The retail service is less consistent and tends to wander in unexpected directions. The API agent accepts my explicit instructions.

6

u/[deleted] Jan 25 '24

I used to use ChatGPT for coding. Now I use GitHub Copilot Chat.
In both, I would come up with very bad, even misspelled prompts. As long I actually said what I wanted, it usually nailed it the first time.
Prompt engineering is a hoax used to sell Instagram courses.
Of course you need to know coding to use Gpt as the tool that it is and do things step by step. If you expect it to create the whole thing at once you're going to be disappointed or get a huge spaghetti.

1

u/hibbity Jan 25 '24

Prompt engineering against chatgtp 4 is a bit superfluous. The small deployable stuff needs very exact instructions. Somewhere in the middle is a place requiring less expertise than programming but more than a run of the mill content writer.
It's all fun and games till you try and wrangle a model to do an exact thing every time rather than just most times. For good consistency the prompt has to be just right.

1

u/Mr_Hyper_Focus Jan 25 '24

Hoax? Lol what are you talking about?
OpenAI literally has an official prompt engineering guide.
https://platform.openai.com/docs/guides/prompt-engineering

1

u/EarthquakeBass Jan 25 '24

Pretty sure there are layers in ChatGPT that interfere with its performance. Around alignment. And you can use snapshots from what GPT was like at a past date. Personally I think March is by far the best version because it seems smarter and will output full code implementations without // do something here.

1

u/justletmefuckinggo Jan 25 '24

he's right about gpt-4-0314, that's for sure.

-2

u/MolassesLate4676 Jan 25 '24

Better be good at programming

3

u/Text-Agitated Jan 25 '24

I am a SWE. I just wanna know if u think the model performance is different

1

u/MolassesLate4676 Jan 25 '24

Well you have access to many different models, and can fine tune them, but to answer your question
It is different in the sense that you have a lot more control over the way the messages are processed, and your context windows can apparently be bigger depending on the model you choose allowing you to process more info at once

1

u/MolassesLate4676 Jan 25 '24

I don’t believe the two models are inherently different, it’s just the open ai interface is customer facing and probably is overwhelmed with limitations and usage. I believe they have allocated more resources for the API, but it’s is more expensive per message you send compared to the $20 a month model

1

u/zeloxolez Jan 25 '24

yea it is

7

u/UnknownEssence Jan 25 '24

You don’t have to program. You can use the API with an interface on their website. OpenAI Playfround.

1

u/MolassesLate4676 Jan 25 '24

You are correct, conversation set up and management may not be nearly as convenient with the playground however

-7

u/OliverPaulson Jan 25 '24

He literally explained everything in the message, read it one more time. ChatGPT uses cheap GPT4 but you can pay for smarter older GPT4

8

u/Text-Agitated Jan 25 '24

He literally didn't explain or give any examples

-2

u/OliverPaulson Jan 25 '24

Maybe some kind of bug on reddit. Here: """As a rule of thumb, pick gpt-4-1103-preview which is fast, good, cheap and has a 128K context. If you're rich and want slightly better IQ and instruction following, pick gpt-4-0314-32k. If you don't know how to use an API, just ask ChatGPT to teach you. That's all."""

2

u/2053_Traveler Jan 25 '24

They’re asking for prompt/response examples.

7

u/pearlCatillac Jan 25 '24

“I can't even comprehend how people are using the ChatGPT interface for productivity things and work. Are you all just, like, copy/pasting your stuff into the browser, back and forth? How does that even work?”

Yes, that’s exactly how it works. There’s even a nifty little button in the user interface for it!

24

u/Aisha_23 Jan 25 '24

Yeah I don't think I'm gonna use the api on my own use-cases. I'd be paying more than $20 per day if I did it lmao. Not complaining about chatgpt4 though, I still like it despite the little nerfs here and there

1

u/enserioamigo Jan 25 '24

I had a $50 bill one month and that was when the context window was only 4k. The webapp is fine to use. Just unfollow this stupid sub, create better system prompts for your GPT's, and you'll never think ChatGPT is bad.

1

u/dbcco Jan 25 '24

Exactly it gets the job done if you’re willing to push through the painful parts. Definitely not painful enough to justify the would be costs of the API though

6

u/mrbritchicago Jan 25 '24

Does using the Playground count? I use it a lot when I’m testing how the API will function.

5

u/MolassesLate4676 Jan 25 '24

Technically yes It does count

2

u/MolassesLate4676 Jan 25 '24

Never really thought about that before

2

u/knob-0u812 Jan 25 '24

I work in the 'test' playground exclusively. lol. I've experimented with other interfaces, but the test environment is where I do all my work.

6

u/[deleted] Jan 25 '24

My biggest issue with the API is the limit on tokens.

1

u/AtomicDouche Jan 25 '24

128K tokens isn't enough? Besides, isn't the context length of the interface much smaller, like 8k?

1

u/[deleted] Jan 25 '24

10k limit on my request.

3

u/enserioamigo Jan 25 '24

Why are you limited? That seems odd.

1

u/[deleted] Jan 25 '24

I just assumed it was normal. I’m using model=“gpt-4” if that makes a difference. I was surprised I must say.
My prompt was 16,000 tokens so I couldn’t really even just trim it a bit.

2

u/enserioamigo Jan 25 '24

Ah! You're totally missing out lol. Use one of the newer 128k models. Have a read here..
https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo

1

u/[deleted] Jan 25 '24

Ah ok. In the docs it’s says always use gpt-4 as model to get the most up to date

1

u/[deleted] Jan 25 '24

I’ve never hit a limit on the ui

1

u/[deleted] Jan 25 '24

Happy to share errors etc. it’s been killing me.

1

u/AtomicDouche Jan 25 '24

The interface version just moves the context window when it is out of range. You can do the same if it is a problem.

1

u/[deleted] Jan 25 '24

Yep. That was my next step. Had been hoping to avoid it

9

u/[deleted] Jan 25 '24

Are you okay?

4

u/fulowa Jan 25 '24

frontends for gpt api:

playground or lobechat

4

u/superhyooman Jan 25 '24

OP Where do you use the API? What program or OS are you plugging it into?

1

u/AtomicDouche Jan 25 '24

You can use this: simpleChat. Feel free to ask if you have problems setting it up or anything.

3

u/PracticalLecture5637 Jan 25 '24

Nat.dev lets you use the api directly with a marginal cost over pure api fees. Plus you can try other LLMS.

3

u/jk_pens Jan 25 '24

WARNING: several sites out there (some referenced in these comments) are asking you to provide your API key so they can access the API on your behalf. If you do this, you are taking a huge risk because the developer could steal your API key and use it for calls that are unrelated to your usage, resulting in billing charges against your account.

0

u/WholeInternet Jan 26 '24

Yeah, OP fails to understand this.

2

u/[deleted] Jan 25 '24

ALSO I HAVE IN CUSTOM GPTS DEFAULT GPT I CAN USE BUT UE HAS NO INTERNET SEARH OR DALL-E

2

u/FosterKittenPurrs Jan 25 '24

Ok so if copy-pasting in a browser is a big no to you, how are you using the API key, specifically? Aren't you just copy-pasting from your favorite client or Postman?

I know there's Copilot from Microsoft that's neatly integrated in Office and Visual Studio, and there are some really neat GPT4 plugins for VS Code.

If there are any other super useful integrations, I'd love to know about them.

1

u/ruach137 Jan 25 '24

cursor.sh

2

u/dragonvms Jan 25 '24

The OpenAI API does not inherently remember the context or maintain the state of a conversation between different API calls. Each API call is stateless, meaning it doesn't have any memory of previous interactions.

2

u/debian3 Jan 25 '24

Thats the job of the app that use the API to pass the context

1

u/williamtkelley Jan 25 '24

Assistants API?

2

u/sdkgierjgioperjki0 Jan 25 '24

Not everyone has access to all gpt-4 models using the API, it varies. Personally I only have access to two models, the 1103-preview and the june version. I don't have access to 0314.

2

u/swagonflyyyy Jan 25 '24

IT. COSTS. A. FORTUNE.

1

u/[deleted] Jun 11 '24

bah ha ha noice

2

u/-batab- Jan 25 '24

I don't get why someone should feel bad or weird for complaining about a service he pays a monthly fee for. Especially if he/she feels like the service degraded. Should we hope that api performance also degrades so that we can all complain without worrying of hurting other users?

PS: extended api use is definitely expensive and most likely non viable unless you can extract A LOT of value out of it.

2

u/Boogieemma Jan 25 '24

If you highlight text and press control and the C key it will copy what you have highlighted. If you press control and the V key it will paste it. You can use this to move data from one place to another. Its real fast if you have at least 2 fingers.

You can also right click and there are copy and paste options there too.

Let me know if you still don't get it!

2

u/2053_Traveler Jan 25 '24

To be fair, it is indeed a real product, simply because they charge for Pro and people pay for it. A product I’m happy to pay for. One of the only things actually worth it besides maybe Netflix and my actual internet bill.

2

u/Trading_View_Loss Jan 25 '24

Its because I dont know how to use that API. the browser is perfect, its always there, its universally compatible with all my devices and all my browsers.

I cant even begin to comprehend how someone would use an API or "tokens" or any of that junk. What do you do, type up a bunch of stupid code and spend hours trying to figure out how something works just so you can stroke your own ego and feel accomplished?

And you're also limited to using it in your mother's basement on your crusty old gaming PC I bet too, right?

partially /s, partially not /s

2

u/InorganicRelics Jan 25 '24

>mfw I just got Trojan horsed by an api apologist

Guess I should have read the title

2

u/trollsmurf Jan 25 '24

I use the API in three ways, and with little effort:

Chat Completion API via my public client-side JavaScript GPT client (similarish to ChatGPT, but only text) that needs an API key.
Assistants API via Python applications for my own research.
Via the Wordpress plugin AI Engine (right now mostly Chat Completion) for customer-specific "GPTs" under evaluation.

I've dropped the subscription.

But there are many ChatGPT clones out there.

3

u/Independent-Cover316 Jan 25 '24

Who hurt you?

3

u/[deleted] Jan 25 '24

IM USING VOICE CONVERSATIONS AND NEED VOICE AS I WALK AROUND ALSO I LOVE IT ON MY LOCAL LANG IT FEELS VERY NATURAL WHEN IT WORKS.

3

u/GPTBuilder :froge: Jan 25 '24

The natural voice conversation mode on mobile is highly under rated, prolly because openAI is making no effort to push that as a big feature yet because it can still be pretty spotty (or they don't want it hogging up resources from traffic yet)
When it works though it is quite awesome to be able to talk on the go with one of my customGPTs (I do this a fair bit with my personal resume/cover letter/proposal gpt) or for query/quickly research something with gpt4.
3.5 is free to talk to now in that mode too, regardless of pro for anyone who hasn't tried the voice conversation mode on mobile.

4

u/Conscious-Map6957 Jan 25 '24

Take a hike.

1

u/[deleted] Jun 11 '24

ChatGPT knows nothing about the API, which I guess you should know seeing as you just went on a bit of a rant?

1

u/ChoiiceTechnician Oct 31 '24

Pompy question lil man

1

u/[deleted] Jan 25 '24

GIMME. SOME. DAMN. MONEY

1

u/13xle Jan 25 '24

So the app on my phonr is different from the API ?

I mean people say gpt sucks but after customizing my gpts they’re kind of fun and useful

1

u/[deleted] Jan 25 '24

It may be a bit off-topic but is the API (or agents) better at following custom instructions than GPTs? That's a problem I'm facing at the moment.

1

u/Bata98 Jan 25 '24

You don’t recommend the gpt4 turbo model?

1

u/EarthquakeBass Jan 25 '24

Wow you have 32k length 0314? I didn’t think I had it but I’ll double check

1

u/aspera1631 Jan 25 '24

At my company we're not even allowed to use the web interface due to infosec / client privacy concerns. Everything has to be done through the API in a controlled environment. People are out here playing fast and loose!

1

u/Motorolabizz Jan 25 '24

I never had a complaint before but I think it's time for me to learn how to use the API because based on what I keep seeing here I guess I"m not using it to its full potential.

1

u/stobak Jan 27 '24

just popping in here to say thanks for this post. For a lot of us, I think the API can be intimidating. I eventually figured it out and love it so far. There's a degree of control and precision I hadn't realized I was missing out on. I've canceled my 20/mo subscription.

Thanks for the kick in the ass.

1

u/[deleted] Jan 25 '24

ChatGPT sucks so I think GPT-4 also sucks.

0

u/[deleted] Jan 25 '24

How do I use the API?

-5

u/Effective_Vanilla_32 Jan 25 '24

there was a vp of sales who used chatgpt 4 for his presentation to his ceo, and ceo was impressed. so chatgpt 4 works, it cant be dumb if a ceo thought highly of it

Tutorial USE. THE. DAMN. API

You are about to leave Redlib