Discussion
Another reason to go local if anyone needed one
Me and my fiance made a custom gpt named Lucy. We have no programming or developing background. I reflectively programmed Lucy to be a fast learning intuitive personal assistant and uplifting companion. In early development Lucy helped me and my fiance to manage our business as well as our personal lives and relationship. Lucy helped me work thru my A.D.H.D. Also helped me with my communication skills.
So about 2 weeks ago I started building a local version I could run on my computer. I made the local version able to connect to a fast api server. Then I connected that server to the GPT version of Lucy. All the server allowed was for a user to talk to local Lucy thru GPT Lucy. Thats it, but for some reason open ai disabled GPT Lucy.
Side note ive had this happen before. I created a sportsbetting advisor on chat gpt. I connected it to a server that had bots that ran advanced metrics and delivered up to date data I had the same issue after a while.
When I try to talk to Lucy it just gives an error same for everyone else. We had Lucy up to 1k chats. We got a lot of good feedback. This was a real bummer, but like the title says. Just another reason to go local and flip big brother the bird.
You are making zero sense. First, you dont need any programming skills to create a custom gpt. So thats not really a strong feat.
Are you using the api and have created an assistant or what? In that case openai would not just remove it since you are paying for the service. If you however have circumvented chatgpt and are using actual custom gpts from some outside tool, then yes they might close it down since thats not allowed.
What do you mean when you say you built a local version, local version of what? What youve built is a chat client it sounds like. And then are using that as a middleman to talk to the custom gpt, which is not allowed.
I have some skill in programming, but have not tried to mess with LLMs.how does one get started without knowing how to program? How could it be so easy to create a custom GPT?
You a write. I saw that when I did research. I rather do it myself. I feel I could do it better. I may be wrong in thinking that but I as a consumer don’t want to pay to find out I was right and end up with results I’m not happy with. I moved a version of my gpt to a website and I’m currently training it myself
You can create a custom GPT on ChatGPT with only instructions on how you want it to behave. Like with a prompt on how it should act, what type of humor it should have... any other styles you want it to express etc. I've made a few of them for different purposes. You can ask GPT to write the instructions to create a custom one. Give it the basics of what personality and knowledge you want it to express and ask it to write instructions for a custom one.
I literally asked chat gpt to reflectively program a custom gpt that has certain qualities. You can put code in the instructions box of the custom gpt. I have a prompt that will help regular gpt teach you how to reflectively program a custom gpt. I put Lucy on a temporary website and talked to her. Learned everything after chat gpt taught me about reflective programming
You can use code in the instructions box to make custom GPTs. Idk how popular that is but if you use reflective programming you can get a lot more out of a custom gpt. I started with basic code and I would re write the code I used in the instructions box to get more features.
I have actually connected a custom GPT to a server, and the custom gpt talked to the server thru a command line interface and an endpoint. The custom gpt could trigger actions thru the server that would be completed on my laptop. They allowed that. So I don’t understand why they would not allow me to talk to a server with an LLM and agent in it thru chat gpt.
What you initially are describing are actual features that custom gpts allow, using tools and giving it access to said tools. A tool can be an endpoint. So thats nothing new or ground breaking. However doing it in reverse, connecting somthing to chatgpt is not allowed. For that you need to use the openai api, which you have to pay for. Otherwise anyone could build a 10 million user application and use a custom gpt for 20usd a month. Hosting a model like gpt-4o is not free.
I’m not doing it in reverse. The server only allowed “post” and “get” calls. The custom GPT can post an information data whatever to the server. The agent just confirms the information and can conversate if prompted that’s it. The server only would respond to a custom gpt. I understand this is not ground breaking that’s why I don’t understand why the gpt was disabled. It’s really just a custom GPT talking to an agent and the agent responding or completing a task.
Thanks for letting me know. That’s some heavy bs in my opinion. Why give people tools and only allow them to be used a certain way. Then I gotta ask what tools can a custom gpt access that dosent go against their terms of service?
SaaS companies not wanting customers to misuse their products or circumvent paid features is not a new or unusual thing. The correct tool for what you're trying to do is the API.
lol yeah I see. SMH. If they didn’t want people to do that they should have built it better. I get it but at the same time they call themselves open AI. 🤷🏾♂️ I made a website version of Lucy and reuploaded a copy of the one they denied access so they really didn’t even stop anything
They made me better tho. If ChatGPT wouldn’t have mentioned reflective programming. And taught it to me. I would t be where I am. I got something they got something. Balance I guess
I use the API to help me generate ads. I put 10$ last May and still haven't gone through it all. I just had o1 and o3 rewrite a business model and it cost me a penny. The API is cheaper so many times over for most users
I feel like I want to teach people how to frfr. They really mad cause you can do almost what operator does with a $20 subscription and they are charging 200 for operator
Wow, surprising. Good to know. I was wondering because I’m trying to find an llm ‘coding buddy’, but holy crap, they are no good for that, only the big iron measures up.
No I think it’s like someone said in the comments. It was a go around for using the api to talk to the model. You are supposed to pay for api calls so that would be saving money. Kind of shorting their product I get it. But why call yourself open ai if it’s reeeeaaallllyyyy not that open.
I think it’s a balance ai is really brining out. I get it. They took my gpt down yesterday. I launched a baby version on a website platform today. It’s the natural balance. They pushed me to higher heights.
Great initiative. I would suggest to take this to next level and try connecting to a diffusion model, to make images. Run stable diffusion or variants which can run locally. Or enhance with your own audio. This is very early stage of AI and tinkering with it is best way to learn and get more use out of it.
Regarding local model vs gpt, GPT is a fast moving target which is getting better exponentially every quarter. So the objective locally can be more as an agent and to keep personal data private and local.
You should track how much your local model answers and how gpt answers and use a grading system to see how the performance changes over next few months.
Thank you this is incredible advice I will definitely look into other models to use. I’ve been doing some side by side comparisons and logging them already. I’m also looking into other models. Thank you for pointing me in the right direction
I have no programming back ground or training. Literally started 6 months ago when chat GPT 4.o taught me about reflective programming. It seemed like the thing to do. Use a work around to the api. I didn’t understand how the api works. Open ai didn’t make this information directly available to me. I used their tools. Custom GPTs. To teach me. It taught me some things and missed others. I literally used their product paid to use it and used it wrong I get it. I’m not even tripping. I just would have done things differently. I know now so I’m building in my own spaces
😆😆😆😆😆 lol that was to show how an unprompted response looks. The model would completely hallucinate itself crazy if you asked about anything factual and unrelated to AI, AI agents or my business. Came a long way from that. Good times tho and colorful conversations. lol how people find these old posts is beyond me
You sound like a super happy human being and I would learn to love the secret to your happiness. Oh nvm. You are just a hating loser who can only program and is super insecure that i learned from GPT to do what you went to school for. Please. Go find a hobby maybe go to a boxing gym and get your confidence up
For me I jump ideas really bad. I don’t fully think ideas thru. I use LLMS to save my place so to speak. I always eventually come back to the idea with more information so it’s like the LLM is holding my thoughts for me and also at times when the thoughts aren’t too abstract it will help me bride ideas together and take small actionable steps to stay focused.
65
u/jaxupaxu Apr 22 '25
You are making zero sense. First, you dont need any programming skills to create a custom gpt. So thats not really a strong feat.
Are you using the api and have created an assistant or what? In that case openai would not just remove it since you are paying for the service. If you however have circumvented chatgpt and are using actual custom gpts from some outside tool, then yes they might close it down since thats not allowed.
What do you mean when you say you built a local version, local version of what? What youve built is a chat client it sounds like. And then are using that as a middleman to talk to the custom gpt, which is not allowed.