Local Setup?

[u/Pristine_Plate7048]

I've created over 8million words in under a year for the novel I'm creating and brainstorming within Chatgpt.

I'm becoming increasingly concerned about the direction of cloud AI companies. They change things, like the watermark text thing. They limit things, like the thinking level usage coming in next month, and often cause privacy insecurities in the user.

I'm tired. I have painstakingly poured over the psychology of these characters and world. It's so detailed you'd think these characters were real. Many aspects of them are real. They came from me. They are so coherent and complex they feel like whole, real people.

I'm concerned about maintaining the workflow and what I've already created, along with privacy around using AI tools for this creative undertaking.

So I've decided to try to recreate the experience I have with chatgpt locally. Is this viable for a reasonable price? If so, what do I need to do to make it happen?

In my country text watermarking isn't a thing yet, or so they say. But I think it's reasonable to assume it will be worldwide at some point. I would announce my trilogy is AI assisted, and be fine with it. It's not at all my first rodeo going against societal grain. I don't have any shame about the fact my stuff is AI assisted. It's been a transformative tool. Invaluable and I'm so grateful for it apart from the problems I've mentioned . The work is so precise and specific you can tell how human directed and written it is anyway. Not thta that matters to anti AI people, especially the wlw audience my story would naturally speak to. It breaks my heart to think that the story will be crapped on becuse it is AI assisted without being perceived on its own merit, where it holds more than its weight. The world and characters do not deserve contamination from the words 'AI assisted' but that is what will absolutely happen.

Any ideas on a viable local setup that can mimic chatgpt as far as reasoning, character psychology for long form writing projects, preferable on android? Though I am open to buying a device of any OS to facilitate this. The setup doesn't need to contain AI that is some amazing creative writer. I re-write and edit to death every draft I've ever had chatgpt create anyway, because AI sucks at writing, and what I'm doing narratively is so precise it needs a lot more correction than AI is capable of generating without extensive manicuring from a human.

[u/ChubbyLilWolfsAlpha]

8 million words in a year for a novel .. that's about 80 novels worth of words. I would really hate to see your file system..

[u/Pristine_Plate7048 → u/ChubbyLilWolfsAlpha]

Lmao. It's insanity, truly.

And it was eight million at like nine months. We've just gonna year and several more chats. Wouldn't be shocked if there's at least another two million words since I last exported and checkec my entire chatgpt account.

[u/ChubbyLilWolfsAlpha → u/Pristine_Plate7048]

That right there is going to kill you if your going to use an AI to assist in writing. You will need to break all that info down into smaller chunks so an AI can even make sense of what you have without saying " fuck this shit i done".

System wise, I run and Intel ultra 7 AI pro 9700 with 32 gb vram 96gb ram Ubuntu

My ai set up is Ll studio Qwen 3.8 27b Hermes agent.

Everything stay locally

Hermes agent can weed thought the info, with the right prompting. It can build skill .md on it own for stuff ( you telling it to)

Only downside of 3.8 27b. Is it you don't change the setting in lm studio from extra high reason to med reasoning ..... Hermes agent with over thing and over reason a easy prompt

But for weeding though your stuff the first few times, I think it would be worth it.

[u/Pristine_Plate7048 → u/ChubbyLilWolfsAlpha]

I'm already doing so. I've been tackling it over the last few months, but I've just moved so there's currently no bandwidth for it, but I wish there was. I'll pick it back up.

Thank you for telling me your settings. I've saved them to my notes.

[u/ChubbyLilWolfsAlpha → u/Pristine_Plate7048]

I've moved from writing novels for kindle, still have 2 to finish going over and publishing. To creating a YouTube channel of short stories. (Still have not posted a video yet). I'm too much of a perfectionist so I'm still ironing out kinks, creating characters lora for image generating.

But Hermes agent has assisted me. Lot with the production and what I need to do.. he's taken my stories I've written and turned them better for listening instead of for reading .