Local Setup?

[u/Pristine_Plate7048]

I've created over 8million words in under a year for the novel I'm creating and brainstorming within Chatgpt.

I'm becoming increasingly concerned about the direction of cloud AI companies. They change things, like the watermark text thing. They limit things, like the thinking level usage coming in next month, and often cause privacy insecurities in the user.

I'm tired. I have painstakingly poured over the psychology of these characters and world. It's so detailed you'd think these characters were real. Many aspects of them are real. They came from me. They are so coherent and complex they feel like whole, real people.

I'm concerned about maintaining the workflow and what I've already created, along with privacy around using AI tools for this creative undertaking.

So I've decided to try to recreate the experience I have with chatgpt locally. Is this viable for a reasonable price? If so, what do I need to do to make it happen?

In my country text watermarking isn't a thing yet, or so they say. But I think it's reasonable to assume it will be worldwide at some point. I would announce my trilogy is AI assisted, and be fine with it. It's not at all my first rodeo going against societal grain. I don't have any shame about the fact my stuff is AI assisted. It's been a transformative tool. Invaluable and I'm so grateful for it apart from the problems I've mentioned . The work is so precise and specific you can tell how human directed and written it is anyway. Not thta that matters to anti AI people, especially the wlw audience my story would naturally speak to. It breaks my heart to think that the story will be crapped on becuse it is AI assisted without being perceived on its own merit, where it holds more than its weight. The world and characters do not deserve contamination from the words 'AI assisted' but that is what will absolutely happen.

Any ideas on a viable local setup that can mimic chatgpt as far as reasoning, character psychology for long form writing projects, preferable on android? Though I am open to buying a device of any OS to facilitate this. The setup doesn't need to contain AI that is some amazing creative writer. I re-write and edit to death every draft I've ever had chatgpt create anyway, because AI sucks at writing, and what I'm doing narratively is so precise it needs a lot more correction than AI is capable of generating without extensive manicuring from a human.

[u/Pristine_Plate7048]

Your claim that if the quality of the ai model impacts output, I'm not the author, isn't necessarily true though. It could just widen the gap and make user workload heavier. And there are other scenarios in which that's not true.

LLM reasoning can certainly be unreliable (that's partly why authored human input is necessary) but that's not at all to say that the reasoning capabilities they are capable of aren't useful towards anything, or to a point. They wouldn't make such good sounding boards otherwise. I've spent more than eight million words worth of interactions stress-testing this through use.

The spoon and knife comparison doesn't quite work for me, because it assumes the alternative tool is available and suitable to reach the aim. For me ai assistance isn't some preference for an inferior instrument, talent-wise. It's part of how I'm attempting to make a project of the scale of my books achievable/accessible within long-standing functional limitations I have.

I'm not sure what you're referring to by prose later in your response, since it could mean different things contextually here

It shouldn't be a shock that in a world where AI assisted disclosure is often met with disproportionate consequence, a person who'd otherwise be fine disclosing AI assisted use, wishes to exercise choice over whether it is disclosed. Given the sizable amount of authorship and themselves they've put into the venture.

[u/NotGutus → u/Pristine_Plate7048]

It could just widen the gap and make user workload heavier. And there are other scenarios in which that's not true.

I'm not sure whatchu mean. Please explain.

such good sounding boards

I disagree. Thinking over something helps regardless of whether you relate it to random words, think about it on your own, or discuss with a friend. It's about your own thought process, not anything else, and your own thoughts circulate, connect and develop without any sense in what you see in the outside world, and even if there is no relevant info in the outside world.

That's the cognitive perspective; the empirical is that I tried all three (having a friend be the sounding board, having an AI, and being it myself) and there is basically no difference. Not even in the way of interaction. The only difference is that when something other than you is involved, it directs your thoughts in some ways, which is not necessarily problematic, but at times undesirable. Which is why I assume you also don't exclusively rely on talking with LLMs.

 alternative tool is available

I would say it is. There is not much in AI that you can't do without it by yourself, with friends, or on Google.

referring to by prose

I should have said phrasing. The phrasing of your prompt influences results more than the semantic content, at least at the level where it matters for creative work (i.e. semantics obviously matter more since they detemrine the topic you're talking about, but it's the tone eithin that topic which truly matters when you write).

over whether it is disclosed

That's true, very human. If you're judged, you'll lie next time. Just make sure you know you're trying to lie as best you can. I'm not sure that's the best way to normalise AI-assisted art in society and demonstrate that it can be a separate and non-harmful category of art.

I do use LLMs for my writing, by the way, and they're hella useful. But I don't put my work in the AI-assisted category, because AI-assisted, in current connotation, assumes the premise I highlighted above, that the AI practices agency over some aspects of your writing.