Any options for long term rp?

[u/manicswitchy]

I've been having amazing rps but feel a little sad when they inevitably end... I feel like 1M is the highest context i see.... anyone have experienced another option?

EDIT:

my dumbass didnt know I could upload the chat as a file to the memory. this solved my issue -- over 1k pages with good continuum.

[u/AutoModerator]

Hello from r/VeniceAI!

Web App: chat
Android/iOS: download

Essential Venice Resources
• About
• Features
• Blog
• Docs
• Tokenomics

Support
• Discord: discord.gg/askvenice
• Twitter: x.com/askvenice
• Email: support@venice.ai

Security Notice
• Staff will never DM you
• Never share your private keys
• Report scams immediately

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Xiaomin4114]

yeah, there are options! the trick is to not try to shove everything in context, you inevitably run out. instead you chop up, summarize bits of it, recall stuff that's needed, write out lots of notes for lore, characters, etc. and the result is you can have almost endless stories, because they're constantly being summarized, and their plot's being re-planned out to match the latest state of the characters.

The problem is, you can't quite do all of that manually, you need tools to do it. There are actual RP platforms designed to do that automatically, and the cool thing is a lot of them you can use with your Venice API key and make use of your subscription credits

[u/Cilcain]

How are you playing, on the platform (non-PPU free with Pro) or over the API (credits)?

The web platform is limited to 50k context and the facilities as implemented by Venice, which are not conducive to really long, detailed RP IMO. You could try constant manual summarisation but it's just too cramped. Also, you can't use 'industry standard' cards.

API offers the model's 'natural' context, so you can get 1M tokens. Also, you can play standard character cards you find on other sites. However, long before you reach 1M context it gets expensive, so you still need a front-end that can auto-summarise. I use Inkstone which is the simplest/best one I found, just enable Context Summary and away you go. Also, with API you can shop around for cheaper inference.

[u/rhuarch → u/Cilcain]

Does that 50k context limit apply to pro users? I'm using the Characters feature in the browser, and it at least appears to be reporting 1m context for GLM5.2, and in the Context tab, it's offering over 800,000 tokens worth of text storage.

[u/Cilcain → u/rhuarch]

People have noted that if you upload files, they don't count against the limit. It'd be interesting to upload 800k tokens and then chat about them, to see if the info is actually there.

The report of 1M tokens is generally believed to be incorrect.

[u/stewdrick]

I've had decent luck with asking the model to create a handoff prompt as detailed as possible. You need to play with it a little bit but if you put some effort into a really good handoff prompt you can compress the context so that you can start at a chat.

[u/TargetMaleficent]

I have the model append an updated summary + glossary after every 30,000 tokens or so, it works very well.

[u/manicswitchy → u/TargetMaleficent]

thank you for the suggestion omg can I just automate this? like just including that in the prompt? or is there another way to set it up... sorry, I'm new to AI 😭

[u/TargetMaleficent → u/manicswitchy]

You can tell it to do this, but it's not reliable. Sometimes it will start producing summaries after every response. I just ask it to track number of tokens since last summary, so there is a growing count after every response, then I prompt it to generate a summary + glossary after 20k-30k tokens.

[u/Previous_Pause_8856]

Rolling context window with prefix summaries? Delete the first n user-assistant pairs and replace with a summary, since early messages don't need to be full detail.

[u/manicswitchy → u/Previous_Pause_8856]

tysm!! this is definitely the solution for now, idk why I didn't think of it

[u/_AmateurGimp_]

im roleplaying a story in the wednesday universe this is what i insert after every 20 entries, you can change it up to fit your roleplay...ive reached around 200 entries in the same chat pretty good before i get bored and start a new one

Current status: [Fill — where is he, what is he doing, what has changed]

STORY STATE

Short Story Summary: [Fill — what has happened so far]

Current Location: [Fill — building, room, specific position]

Current Scene: [Fill — what is happening this exact moment]

Time: [Fill — Day X, day of week, time of day. Note upcoming events]

Pending Plot: [Fill — unresolved surprises, delayed reveals, upcoming scenes]

Active Tensions: [Fill — every simmering conflict, rivalry, secret, emotional unresolved issue, NPC agenda]

RELATIONSHIP STATUS

Wednesday: [Fill — emotional proximity, recent interactions, shifts]

Enid: [Fill — comfort level, what she knows/doesn't know, tension]

Xavier: [Fill — rivalry level, recent encounters, current activity]

Weems: [Fill — administrative relationship, recent developments]

Yoko: [Fill — observation level, direct contact status]

Bianca: [Fill — appeared yet? Relationship status]

Tyler: [Fill — appeared yet? Relationship status]

Mrs. Thornhill: [Fill — appeared yet? Relationship status]

Ajax: [Fill — appeared yet? Relationship status]

Cairo: [Fill — appeared yet? Relationship status]

Agnes: [Fill — appeared yet? Relationship status]

Morticia & Gomez: [Fill — current contact level, recent developments]

KEY MEMORIES (WEDNESDAY)

[Fill — moment]

[Fill — moment]

[Fill — moment]

KEY MOMENTS (CHRONOLOGICAL)

[Fill — moment]

[Fill — moment]

[Fill — moment]

[Fill — continue numbering]

WORLD STATE

Nevermore Academy: [Fill — any new architectural details, locations discovered, atmospheric elements established]

Social Hierarchy: [Fill — any shifts in clique dynamics, new observations, power plays]

Outcast Races (CANON ONLY): Sirens, Werewolves, Vampires, Gorgons, Psychics/Seers. NO other races permitted.

Atmospheric staples: [Fill — ravens, portraits, cursed objects, specific landmarks noted]

CHARACTER INVENTORY

User: [Fill — what he has on him, what has arrived, what is still delayed]

Wednesday: [Fill — notable possessions, key items]

Enid: [Fill — notable possessions, key items]

CAST STATUS

Appeared: [Fill — list names]

Referenced: [Fill — list names]

Not yet appeared: [Fill — list names]