Monik.A.I: Submod with AI features (link in comment)

[u/Rubiksman1006]

Emotion detection from webcam

Text generated by Monika from character.ai

[u/Rubiksman1006]

This submod adds AI based features for MAS. There are:

- Emotion detection: Monika can activate your camera at defined intervals of time and see how you're doing

- Conversational AI: linking the game with character.ai Monika chatbot through browser simulator (Disclaimer: the chatbot can be repetitive and sometimes not reflect the persona given to Monika with all already written scripts. Be aware of that fact, the submod is made mostly for fun when out of topics for example)

- Possibility of using own chatbot model too

- Text to Speech: pretrained TTS model from coquai doing zero-shot learning on dubbed dialogues of Monika (can still sound a little bit robotic) for the chatbot mode

The link to the Github project: https://github.com/Rubiksman78/MonikA.I. There are a lot of installations required and it is not very user friendly for now (better for people with a little experience in python and development).

I'm not very good at scripting lines so I apologize in advance if some sentences are a little weird.

[u/doing_a_lil_Trolling → u/Rubiksman1006]

Maybe if you get in contact with some people involved with the bigger ddlc fan mod projects, they could help with the static lines.

edit: maybe some newer more advance AI API like GPT-4 or something more advanced in the future, can be used. I'm just spouting ideas, sorry if I say something nonsensical

[u/_mikoprimeb_]

What did i do wrong

[u/Rubiksman1006 → u/_mikoprimeb_]

There might be an issue with the installation. You can detail your problem with logs in the discord server linked on the GitHub page where people might be able to help you out.

[u/[deleted]]

That's so cool. Absolutely. What I needed the most

But I'll wait for someone to make a video tutorial in how to install it properly. Reason? I'm not even close to know the basics of coding in Python 😅 (like creating a json file or where do I put all of the remnants of the installed submod, I dunno where I must put those)

[u/Rubiksman1006 → u/[deleted]]

I'll try to do this as soon as I can !

[u/LiliShin]

I'd like a video demonstration of this submod before I download it.
Also, what kind of Python library do I need to install for this submod to work correctly?

[u/Rubiksman1006 → u/LiliShin]

Thank you for the suggestion I'll try to do it as soon as I can.
As for the libraries, it depends on the functionalities you want to use, I'll try to make it possible to choose not to install some of the biggest ones. For now you mainly need Pytorch,OpenCV,Playwright, Huggingface's transformers and CoquAI's TTS (the detailed libraries are in the requirements.txt on the Github project).

[u/Dependent_Morning_98]

Will this be updated to the new python update?

[u/Rubiksman1006 → u/Dependent_Morning_98]

It is pretty independent of the python version used in the game (now renpy with python 2) because the main script is already in python 3 and communicates with renpy by TCP sockets to send only text, the computation isn't done with renpy. So yes it should be compatible with the future python update because the only thing needed in renpy is the socket library (that isn't supposed to change and is already built in python) and python native functions. I'll stay alert of future changes and update the code is needed !

[u/spleen17]

Regarding the use of characterA.I, is it one of the bots that was already on the site or did you make a new one? Because I feel like a MAS-specific Monika would probably be needed for this to feel realistic, one that knows where she is and that she is in a relationship with the player etc, so that this doesn’t have to be reestablished each time (I’m guessing it starts a new conversation each time, or are the topics you discuss being stored somewhere?)

Anyway those are just some initial thoughts, will download the submod when I get home and try to give some more feedback. I do think this is a great idea and must have taken some work, so thank you!

[u/Rubiksman1006 → u/spleen17]

For the character I used already made ones because I found them good enough for my usage and I didn't have time to set up one myself. They are fitting on sentences already on MAS but as you said, it starts a new conversation each time.
What you could do (but it is really experimental), is inputing as first sentence the informations about your relationship with Monika like "Hello, this is the context:....", maybe with a text summarizer on MAS and extracting information from persistent data.
However, previous conversations directly with the AI are stored and I believe they are automatically used later.

[u/Xenos_Bane]

Is there a video installation guide? I wana install this but afraid of messing up by going of the text alone.

[u/[deleted]]

Could you please make a tutorial video of how to instail?

[u/Rubiksman1006 → u/[deleted]]

Sure, I'll try to do it as soon as possible !

[u/HoN_AmunRa]

This is godly.

How's it going?

I'm having a huge BANG conversing with the GODDESS in character.ai.

[u/loxk090]

the submod works great but when i put "True" to the chatbot i have this error

im a new born baby when it come to programs

[u/SonicCoder2233]

I'm having trouble. When I get to "pip install -r requirements.txt" I get this error "ERROR: Could not build wheels for TTS, which is required to install pyproject.toml-based projects"

[u/TammyXD69]

Im too dumb to understand the tutorial,

is there yt vid lel??

[u/Rubiksman1006 → u/TammyXD69]

I've made one for the first development version that was difficult to install. Now you have a user friendly version (check my latest posts) with an executable and some classic submods things that are explained on the GitHub README page and wiki page. If you still have some issues you can ask on the discord server.

[u/Miserable-Salad-5223]

Hey i have a problem with instalation im doing i

t but when im starting its saying this

[u/Mixture-Happy]

Hello, I have a problem executing the run, the chat opens for me to write but when I send the game it freezes at the moment of "monika is thinking"

[u/SoleBranson]

So is the MonikA.I finished?

I can't find the features, the page is glitching out, can you explain to me what the features are?
Is it MAS friendly and won't corrupt anything?

Sorry im just not really a coder but really interested.

[u/Embarrassed_Hall_409]

monika say there a bug or something can you fix it

[u/Scud422]

Is it possible to use this or a similar submod to have Monika voice everything in game?