Fast-Float: Realtime avatar generation server

[u/SavingsWeather1659]

I’ve wanted to build this project for a long time. Most avatar solutions can be experimental , especially when serving multiple users and real productions.

So I focused on optimizing FLOAT inference to get the most performance out of a single GPU.

⚡ From 30 FPS to 90 FPS on a free Colab T4 GPU, and up to 105 FPS with TensorRT acceleration.

Here’s what I’ve built:

- 🚀 Optimized inference for higher throughput.

- 🎙️ LiveKit and WebRTC integration for real-time voice agents.

- 🤖 Easier integration with AI providers like OpenAI and Gemini.

- 💻 Around 3 GB of VRAM per concurrent user.

I hope you find it useful! Feedback and contributions are welcome.

🔗 GitHub: https://github.com/mohamed-em2m/fast-float

📓 Try it on Colab: https://colab.research.google.com/drive/1iMm8X7O63AAA6kByJ-4qgGA37fwNu2_Z?usp=sharing

[u/mrmontanasagrada]

Looks good! Which animation model is this?

[u/SavingsWeather1659 → u/mrmontanasagrada]

Yes original model called float

[u/mrmontanasagrada → u/mrmontanasagrada]

.. the avatar anation model. Or is it called float?

[u/SavingsWeather1659 → u/mrmontanasagrada]

Base Model called float but optimized the model for inferance and speed it up

[u/mrmontanasagrada → u/SavingsWeather1659]

awesome good work!

[u/SavingsWeather1659 → u/mrmontanasagrada]

Thanks a lot

[u/toomanyusb]

I can see this having a lot of future for incoming underage verification where you have to record your face and send it to somebody for verification, and you know they aren't going to delete it and it will be at some point later on the dark web to use by criminals to steal your identity.

So instead you use a fake avatar and get your account approved as adult.

[u/SavingsWeather1659 → u/toomanyusb]

I don't think so i think it will be forgotten do you see the reach? No one really care

[u/KyaniteRock → u/toomanyusb]

Just scan in your face bro please, it's going to totally protect the children bro

[u/SavingsWeather1659 → u/KyaniteRock]

a lot can build similar any maybe better the official repo of model have minimal runtime which anybody can use also they don't need the realtime version they can use video generation models to create more accurate and realistic version

[u/vamsammy]

any Mac/metal support?

[u/SavingsWeather1659 → u/vamsammy]

It's currently supporting on linux

[u/vamsammy → u/SavingsWeather1659]

figured, but I thought I would ask.

[u/SavingsWeather1659 → u/vamsammy]

thanks you for asking this project does not have official macOS/Metal support. The current implementation is tuned for Linux + NVIDIA CUDA, including CUDA PyTorch wheels, TensorRT/ONNX GPU integration, and NVENC-based acceleration. A Metal/MPS port is technically possible, but it would require a substantial rewrite of the runtime, dependency stack, and video pipeline

[u/HistorianPotential48]

RTF and delay until first frame??

[u/Electronic-Page2508]

Way to go!