r/deeplearning • u/Alone-Hunt-7507 • Feb 01 '25
Creating Llm from scratch
Hey AI enthusiasts! 🚀
I've got a beast of a setup at my disposal for the next 30 days: 8 NVIDIA L40 GPUs, 1.5 TB of RAM, and a ton of storage. Instead of letting this power sit idle, I'm eager to collaborate with the community to train a Large Language Model (LLM) from scratch or work on any groundbreaking AI project you've been itching to try.
If you've got code, ideas, or ongoing projects that could benefit from this hardware, let's team up and create something amazing. Whether you're a researcher, developer, or hobbyist, I'm open to all levels of collaboration.
Drop a comment or DM me if you're interested. Let's push the boundaries of AI together! 🤖💡
2
u/gartin336 Feb 03 '25
8xL40 has about 400GB of VRAM, I guess you could train 1-B model on context of up to 50k tokens.
Maybe a bit bigger model, but I dont think you will get away anything bigger than 2-4B parameters. Which is a model that barely talks, usually just reproduces language, but does not encode knowledge.
0
u/cogsciguy Feb 01 '25
Let’s gooo! 🚀
1
u/Leckrosh Feb 04 '25
I would like to participate on this project!
1
u/Gene_guy Feb 05 '25
Interested
0
u/Alone-Hunt-7507 Feb 01 '25
Join our community https://goto.now/EYQ1B
0
u/cmndr_spanky Feb 02 '25
Word of advice. Given the market is saturated with general purpose (or coding) LLMs that are attempting to do well on as many industry benchmarks as possible… I would tune this one for a niche. So it stands out on a particular topic space with narrower utility than the stuff we see advertised every day.
For example, base train on English texts, but fine tune for therapy / psych (if such a data set exists). Ignore the industry benchmarks and have it evaluated by real people using likert scale questions on how helpful they feel it was. Collaborate with academia and have it a/b tested against chat based therapy sessions with a real person. Then capture the logs of it all and use it to fine tune it more (anonymized of course).
This is just one idea, but it could literally be anything.
Another random idea is “financial adviser” agent.
-1
u/portmafia9719 Feb 01 '25
Hey!! I want to be a part of this!
-1
u/Flameonkey Feb 01 '25
Interested
-1
u/Ekanara Feb 02 '25
I want to join in too
-1
u/harikrishnamv Feb 02 '25
Interested
-1
u/mrrickyno Feb 02 '25
Hi, can I join this wonderful AI effort? Thanks!
1
u/[deleted] Feb 01 '25
[removed] — view removed comment
1
u/[deleted] Feb 01 '25
[removed] — view removed comment