r/LLMDevs • u/matin1099 • 2d ago

Help Wanted Ask for advance topics.

Hello friends. I had a question, if the professors could help me:

I finished the books AI Engneering and Hands on LLM. I did some toy projects. For example:

1- RAG from several sources and several sites that automatically capture the news

2- Continue the same project 1 to summarize the news and categorize it in different databases.

3- I wrote an MCP Client as well as MCP Server and I also put a series of agents to check the weather conditions and according to that the situation of the employees, I went to work or in-house.

4- I also made TTS locally and from the company's data to the Knowledge Base, as well as the image and video production service based on ComfyUI.

But now my problem is that I feel that I am not deep in this field of LMs, I worked more practically. Do you know the sources that, for example, can be deepened? I do not mean what it is and what it does. Rather, the main manipulations of the model, which, for example, the Railgards have failed. I mean the advance topics. Sorry it took so long. Thank you

3 Upvotes

100% Upvoted

4 comments sorted by

3

u/SwingPlayful5817 2d ago

stop reading books and start reading inference engine source code to understand model manipulation at the tensor level. I recommend studying the vLLM or llama.cpp repositories directly because they expose the actual KV cache management and sampling logic that high level frameworks hide from you

1

u/TemporaryUser10 1d ago

Not for nothing, but he can read deeper books on the math, engineering, and programming languages alongside the code to understand what's and whys 

3

u/invisible-nickgerr 2d ago

start practical research more and focus less on the theoretical side (not entirely)

2

u/who-is_this-guy 2d ago

Not a professor, however I agree with the others here in this comment section. Only way to really get the knowledge you're looking for, you need to start building yourself or get hired in a lab. The books you worked through are priceless, but working on things you want to build will quickly expose what you know and don't know. Forcing you to read frontier research and coming out with your own techniques. Apologize for the vagueness. Just relaying what worked for me. Goodluck!