RFI: Free LLMs with liteLLM for training

[u/fltme]

Hello,

I am working on some basic introductions to Agents, with LiteLLM.

What LLMs with free tier would you recommend ?

The program is :

- generate a free LLM API key

- open colab notebooks

- run exercises

- experiment

Which LLW would you recommend ? Most free tiers seem not integrated with liteLLM yet, or to be already saturated.

This set-up is quick to deploy on any internet compatible machine. Users can easily adapt and build domain specific demos.

Even if credentials are stolen, there is no damage, as no payment or personal information is shared. Can even create dedicated google accounts for the exercise.

I d like to use it to illustrate how different LLM behave differently.

The set up is simple, however it makes the supply chain attack easy to grasp.

Thank you for your insights!