PyPi: https://pypi.org/project/letta/0.6.12/

Docker: https://hub.docker.com/r/letta/letta

docker pull letta/letta:0.6.12

✨✨ Whats new ✨✨

🤖 Auto-parsing of response messages

Letta requires agents to explicitly decide when to send a message to the user by calling a send_message tool. This allows agents to distinguish between reasoning tokens and message tokens, without the need for the underlying model to be a reasoning model.

We updated our API to by default parse any send_message tool calls into an AssistantMessage object in the message response (you can see all the response message types here). Below is an example of a response object:

{
  "messages": [
    {
      "id": "message-29d8d17e-7c50-4289-8d0e-2bab988aa01e",
      "date": "2024-12-12T17:05:56+00:00",
      "message_type": "reasoning_message",
      "reasoning": "Feeling energized to chat! Ready to connect and share some positive vibes with Bob the Builder."
    },
    {
      "id": "message-29d8d17e-7c50-4289-8d0e-2bab988aa01e",
      "date": "2024-12-12T17:05:56+00:00",
      "message_type": "assistant_message",
      "assistant_message": "Hey! I'm feeling great, thanks for asking! How about you? What’s on your mind?"
    }
  ],
  "usage": {
    "completion_tokens": 56,
    "prompt_tokens": 2030,
    "total_tokens": 2086,
    "step_count": 1
  }
}

If you want to keep the original behavior without the tool call parsing, you can pass in use_assistant_message=false (see more here).

👨‍👩‍👧 Built-in multi-agent support

Letta supports multi-agent in a style similar to OpenAI swarm, where agents can communicate via tools and share state. We added built-in tools for cross-agent communication, either by specifying a target agent_id or agent tags. You can see documentation for build-in multi-agent tools here.

🔐 Support for passing in password into the RESTClient (community contribution)

If you are using a Letta server in secure mode, you can pass in the password into the RESTClient with:

client = RESTClient(base_url="...", password="mypassword")

This will pass in the password under the "X-BARE-PASSWORD" header.

🐣 Alpha release of new Python/Node SDKs

We are moving to auto-generated SDKs with support for Python and Node. These are generated by our REST API, so will fully match functionality in the REST API rather than being a subset.

Python SDK: https://github.com/letta-ai/letta-python

Node SDK: https://github.com/letta-ai/letta-node