Letta Configuration

When to Use This Skill

• Creating agents with specific model configurations
• Adjusting model settings (temperature, max tokens, context window)
• Configuring provider-specific features (OpenAI reasoning, Anthropic thinking)
• Changing models on existing agents

• Setting up BYOK (bring your own key) providers
• Configuring self-hosted deployments with environment variables
• Validating provider credentials
• Setting up custom OpenAI-compatible endpoints

agent-development

Part 1: Model Configuration (Agent-Level)

Model Handles

provider/model-name

openai/

openai/gpt-4o

openai/gpt-4o-mini

anthropic/

anthropic/claude-sonnet-4-5-20250929

google_ai/

google_ai/gemini-2.0-flash

azure/

azure/gpt-4o

bedrock/

bedrock/anthropic.claude-3-5-sonnet

groq/

groq/llama-3.3-70b-versatile

together/

together/meta-llama/Llama-3-70b

openrouter/

openrouter/anthropic/claude-3.5-sonnet

ollama/

ollama/llama3.2

Basic Model Configuration

from letta_client import Letta

client = Letta(api_key="your-api-key")

agent = client.agents.create(
    model="openai/gpt-4o",
    model_settings={
        "provider_type": "openai",  # Required - must match model provider
        "temperature": 0.7,
        "max_output_tokens": 4096,
    },
    context_window_limit=128000
)

Common Settings

provider_type

openai

anthropic

google_ai

temperature

max_output_tokens

Changing an Agent's Model

client.agents.update(
    agent_id=agent.id,
    model="anthropic/claude-sonnet-4-5-20250929",
    model_settings={"provider_type": "anthropic", "temperature": 0.5},
    context_window_limit=64000
)

Provider-Specific Settings

references/provider-settings.md

Part 2: Provider Configuration (Server-Level)

Quick Start

# Add provider via API
python scripts/setup_provider.py --type openai --api-key sk-...

# Generate .env for Docker
python scripts/generate_env.py --providers openai,anthropic,ollama

# Validate credentials
python scripts/validate_provider.py --provider-id provider-xxx

Add BYOK Provider

# Via REST API
curl -X POST http://localhost:8283/v1/providers \
  -H "Content-Type: application/json" \
  -d '{
    "name": "My OpenAI",
    "provider_type": "openai",
    "api_key": "sk-your-key-here"
  }'

Supported Provider Types

openai

anthropic

azure

google_ai

google_vertex

ollama

groq

deepseek

xai

together

mistral

cerebras

bedrock

vllm

sglang

hugging_face

lmstudio_openai

• references/common_providers.md

  - OpenAI, Anthropic, Azure, Google

• references/self_hosted_providers.md

  - Ollama, vLLM, LM Studio

• references/all_providers.md

  - Complete reference

• references/environment_variables.md

  - Docker/self-hosted setup

Anti-Hallucination Checklist

• Model handle uses correct

  provider/model-name

  format

• model_settings

  includes required

  provider_type

  field

• context_window_limit

  is set at agent level, not in

  model_settings

• Provider-specific settings use correct nested structure
• For self-hosted: embedding model is specified
• Temperature is within valid range (0.0-2.0)

Scripts

• scripts/basic_config.py

  - Basic model configuration

• scripts/basic_config.ts

  - TypeScript equivalent

• scripts/change_model.py

  - Changing models on existing agents

• scripts/provider_specific.py

  - OpenAI reasoning, Anthropic thinking

• scripts/setup_provider.py

  - Add providers via REST API

• scripts/validate_provider.py

  - Check provider credentials

• scripts/generate_env.py

  - Generate .env for Docker