Available LLMs

The LLM is the reasoning engine behind every AI Teammate. When a user speaks, their words are transcribed by the STT engine and passed to the LLM, which generates the response that the TTS engine then speaks aloud. Choosing the right model affects response quality, latency, and cost. TruGen supports a range of models across multiple providers, so you can optimise for speed, quality, cost, or compliance depending on your use case.

You can also connect your own LLM: see Bring Your Own LLM. Use the /v1/providers endpoint to always fetch the latest available model list.

Groq

Ultra-low latency inference. Best for real-time conversational agents where response speed and throughput are top priorities.

Model	Model ID	Provider Key	Description
GPT OSS 20b	`openai/gpt-oss-20b`	`groq`	Extremely fast, high-throughput reasoning model. By OpenAI.
GPT OSS 120b	`openai/gpt-oss-120b`	`groq`	Fast, high-throughput OpenAI GPT reasoning model, great at tool calling. By OpenAI.

OpenAI

High-performance models for agentic and multimodal workflows.

Model	Model ID	Provider Key	Description
GPT 5.4 Mini	`openai/gpt-5.4-mini`	`lk-inference`	Built for agentic workflows, fast latency, and excels in multimodal tasks. By OpenAI.

Google

Gemini and Gemma models optimized for reasoning, communication, and efficiency.

Model	Model ID	Provider Key	Description
Gemini 4 31b	`google/gemma-4-31b-it`	`lk-inference`	Best for advanced reasoning, multimodal understanding, and agentic workflows. By Gemini.
Gemini 3.5 Flash Lite	`google/gemini-3.5-flash-lite`	`lk-inference`	Built for fast and efficient AI workflows. By Gemini.
Gemini 3.1 Flash Lite	`google/gemini-3.1-flash-lite`	`lk-inference`	Built for communication. By Gemini.

Kimi

Advanced multimodal models designed for autonomous agents.

Model	Model ID	Provider Key	Description
Kimi K2.6	`moonshotai/kimi-k2.6`	`lk-inference`	Built for agents, multimodal capabilities, and fast inference. By Kimi.

Choosing a Model

Priority	Recommended Model	Model ID
Lowest latency	Groq GPT OSS 20b	`openai/gpt-oss-20b`
Tool calling & high throughput	Groq GPT OSS 120b	`openai/gpt-oss-120b`
Agentic & multimodal	OpenAI GPT 5.4 Mini	`openai/gpt-5.4-mini`
Advanced reasoning	Google Gemini 4 31b	`google/gemma-4-31b-it`
Fast & efficient workflows	Google Gemini 3.5 Flash Lite	`google/gemini-3.5-flash-lite`
Conversational communication	Google Gemini 3.1 Flash Lite	`google/gemini-3.1-flash-lite`
Multimodal & fast inference	Kimi K2.6	`moonshotai/kimi-k2.6`

What’s Next?

Bring Your Own LLM

Connect a self-hosted, fine-tuned, or third-party LLM to your agents.

Prompting Strategies

Write system prompts that get the best out of any model.

Providers

See all STT, LLM, and TTS providers available on TruGen.

Introduction

Models

AI Teammates (Avatars)

Text to Video

Groq

OpenAI

Google

Kimi

Choosing a Model

What’s Next?

Bring Your Own LLM

Prompting Strategies

Providers

​Groq

​OpenAI

​Google

​Kimi

​Choosing a Model

​What’s Next?

Bring Your Own LLM

Prompting Strategies

Providers

Groq

OpenAI

Google

Kimi

Choosing a Model

What’s Next?