Model library

Browse our library of open source models that are ready to deploy behind an API endpoint in seconds.

Deploy your own model

All LLM Transcription Text to speech Image generation Embedding

23 TRT-LLM models

Text to speech

Orpheus TTS

TRT-LLM - H100 MIG 40GB

LLM

Qwen 3 4B

V3 - TRT-LLM - H100

LLM

Qwen 3 32B

V3 - TRT-LLM - H100

LLM

DeepSeek-R1 Llama 70B

R1 - Llama - TRT-LLM - H100

LLM

Llama 3.3 70B Instruct

3.3 - TRT-LLM - H100

LLM

DeepSeek-R1 Qwen 32B

R1 - Qwen - TRT-LLM - H100

LLM

Qwen 2.5 14B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 32B Coder Instruct

2.5 - Coder - TRT-LLM - H100

LLM

Qwen 2.5 7B Math Instruct

2.5 - Math - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 8B Instruct

3.1 - Instruct - TRT-LLM - H100

LLM

Qwen 2.5 32B QwQ

2.5 - QwQ - TRT-LLM - H100

LLM

DeepSeek-R1 Qwen 7B

R1 - Qwen - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 Nemotron Ultra 253B

3.1 - Nemotron - TRT-LLM - H100

LLM

Qwen 2.5 72B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 72B Math Instruct

2.5 - Math - TRT-LLM - H100

LLM

Qwen 2.5 14B Coder Instruct

2.5 - Coder - TRT-LLM - H100

LLM

Qwen 2.5 32B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 7B Coder Instruct

2.5 - Coder - TRT-LLM - H100 MIG 40GB

LLM

Qwen 2.5 7B Instruct

2.5 - TRT-LLM - H100 MIG 40GB

LLM

Mistral 7B Instruct

v3 - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 70B Instruct

3.1 - Instruct - TRT-LLM - H100

LLM

Qwen 2.5 3B Instruct

2.5 - TRT-LLM - A10G

LLM

Mixtral 8x7B Instruct

v1 - TRT-LLM - H100

🔥 Trending models

LLM

Qwen 3 235B

V3 - SGLang - H100

Text to speech

Orpheus TTS

TRT-LLM - H100 MIG 40GB

Model API

LLM

DeepSeek-R1

R1 - SGLang - B200

Model API

LLM

Llama 4 Maverick

V4.0 - Instruct - vLLM - B200

Explore Baseten today

Start deploying

Talk to an engineer