Pankaj Gupta

Co-Founder

Infrastructure

Testing Llama 3.3 70B inference performance on NVIDIA GH200 in Lambda Cloud

Pankaj Gupta
1 other
Testing GH200 GPUs
Model performance

Driving model performance optimization: 2024 highlights

Pankaj Gupta
MP 2024 highlights
Model performance

How we built production-ready speculative decoding with TensorRT-LLM

Pankaj Gupta
2 others
Speculative Decoding with TensorRT-LLM
Model performance

A quick introduction to speculative decoding

Pankaj Gupta
2 others
Intro to Speculative Decoding
Infrastructure

Evaluating NVIDIA H200 Tensor Core GPUs for LLM inference

Pankaj Gupta
1 other
NVIDIA H200
Model performance

How to serve 10,000 fine-tuned LLMs from a single GPU

Pankaj Gupta
1 other
10,000 LoRAs 1 GPU
Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard
3 others
H100 MIGs
Model performance

Benchmarking fast Mistral 7B inference

Abu Qader
3 others
Mistral 7B
Model performance

33% faster LLM inference with FP8 quantization

Pankaj Gupta
1 other
Faster inference with FP8
12

Explore Baseten today

Start deploying
Talk to an engineer