guidellm

Here are 6 public repositories matching this topic...

brtydse100 / vllm-optimizer

Benchmark-driven configuration optimization for vLLM inference servers

python benchmarking machine-learning performance ai offline gpu optimization cuda inference optuna local-first llm vllm guidellm

Updated Sep 4, 2026
Python

InseeFrLab / auto-tuning-vllm

Star

Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)

benchmarking gpu hyperparameter-optimization optuna llmops llm-serving vllm llm-inference speculative-decoding guidellm

Updated Sep 8, 2026
Python

irenakochtov / quantization-serving-vllm

Star

Quantization from first principles + real-world vLLM serving benchmarks — BF16 vs on-the-fly FP8/INT8, measured with guidellm for memory, throughput, and latency trade-offs.

benchmarking inference pytorch quantization int8 mlops fp8 vllm guidellm

Updated Jul 31, 2026
Jupyter Notebook

GoKu1402 / quantized-llm-serving

Star

Measured BF16 vs FP8 serving study on H100: quantization error, vLLM memory, latency, and throughput.

performance-engineering benchmarking inference pytorch quantization llm fp8 vllm h100 guidellm

Updated Aug 31, 2026
Jupyter Notebook

saminkhan1 / llm-serving-benchmark-lab

Star

Artifact-backed LLM serving performance lab for vLLM baselines, official metrics, GuideLLM checks, and SGLang/PD scaffolding

python performance-engineering modal prometheus artifact-evaluation llm llm-serving vllm llm-inference sglang llm-performance gpu-benchmarking guidellm inference-benchmarking serving-metrics

Updated May 21, 2026
Python

cloud-bulldozer / guidellm-results-parser

Star

Results parser for guideLLM with OpenSearch indexing capabilities

python elasticsearch performance opensearch llm guidellm

Updated Sep 8, 2026
Python

Add this topic to your repo

To associate your repository with the guidellm topic, visit your repo's landing page and select "manage topics."

Learn more