expert-offload

Here are 2 public repositories matching this topic...

mark-yong / dsv41f-sm120-tp3-notes

DeepSeek-V4.1-Flash at TP3 on 3x RTX PRO 6000 (SM120): EXL3 vs official checkpoint + UVA offload, same-box benchmarks, failed attempts, reproducible configs.

benchmark uva quantization cpu-offload blackwell tensor-parallelism vllm llm-inference deepseek sm120 rtx-pro-6000 exl3 expert-offload

Updated Sep 22, 2026
Python

andreyivan4enkov / moe-orbit-prefetch

Star

Object A: MoE orbit prefetch — source+math+215KB trajectories+plots+sparse DeepSeek runtime (Apache-2.0). Analyze without weights; credit on substantial use.

pytorch moe memory-efficient mixture-of-experts huggingface dynamic-inference safetensors llm-inference deepseek sparse-moe expert-prefetch expert-offload

Updated Jul 29, 2026
Python

Add this topic to your repo

To associate your repository with the expert-offload topic, visit your repo's landing page and select "manage topics."

Learn more