moe-offloading

Here are 2 public repositories matching this topic...

adrienbrault / glm5.3-flash-2x-rtx5090

GLM-5.3-Flash (321B MoE, 2.05bpw EXL3) on 2× RTX 5090 + 64 GB DDR5, ExLlamaV3 + TabbyAPI. CPU-offloaded experts with runtime hot-expert swaps, exact output: 60 t/s at 1 stream, 110 t/s at 4.

glm quantization mixture-of-experts cpu-offload local-llm llm-inference tabbyapi rtx-5090 exllamav3 exl3 moe-offloading

Updated Oct 10, 2026
Python

midagedev / rig-log

Star

A build log for one workstation: a 284B mixture-of-experts model across two GPUs and 256 GB of RAM, measured.

threadripper mixture-of-experts llama-cpp local-llm gguf speculative-decoding deepseek ik-llama-cpp moe-offloading

Updated Oct 18, 2026
Python

Add this topic to your repo

To associate your repository with the moe-offloading topic, visit your repo's landing page and select "manage topics."

Learn more