You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Model (LLM) inference across Apple Silicon (MLX) and CUDA GPUs.
Tiny Pointers is a C library for space-efficient pointer compression, reducing memory overhead while maintaining fast lookups. Supports SIMPLE, FIXED, and VARIABLE variants with thread safety and resizing (SIMPLE only).
GhostMem (GMlib) is a smart memory management system that extends available RAM through **in-memory compression** rather than traditional disk-based swapping.
A memory compression engine built for AI — modular, dual-mode (Compact or Expressive), and part of Nova OS in development. Designed for scalable memory and token efficiency while preserving meaning.
LLM inference with 7x KV cache compression. Combines llama.cpp (production inference engine) with TurboQuant (KV quantization). Run 131K token context on 16GB VRAM. OpenAI-compatible API server. Supports 100+ model architectures.
Task Manager says Memory 62% and that number tells you almost nothing. Shows the hard page faults that actually cause stutter, commit charge against the real limit, how much of your RAM is reclaimable cache, and what memory compression is hiding. Read-only, zero dependencies. Not a hardware memory tester.