offloading

Running large language models on a single GPU for throughput-oriented scenarios.

Run Mixtral-8x7B models in Colab or consumer desktops

A QoE-Oriented Computation Offloading Algorithm based on Deep Reinforcement Learning (DRL) for Mobile Edge Computing (MEC) | This algorithm captures the dynamics of the MEC environment by integrating the Dueling Double Deep Q-Network (D3QN) model with Long Short-Term Memory (LSTM) networks.

ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]

LLM Inference on consumer devices

dpdk infrastructure for software acceleration. Currently working on RX and ACL pre-filter

DPU-Powered File System Virtualization over virtio-fs

A collection of tests for the Open vSwitch HW offload.

A Dynamic Programming Offloading Algorithm for Mobile Cloud Computing

Monero hardware wallet protocol implementation for Trezor, agent

LeapIO: Efficient and Portable Virtual NVMe Storage on ARM SoCs (ASPLOS'20)

A framework for IoT devices to offload tasks to the cloud, resulting in efficient computation and decreased cloud costs.

A lightweight framework that enables serverless users to reduce their bills by harvesting non-serverless compute resources such as their VMs, on-premise servers, or personal computers.

The container-based cloud platform for mobile code offloading

30 tok/s for 20B MoE on 8 GB VRAM. Flat throughput to 32K context. Native MXFP4 + GGUF Q4_K/Q5_K/Q6_K via ggml CUDA kernels — zero dequant. Expert offloading for models that don't fit in GPU memory.

Code for paper "Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI" (MobiCom'22)

Monero wallet Trezor integration documentation

Implementation of the RTSS'23 Best Student Paper Award paper Progressive Neural Compression for Adaptive Image Offloading under Timing Constraints

Fedora 42 KDE PLASMA Set UP On Lenovo Ideapad Gaming 3 with NVIDIA