Code for https://arxiv.org/pdf/2608.16157
-
Updated
Sep 7, 2026 - Python
#
gpu-offloading
Here are 6 public repositories matching this topic...
Fine-tune and serve large Mixture-of-Experts models on one GPU, with 4-bit experts in GPU memory, RAM or SSD.
cuda transformers pytorch moe lora quantization nvme model-serving fine-tuning mixture-of-experts int4 fp8 llm-training llm-inference qlora bitsandbytes nf4 consumer-gpu mxfp4 gpu-offloading
-
Updated
Oct 8, 2026 - Python
4-bit GPU kernels that compute directly on packed Mixture-of-Experts weights, for training and inference.
cuda pytorch triton moe quantization nvme model-serving gpu-kernels mixture-of-experts int4 fp8 llm-training llm-inference qlora bitsandbytes paged-attention nf4 mxfp4 grouped-gemm gpu-offloading
-
Updated
Oct 8, 2026 - Python
Plan and run Mixture-of-Experts fine-tuning on one GPU: check the machine, fit the model, and keep a report of each run.
cuda pytorch moe quantization fine-tuning mixture-of-experts llm-training qlora consumer-gpu gpu-offloading
-
Updated
Oct 8, 2026 - Python
Trace which MoE experts actually fire and pin the hot ones to GPU - ran Qwen3-30B-A3B at 5.5-7.2 tok/s on a 4GB GTX 1050 Ti
-
Updated
Sep 20, 2026 - Shell
gpu-offload: transparent CPU-to-GPU offloading. Runs the BLAS/LAPACK calls of unmodified programs (NumPy, R, Octave, C, Fortran) on an NVIDIA GPU when a per-machine calibration says it is faster, with CPU fallback. LD_PRELOAD + cuBLAS/cuSOLVER.
performance hpc gpu numpy linear-algebra cuda cublas nvidia scientific-computing gpu-acceleration blas lapack openblas drop-in ld-preload auto-tuning cusolver heterogeneous-computing wsl2 gpu-offloading
-
Updated
Oct 5, 2026 - C
Add this topic to your repo
To associate your repository with the gpu-offloading topic, visit your repo's landing page and select "manage topics."