gguf-models

LeanType is an Open-source keyboard, fork of HeliBoard with additional features and customisation

This custom_node for ComfyUI adds one-click "Virtual VRAM" for any UNet and CLIP loader as well MultiGPU integration in WanVideoWrapper, managing the offload/Block Swap of layers to DRAM *or* VRAM to maximize the latent space of your card. Also includes nodes for directly loading entire components (UNet, CLIP, VAE) onto the device you choose

My public AI learning journey — sharing what I learn, build, test, and discover across AI. Traffic: 7K+ monthly clicks · 150K+ AI citations/month · 5.5 average search position across search engines. local-ai-zone.github.io

A quant trading system platform based on FinGPT, demonstrating new applications of large pre-trained Language Models in quantitative finance.

On-device AI chat for iOS. Private, offline-first. Runs open-weight LLMs via llama.rn with semantic memory - no cloud, no API keys

Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.

Inspect LLM's logprobs and perplexity over a piece of text, or compare two LLMs (like a git diff)

Obrew Server: A self-hostable machine learning engine. Build agents and schedule workflows private to you.

Run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1, and other state-of-the-art language models locally with scorching-fast performance. Inferno provides an intuitive CLI and an OpenAI/Ollama-compatible API, putting the inferno of AI innovation directly in your hands.

Your terminal's AI co-pilot. Describe your intent and get the command.

Run GGUF through llama.cpp and SafeTensors through vLLM behind one OpenAI-compatible endpoint. Your coding tools select a model; the switchboard manages the local runtime, process, and resident-model change.

DoE Janus Architecture: Democracy of Experts

YENT: You. Exist. No. Translation.

Running GGUF-Format ML Models in Pure Go

Create out symbolic links for the GGUF Models in Ollama Blobs. for use in other applications such as Llama.cpp/Jan/LMStudio etc. / 将 Ollama GGUF 模型文件软链接出，以便其他应用使用。

An offline AI chat application built specifically for Ubuntu Touch, allowing users to run lightweight Large Language Models (LLMs) directly on their mobile device.

Simple Python Script that converts the Weight of a GGUF Model to a PyTorch Tensor

Web UI for orchestrating distributed llama.cpp RPC GPU clusters with auto node discovery, telemetry, and one-click deployment.

Fatrocu converts your e-archive invoices, cash register receipts, and receipts into Excel format within minutes using a 100% locally running AI, drastically reducing manual data entry.

RA Local AI – Run GGUF models on your Android phone and chat fully offline.