made by 0x1da49.com blog

← all reports

Top 163 Local LLM & Edge Inference Engines (July 2026)

repos

Access 163 local LLM runtimes, model quantization toolkits, Ollama extensions, and GPU inference engines released in July 2026.

Local LLMs & Inference — July 31, 2026

GitHub

World Model MCP v0.10.0 – cross-runtime memory across 7 coding agentsSaravananJaichandar/world-model-mcp

GitHub

Transcribe.cpp – ggml speech-to-text inference enginehandy-computer/transcribe.cpp

GitHub

Signal: A draft UX framework for LLM-based systemshi-mundo/SIGNAL

GitHub

LLM Colosseum – A zero-dependency browser RTS to test LLM tool callingasp67/llm-colosseum

GitHub

More AI – Open-source model-agnostic AI desktopDougTrier/MoreAI

GitHub

Self-Hosted Supabase Studio and Vercel Alternatives on One 2GB VPStonyanglesey/llama-apps

GitHub

Muxer – open-source model multiplexer for Claude CodeDangerousYams/muxer

GitHub

Claude-real-video － any LLM can watch a videoHUANGCHIHHUNGLeo/claude-real-video

GitHub

Consult-LLM – A second opinion from another model right in your existing agentraine/consult-llm

GitHub

NVCF: Deploy and Route GPU-Accelerated AI Workloads at ScaleNVIDIA/nvcf

GitHub

Action Preflight: consequence-aware admission for LLM agent actionsgfernandf/agent-skills

GitHub

PrivAiTe: Self-hosted proxy that redacts PII from LLM calls, incl. tool-callscrp4222/PrivAiTe

GitHub

Jamesob's guide to running SOTA LLMs locallyjamesob/local-llm

GitHub

Sharing LLM Artifacts with your teamdanielpang/dropway

GitHub

FEOM – Windows GUI automation at 8ms, no GPU neededa92070888-dev/mcp-os-native-automation

GitHub

Gemma 3 inference in pure C++ with Metal accelerationybubnov/metalchat

GitHub

Overllm – flags where you're paying an LLM to do a regex's jobtheadamdanielsson/overllm

GitHub

Out-of-core LLM inference engine written from scratch in RustVage91/Kortex

GitHub

Codex-review – a read-only cross-model review skill for Claude Codeshimo4228/codex-review

GitHub

Fidx – local semantic search in one SQLite file, no LLM at querywilliamliu-ai/fidx

GitHub

Gubbi – Minimalist LLM Chatbotprahladyeri/gubbi

GitHub

UATC-Closed-loop VRAM control and dynamic data pruning for LLM trainingsajjaddoda72-design/UATC

GitHub

Glyph a blockchain where the proof-of-work is neural network inferenceraphaelwkago69-create/GLYPH

GitHub

Goldseam – heal broken Cypress selectors with a local LLMadam-s/goldseam

GitHub

Sidenote – comment on your rendered blog, an LLM writes the Git diffbharadwaj-pendyala/sidenote

GitHub

Fugu – A multi-agent LLM orchestrator delivered as a single APISakanaAI/fugu

GitHub

AKM-CLR – pre-inference governance for vLLM-style LLM servingirenee28/akm-clr-governance-layer

GitHub

Self Hosted LLM Gateway and Feature Rich Chat UI with RBACcroit/llm-gateway

GitHub

ProGPU – a high-performance, GPU-first UI frameworkwieslawsoltes/ProGPU

GitHub

Otaku – one terminal client for Ollama, LM Studio, and MLXenclavum/otaku

GitHub

Otari: your open-source LLM control planemozilla-ai/otari

GitHub

L9gpu – GPU telemetry that ties each GPU to the K8s pod or Slurm joblast9/gpu-telemetry

GitHub

LLM Thought Visualizationninjahawk/Subtext

GitHub

A calculator CLI to help your agents perform calculations accuratelyfreakynit/llm-calc

GitHub

I built a tiny proxy that gives GLM 5.2 vision (or any text LLM) – MITthomasunise/visionbridge

GitHub

Q a REPL for LLM inside the terminalalaa-alawi/q

GitHub

ForkMind – Git for LLM context: branch, offload, and restore itMedhovarsh/forkmind

GitHub

CodeTalk – recover why AI-written code was written, quoted from Git (zero-LLM)HUKAIR/CodeTalk

GitHub

Open-weights VLA model for 20 robot embodiments (code and checkpoints)robbyant/lingbot-vla-v2

GitHub

Trace – open-source, self-organizing memory for LLM agents (PyPI)husain34/TRACE

+ 123 more verified repositories in full dataset...

Download Repos Book — $19

Executive Intelligence Summary

During July 2026, the Repos tracking engine indexed 163 open-source repositories matching the Local LLMs & Inference cluster.

These projects represent active engineering teams and independent open-source developers shipping production code, architectural prototypes, and developer tooling.

Key Sector Telemetry & Maintainer Trends

Primary Topic Signals: llm (96), model (33), inference (16), gpu (15), local (14), agent (13)
Active Maintainers & Orgs: openai (3), jaurakunal (2), Robbyant (2), logxio (2), PJHkorea (2)
Sample Records Displayed: 40 of 163
Remaining Available in Dataset: 123 records

3 Ways to Monetize & Leverage This Developer Intelligence

1. DevTool Sales & Technical Outbound

Reach out to repository creators who just launched tools in the Local LLMs & Inference space. Maintainers actively shipping code are prime candidates for cloud infrastructure, CI/CD automation, API credits, and developer tools.

2. High-Signal Tech Recruitment

Identify skilled engineers working on bleeding-edge projects. Sourcing talent directly from verified open-source releases gives you verified code samples and active commits.

3. Competitive Intelligence & Directory Building

Import structured repository telemetry into internal dashboards, market landscape charts, or developer directory websites to track where open-source velocity is concentrating.

Developer Usage Recipe

import pandas as pd

# Load Repos Master Index
df = pd.read_csv("repos.csv")

# Filter for July 2026 records in this sector
sector_repos = df[df["month"] == "2026-07"]
print(f"Loaded {len(sector_repos):,} open-source repositories from July 2026")

If you need the full dataset of 19,400+ developer repository records formatted for instant use in spreadsheets, pipelines, or databases, check out the Repos Master Dataset.

related reports →

2026Top 45 Local LLM & Edge Inference Engines (September 2026)

2026Top 158 Local LLM & Edge Inference Engines (August 2026)

2026Top 121 Local LLM & Edge Inference Engines (June 2026)

2026Top 125 Local LLM & Edge Inference Engines (May 2026)

2026Top 148 Local LLM & Edge Inference Engines (April 2026)