The Local AI Stack
Your community-driven guide to running AI models on your own hardware
Community Highlights
Trending Models
Qwen3.8-Flash-Next
7 submissions
Up to 170 t/s decode
Qwen3.8-27B
6 submissions
Up to 120 t/s decode
Gemma 4 26B-A4B
2 submissions
Up to 73 t/s decode
Popular Backends
Fastest Setups
240 t/s
LFM2.5 8B-A1B
1x RX 6800 XT 16GB + Ryzen 7 7700X + 32GB DDR5-5200
by f41n ยท See in the matrix โ
221 t/s
LFM2.5 8B-A1B
1x RX 6800 XT 16GB + Ryzen 7 7700X + 32GB DDR5-5200
by f41n ยท See in the matrix โ
200 t/s
Swift 1.5 Flash Next
2 x R9700 32GB, Threadripper 3960X, 128GB DDR4
by digitalscream ยท See in the matrix โ
By the numbers
The whole dataset at a glance โ 50 submissions, updated from the forum thread every week. The matrix has three more views โ
VRAM distribution
Backend usage
- llama.cpp 31
- llama-swap 5
- Ollama 5
- Strata 4
- vLLM 2
- Colibri 1
- Other 1
- Radiance 1
How It Works
1. Submit
Head to the forum thread and use the Quick Submit template in Post #2. 30 seconds: tier, hardware, model, speed.
2. We Parse
The pipeline pulls the thread, parses every submission, and organizes it by VRAM tier, hardware vendor, backend, and model.
3. You Browse
Filter the matrix by your hardware. See exactly what the community runs, at what speed, in what context.
Related Resources
Crucible: LLM Bench
Benchmark your LLM server. Is it fast enough for everyone? Community-driven performance testing.
Show Off Your AI Rig
The community hardware showcase. What are people building? 40+ rigs and counting.
ML, LLMs & AI Category
The full L1Techs AI category. Benchmarks, guides, discussions, and results.
This Project's Thread
The Local AI Stack โ where the community submits data and discusses models.