Vibe Coding Discover

llama.cpp

LLM inference in C/C++.

★ 129K23,541 forksC++MITggerganov

High-performance C/C++ inference for local LLMs across CPUs, GPUs, and devices.

Use Cases

Local LLMEdge InferencePrivate Apps

Built With

Language: C++
Frameworks: llama.cpp

Tags

C++ · llama.cpp · Inference