All Resources / Topics / Topic / llama.cpp

Resource detail

llama.cpp

Run LLMs locally; quantization, GGUF, and CPU/GPU backends.

Open All Resources Search

intermediate repo

Resource Metadata

Category

Local AI

Provider

curated

Type

repo

Level

unknown

Topic

Local AI (On-Prem / Edge)

Track

Local AI (On-Prem / Edge)

Section

n/a

Format

n/a

Status

publishable

Commercial

unknown

Featured

no

Fast start

no

Sequence

n/a

Priority

n/a

Primary source

open_source_ai_hub_catalog

Sources

learning_paths, open_source_ai_hub_catalog

ID

26679f1ab2f3714f

Fallback Access

https://web.archive.org/web/*/https://github.com/ggerganov/llama.cpp