All Resources / Topics / Topic / llama.cpp

Resource detail

llama.cpp

Core local inference stack for CPU / GPU quantized deployment and experimentation.

Open Learn All Resources Search

beginner docs foundation ggml-org inference-engine learning-paths llm-engineering local-ai rag repo

Resource Metadata

Provider

ggml-org

Type

repo

Level

Foundation

Topic

Local AI / LLM Engineering / RAG

Track

Local AI / LLM Engineering / RAG

Section

Learning path

Format

Repo / docs

Status

publishable

Commercial

candidate

Featured

Fast start

yes

Sequence

3.0

Priority

Fast

Primary source

direct_links_master

Sources

direct_links_master, mega_open_hub

ID

baed814293f774c7

Open Resource

Fallback Access

https://web.archive.org/web/*/https://github.com/ggml-org/llama.cpp

Continue Learning

Keep momentum with nearby resources and structured tracks.

Learning placement: track: Local AI / LLM Engineering / RAG · stage: Foundation

Tags: beginner docs foundation ggml-org inference-engine learning-paths llm-engineering local-ai rag repo

More in this topic More by provider More of this type Learning Hub Start Here

Related Resources

Similar items by topic, tags, and provider (metadata-only).

repoAdvancedggml

llama.cpp Build Guide

ggml

Build instructions for local compilation, hardware backends, and the project toolchain.

Open Source

reponanGitHub

Natural Instructions

GitHub

Large collection of NLP tasks with human-readable instructions.

Open Source

reponanGitHub

FLAN Collection

GitHub

One of the best open instruction mixtures; includes FLAN, P3, Super-Natural Instructions, and more.

Open Source

datasetfoundationMIT

MIT OpenCourseWare

MIT

Excellent lecture notes, exams, and videos across advanced technical topics.

Open Source

docsZeroOllama

Ollama

Fastest path to running modern local models on a workstation.

Open Source

docsFoundationOllama

Ollama Docs

Ollama

Official documentation for running and integrating local models with a simple developer workflow.

Open Source

repoAdvancedMeta

FAISS

Hugging Face Datasets documentation

Hugging Face

Essential for loading, cleaning, streaming, and publishing training / eval data.

Open Source

docsBuildQdrant

Qdrant documentation

Qdrant

Simple, strong choice for local and hybrid vector search systems.

Open Source

docsAdvancedHugging Face

PEFT documentation

Hugging Face

Core for LoRA and efficient adaptation on local or limited hardware.

Open Source

docsZeroOpen WebUI

Open WebUI

Gives you an offline-friendly interface for local models, documents, and workflows.

Open Source

docsBuilddeepset

Haystack

deepset

Solid framework for retrieval pipelines, agents, evaluation, and production patterns.

Open Source

llama.cpp

Resource Metadata

Category

Provider

Type

Level

Topic

Track

Section

Format

Status

Commercial

Featured

Fast start

Sequence

Priority

Primary source

Sources

ID

Fallback Access

Continue Learning

Related Resources