vLLM OpenAI-Compatible Server

Category

LLM serving

Provider

vLLM

Type

docs

Level

Advanced

Topic

Local AI / LLM Engineering / RAG

Track

Local AI / LLM Engineering / RAG

Section

Learning path

Format

Documentation / tutorial

Status

publishable

Commercial

link-only

Featured

yes

Fast start

no

Sequence

nan

Priority

A

Primary source

mega_open_hub

Sources

mega_open_hub

ID

5b3e15fc673bf00c

Open WebUI Docs

Open WebUI

Offline-first self-hosted AI interface that works well as a local front-end for models and knowledge tools.

Ollama Docs

Ollama

Official documentation for running and integrating local models with a simple developer workflow.

PEFT documentation

Hugging Face

Core for LoRA and efficient adaptation on local or limited hardware.

TRL documentation

Hugging Face

Useful for supervised fine-tuning, preference tuning, and training experiments.

Qdrant Quickstart

Qdrant

Quick path to a working semantic search stack with the Qdrant API and local deployment.

Open WebUI Quick Start

Open WebUI

Fastest path to standing up Open WebUI with Docker for a self-hosted local AI stack.

Ollama API Introduction

Ollama

API docs for integrating local generation into apps, automations, and RAG pipelines.

LlamaIndex RAG Guide

LlamaIndex

Conceptual and practical entry point for ingestion, indexing, and retrieval-augmented generation workflows.

LlamaIndex

LlamaIndex

Good for document parsing, indexing, query flows, and agentic retrieval patterns.

Haystack Intro

deepset

Open-source framework for search, RAG, and agentic pipelines with a strong retrieval focus.

llama.cpp Build Guide

ggml

Build instructions for local compilation, hardware backends, and the project toolchain.

Ollama

Ollama

Fastest path to running modern local models on a workstation.