STEP 05: Advanced Optimization & RAG

1. Quantization (Reduce VRAM Usage)

ollama run llama3.2:3b --quantize q4_0

2. Run with RAG (Knowledge Base)

Use Open WebUI or AnythingLLM to add your own documents.

3. Multi-Model Management

ollama list

ollama rm modelname