Own project

Local AI Infrastructure with Ollama & Qdrant

RAG applications on your own documents, fully on-prem with Ollama and the Qdrant vector database.

Industry

AI infrastructure

Problem

Cloud AI services are often not an option for documents and data that cannot leave the building. Search across your own documents still needs to work as well as a cloud model.

Solution

A fully local AI infrastructure built on Ollama and the Qdrant vector database, containerized with Docker. Enables RAG applications on your own documents without any data going to external cloud AI services.

Result

Document search with traceable citations, fully on-prem, built with GDPR and the EU AI Act in mind.

Tools

Ollama, Qdrant, Docker, RAG