Lead AI Systems Engineer: Private LLM & RAG Architect

VECTRA International BV; Polska; Hybrid; PLN 420,000 - 660,000; Full time

Job summary

VECTRA International BV seeks an experienced backend engineer to lead the design, deployment, and security of an AI-powered assurance suite. You will own architecture, prompt engineering, and private RAG pipelines in private EU endpoints.

This role requires 6+ years in backend software engineering with 3+ years in production LLM/RAG systems, plus GDPR compliance knowledge, FastAPI, Docker, and PostgreSQL with pgvector to safeguard data.

Qualifications

• 6+ years in backend software engineering with 3+ years in production LLM/RAG system deployment and infrastructure security.
• Tech Stack: Python, LangChain/LlamaIndex, vLLM/Ollama, Private Cloud EU endpoints, FastAPI, PostgreSQL (pgvector), Docker.
• Compliance & Security: Working knowledge of GDPR data security mandates, tenant data isolation, and API encryption standards.

Responsibilities

• Direct the clean-slate design, LLM orchestration, and deployment of the AI-powered assurance suite.
• Own system architecture, prompt engineering, private RAG pipelines, local/private LLM hosting, and the proprietary multi-stage concierge isolation layer that air-gaps client data from public models.
• Architect private, locally hosted model environments to satisfy data privacy requirements.
• Build and enforce a three-tier architecture to guarantee zero proprietary data leakage to public models.
• Purge legacy training configurations and re-train models on client compliance standards.
• Lead technical setup and data mapping for assurance workflows and audit modules.
• Develop confidence-scoring thresholds and QA triggers routing ambiguous sections to humans.

Skills

Backend engineering

LLM deployment

Data security

Tools

Python

LangChain/LlamaIndex

vLLM/Ollama

FastAPI

PostgreSQL (pgvector)

Docker

Private Cloud EU endpoints

Job description

VECTRA International BV seeks an experienced backend engineer to lead the design, deployment, and security of an AI-powered assurance suite. You will own architecture, prompt engineering, and private RAG pipelines in private EU endpoints.

This role requires 6+ years in backend software engineering with 3+ years in production LLM/RAG systems, plus GDPR compliance knowledge, FastAPI, Docker, and PostgreSQL with pgvector to safeguard data.