Senior AI Platform Engineer – RAG & ML Infrastructure

ITDS; Wrocław; On-site; PLN 180,000 - 300,000; Full time

Job summary

ITDS is seeking a Senior AI Platform Engineer to advance AI services and ML infrastructure from Wroclaw, Poland. The role emphasizes on-site work, RAG pipelines, vector databases, and scalable API development across production environments.

You will design and maintain retrieval-enabled AI services, ensure low latency model serving, and monitor quality metrics while collaborating with cross-functional teams.

Qualifications

• 4+ years of experience in software or platform engineering, with exposure to AI/ML or LLM applications.
• Strong Kubernetes skills and experience working with containerized environments.
• Good knowledge of AWS, networking fundamentals, IAM, and cloud infrastructure.

Responsibilities

• Develop and maintain internal AI services and APIs for production environments.
• Build and optimize RAG pipelines, including document ingestion, embeddings, retrieval, and relevance tuning.
• Manage vector database performance, scalability, and data freshness to ensure high retrieval quality.
• Design clear, well-documented APIs to support internal users and workflows.
• Integrate model serving endpoints into application-layer systems, ensuring low latency and high reliability.
• Define and monitor service objectives related to latency, reliability, and retrieval quality.
• Implement prompt management, versioning, evaluation, and testing frameworks for LLMs.
• Build resilient systems with fallback and degradation mechanisms to ensure continuous operation.
• Implement monitoring, tracing, logging, and quality metrics to oversee AI services' health and performance.
• Manage the lifecycle of AI services including deployment, rollout, updates, and deprecation.
• Participate in operational support and incident response to troubleshoot and resolve issues swiftly.

Skills

Kubernetes

AWS

Python

LLM fundamentals

API development

Vector databases

Retrieval systems

Communication skills

Job description

ITDS is seeking a Senior AI Platform Engineer to advance AI services and ML infrastructure from Wroclaw, Poland. The role emphasizes on-site work, RAG pipelines, vector databases, and scalable API development across production environments.

You will design and maintain retrieval-enabled AI services, ensure low latency model serving, and monitor quality metrics while collaborating with cross-functional teams.