AI Systems Engineer: End-to-End Production & LLMs

Omnitrace; Warszawa; Hybrid; PLN 180,000 - 240,000; Full time

Job summary

Omnitrace is seeking an AI Engineer to take end-to-end ownership of AI systems from prototype to production. You will work across LLM pipelines and agentic workflows, shaping architecture and overseeing reliability and scalability in real-world deployments.

The role demands hands-on development, collaboration with Product/Design, and willingness to explore R&D fronts such as tacit knowledge extraction and personalized agents. Fluency in Polish and English is essential.

Qualifications

• 2-5 years of commercial experience in AI/ML or software engineering with production systems shipped.
• Strong Python skills and backend API development, including async, testing, and CI/CD.
• Ability to rapidly prototype AI solutions and convert to customer value.
• Experience with agent architectures, including context engineering, tool calling, agent loops, skills, outputs, and fallbacks.
• Hands-on LLMOps experience with tracing, evals, and production debugging.

Responsibilities

• Own AI systems end-to-end, prototype to production with reliability and scalability across LLM pipelines and agentive workflows.
• Build AI and data agents, RAG systems, semantic layers, and ontologies for Omniviser’s interface.
• Design production-grade orchestration using tool use, skills, MCP, context engineering, memory/state management, and structured outputs with validation.
• Implement fallback handling, human-in-the-loop flows, guardrails, and tool permission controls.
• Prototype new ML/AI ideas quickly and turn strong concepts into production features.
• Iterate with Product and Design based on user feedback and value.
• Build evaluation/monitoring for agents including tracing, evals, RAG evaluation, and model benchmarks.
• Work in an evaluation-driven development model with LLMOps and MLOps practices.
• Support Ops in AI-native initiatives and customer implementations.
• Explore open R&D problems like tacit knowledge extraction and personalized agents.

Skills

Python

Production backend

LLMOps

LangChain/LangGraph

Agent architecture

PostgreSQL

pgvector

Semantic search

MCP servers/interfaces

Langfuse/MLflow

Azure

Code quality (tests/linters)

English & Polish communication

CI/CD

Tools

Claude Code

Codex

Cursor

GitHub Copilot

Langfuse/MLflow

Azure CLI

Job description

Omnitrace is seeking an AI Engineer to take end-to-end ownership of AI systems from prototype to production. You will work across LLM pipelines and agentic workflows, shaping architecture and overseeing reliability and scalability in real-world deployments.

The role demands hands-on development, collaboration with Product/Design, and willingness to explore R&D fronts such as tacit knowledge extraction and personalized agents. Fluency in Polish and English is essential.