Senior AI Platform Engineer - LLM Orchestration & DevOps

XTB; United States; Remote; USD 59,000 - 75,000; Full time

Benefits offered by this job

Training budget

Birthday day off

Parent's day off

Equipment provided

Private medical care

E-learning platform

Wellbeing platform

Remote work

Job summary

XTB is seeking a Senior AI Engineer to design, build, and maintain a cutting-edge AI platform that enables teams to deploy AI-driven solutions at scale. You will bridge software engineering with AI tool orchestration, focusing on self-service LLM integration and enterprise AI infrastructure.

Responsibilities include designing an enterprise AI platform, building gateway infrastructure, and implementing scalable LangGraph orchestration and RAG components.

Qualifications

• 4+ years as a Platform/Backend/AI Engineer with hands-on platform/service delivery experience.
• Proficiency in Python and/or Go/Java; clean code practices.
• Production experience with Kubernetes and ArgoCD for GitOps deployments.
• Expert knowledge of GitLab CI/CD: designing pipelines and deployments.
• Practical experience with LLM frameworks and agentic systems.
• Understanding of RAG systems, vector databases, and prompt engineering.
• Experience with gateway/proxy infrastructure and multi-tenant security.
• Strong IaC, Git, and CI/CD fundamentals.

Responsibilities

• Design and implement an enterprise AI platform with LLM-based routing and cost optimization.
• Build MCP gateway infrastructure for integration of tools/data with AI agents.
• Architect LangGraph-based orchestration for complex agentic workflows.
• Implement RAG platform components: vector search, prompts, chunking.
• Establish observability with Langfuse: tracing, cost monitoring, token analytics.
• Design APIs for seamless LLM access and platform usage.
• Build deployment pipelines using Kubernetes and ArgoCD with GitOps.
• Establish security, auth, and rate-limiting for multi-tenant AI endpoints.
• Create self-service interfaces and documentation for non-AI experts.
• Lead engineering initiatives and mentor team members.

Skills

Platform engineering

Backend engineering

AI engineering

Python

Go/Java

Tools

Kubernetes

ArgoCD

GitLab CI/CD

LangGraph

Pydantic AI

Job description

XTB is seeking a Senior AI Engineer to design, build, and maintain a cutting-edge AI platform that enables teams to deploy AI-driven solutions at scale. You will bridge software engineering with AI tool orchestration, focusing on self-service LLM integration and enterprise AI infrastructure.

Responsibilities include designing an enterprise AI platform, building gateway infrastructure, and implementing scalable LangGraph orchestration and RAG components.