Senior AI Engineer - Production LLMs & Multi-Agent Systems

team.blue; United States; Remote; USD 170,000 - 250,000; Full time

Job summary

team.blue is building the AI layer that runs across one of Europe’s largest digital-services ecosystems, powering hosting, domains, email, and SaaS for millions of SMBs. As Principal AI Solutions Engineer you will be the senior technical authority on AI systems end-to-end: from model research and fine-tuning through agentic orchestration, real-time inference, and production reliability.

This is not a research-only role and not an MLOps-only role.

Qualifications

• 8+ years in ML Engineering, Applied AI, or Research Engineering.
• Deep hands-on experience with LLMs in production: fine-tuning, RLHF/DPO, prompt engineering.
• Strong Python and core ML stack knowledge (PyTorch, Transformers, PEFT/LoRA).
• Experience with LLM inference serving in latency-sensitive environments.
• Knowledge of multi-agent coordination, tool-use orchestration, observability.
• Experience with speech AI or real-time audio systems is a strong plus.
• Solid understanding of MLOps: experiment tracking, model registries, CI/CD for ML.
• Awareness of LLM risks and mitigation strategies in production.
• Strong written and verbal communication for design reviews and stakeholder alignment.

Responsibilities

• Architect and evolve multi-agent orchestration platform (Hermes/Multica) with plugins and tooling.
• Design and implement voice AI pipelines with real-time streaming latency goals.
• Build and maintain RAG pipelines with retrieval quality measurement and hybrid search.
• Define MCP server architecture and tool-use contracts across integrations.
• Fine-tune and evaluate LLMs for customer support, classification, and extraction tasks.
• Benchmark model quality with automated evals and domain metrics (WER/DER).
• Manage model lifecycle: experiment tracking, versioning, reproducibility, production promotion.
• Own the AI observability stack and cost tracking; enforce guardrails and safety checks.
• Drive ML CI/CD, shadow deployments, canary releases, and rollback triggers.
• Mentor ML engineers; collaborate with Product/Commercial to translate problems into ML goals.

Skills

ML Engineering

Production LLMs

Python & ML stack

LLM inference serving

Agentic frameworks

Speech AI / Real-time audio

MLOps

Risk mitigation ( hallucination, data)

Communication

Tools

Langfuse

MLflow

Weights & Biases (W&B)

Docker

Kubernetes

Job description

team.blue is building the AI layer that runs across one of Europe’s largest digital-services ecosystems, powering hosting, domains, email, and SaaS for millions of SMBs. As Principal AI Solutions Engineer you will be the senior technical authority on AI systems end-to-end: from model research and fine-tuning through agentic orchestration, real-time inference, and production reliability.

This is not a research-only role and not an MLOps-only role.