Lead AI Platform Engineer — Remote, Observability & Quality

Jobgether SRL; Schweiz; Remote; CHF 125,000 - 158,000; Full time

Benefits offered by this job

Remote work

Equity

35 days PTO

International retreats

Flexible schedule

Professional development

Job summary

Jobgether SRL is partnering with a Switzerland-based leader to recruit a Lead Engineer, AI Platform. You will oversee an AI Quality engineering team, building evaluation frameworks, observability tooling, and diagnostic infrastructure for reliable AI agents in production.

The role blends hands-on software development with technical leadership and people management. You will drive experiments, optimize cost and latency, and collaborate with AI Core teams to implement measurable improvements.

Qualifications

• 7+ years of experience building and shipping production software, ideally including LLM-powered agents.
• Experience with complex, tool-using AI systems involving multiple tools, planning, orchestration, or sub-agents.
• Strong ability to demonstrate shipped software and explain how its effectiveness and reliability were measured.
• Experience with Ruby on Rails and/or Python, with ability to become productive quickly in new tech.
• Experience building evaluation or observability infrastructure for ML/AI systems.

Responsibilities

• Design, build, and own evaluation infrastructure, including CI/CD pipelines, scorers, datasets, and systems for assessing AI agents across conversations.
• Develop observability and diagnostic capabilities to identify quality issues in AI workflows.
• Investigate failures and turn findings into prototypes or priorities for AI engineering teams.
• Build datasets via human annotation, AI-generated examples, and simulated conversations to improve evaluation coverage.
• Develop experimentation frameworks for prompts, models, and agent harnesses; evaluate new/open-source models vs production baselines.
• Identify opportunities to reduce AI system cost and latency through optimization strategies.
• Set technical direction and manage day-to-day priorities for the AI Quality engineering team while contributing hands-on.
• Collaborate with AI Core to measure changes and improve product quality.
• Establish engineering practices and evaluation approaches for reliable, scalable production AI systems.

Skills

Leadership

English Proficiency

Experimentation

Observability

LLM Systems

Python / RoR

Tools

Braintrust / LangSmith

CI/CD Tools

Job description

Jobgether SRL is partnering with a Switzerland-based leader to recruit a Lead Engineer, AI Platform. You will oversee an AI Quality engineering team, building evaluation frameworks, observability tooling, and diagnostic infrastructure for reliable AI agents in production.

The role blends hands-on software development with technical leadership and people management. You will drive experiments, optimize cost and latency, and collaborate with AI Core teams to implement measurable improvements.