Senior AI Platform Engineer & Technical Lead (Remote)

Jobgether SRL; Netherlands; Remote; EUR 134,000 - 170,000; Full time

Job summary

Partner company in the Netherlands is seeking a Lead Engineer, AI Platform to shape the engineering foundation behind scalable AI-powered features. You will build evaluation frameworks, observability tooling, and diagnostic infrastructure for production AI systems, while balancing hands-on coding with people management.

In a fast-paced, highly remote environment, you will partner with AI Core teams, drive technical direction for the AI Quality function, and own end-to-end evaluation and

Qualifications

• 7+ years of experience building and shipping production software, ideally including LLM-powered agents.
• Experience with complex, tool-using AI systems involving planning, orchestration, or sub-agents.
• Strong ability to demonstrate shipped software and explain how its effectiveness was measured.
• Experience with Ruby on Rails and/or Python, with ability to quickly learn new tech.
• Experience building evaluation/observability infrastructure for ML/AI systems (dashboards, pipelines, CI/CD).
• Familiarity with evaluation frameworks such as Braintrust, LangSmith, or similar tools.

Responsibilities

• Design, build, and own evaluation infrastructure, including CI/CD pipelines, scorers, datasets, and multi-turn evaluation systems.
• Develop observability and diagnostic capabilities across planning, tool selection, and agent trajectories.
• Investigate failures and translate findings into prototypes or clear priorities for AI teams.
• Expand datasets via human annotation, AI-generated examples, and simulated conversations.
• Create experimentation frameworks for prompts, models, and agent harnesses with production baselines.
• Identify opportunities to reduce AI system cost and latency via optimization strategies.
• Set direction and manage day-to-day priorities for the AI Quality engineering team while coding.
• Collaborate with AI Core teams to measure changes and improve quality.

Skills

Experience shipping software

Leadership

English proficiency

Tools

Ruby on Rails

Python

LangSmith

Braintrust

Job description

Partner company in the Netherlands is seeking a Lead Engineer, AI Platform to shape the engineering foundation behind scalable AI-powered features. You will build evaluation frameworks, observability tooling, and diagnostic infrastructure for production AI systems, while balancing hands-on coding with people management.

In a fast-paced, highly remote environment, you will partner with AI Core teams, drive technical direction for the AI Quality function, and own end-to-end evaluation and