Lead AI Platform Engineer - Remote, Equity & Growth

Lever, Inc.; España; A distancia; EUR 129.000 - 174.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work environment

35 days PTO per year

Equity in the company

Twice-yearly international retreats

Health and wellbeing benefits

Professional development

Global, distributed team

Descripción de la vacante

Lever, Inc. seeks a Lead Engineer, AI Platform based in Spain to lead the engineering foundation behind reliable, measurable AI-powered features. You will build evaluation frameworks, observability tooling, and diagnostic infrastructure for production AI agents.

You’ll combine hands-on software development with technical leadership, managing an AI Quality team and collaborating with AI Core teams to improve product quality.

Formación

• 7+ years of experience building and shipping production software, ideally with LLM-powered agents.
• Experience with complex tool-using AI systems with planning, orchestration, or sub-agents.
• Strong ability to demonstrate shipped software and explain how effects were measured.
• Experience with Ruby on Rails and/or Python; quick productivity in new tech.
• Experience building evaluation or observability infrastructure for ML/AI systems.
• Familiarity with evaluation frameworks such as Braintrust, LangSmith, or similar tools.
• Experience designing datasets, annotation workflows, or labeling pipelines for ML/AI evaluation.
• Ability to learn quickly, experiment extensively, and use empirical results to guide decisions.
• Comfortable in fast-paced, ambiguous environments with evolving requirements.
• Strong technical leadership and people-management capabilities.
• Excellent English communication (CEFR C2 / ILR 5).
• Strong alignment with a collaborative, ownership-oriented culture.

Responsabilidades

• Design, build, and own evaluation infrastructure, incl. CI/CD pipelines, scorers, datasets, and multi-turn evaluation.
• Develop observability and diagnostic capabilities across planning, execution, tool selection, and agent trajectories.
• Investigate failures in AI workflows and turn findings into prototypes or prioritized improvements.
• Build datasets via human annotation, AI-generated examples, and simulated conversations.
• Develop experimentation frameworks for prompts, models, and agent harnesses against baselines.
• Identify cost and latency optimization opportunities through model selection and caching.
• Set technical direction and manage day-to-day priorities for the AI Quality team while staying hands-on.
• Partner with AI Core teams to measure changes and prove quality improvements.
• Establish engineering practices and evaluation approaches for reliable production AI systems.

Conocimientos

LLM-powered agents

Observability infrastructure

Evaluation pipelines

Ruby on Rails

Python

Leadership

People management

English proficiency

Herramientas

Braintrust

LangSmith

CI/CD tooling

Descripción del empleo

Lever, Inc. seeks a Lead Engineer, AI Platform based in Spain to lead the engineering foundation behind reliable, measurable AI-powered features. You will build evaluation frameworks, observability tooling, and diagnostic infrastructure for production AI agents.

You’ll combine hands-on software development with technical leadership, managing an AI Quality team and collaborating with AI Core teams to improve product quality.