Principal AI Engineer, Context Engine & Agents (Hybrid)

Elasticsearch B.V.; Ireland; Hybrid; EUR 105,000 - 166,000; Full time

Benefits offered by this job

Competitive pay

Health coverage

Flexible locations & schedules

Generous vacation days

Donation matching

Volunteer hours

Parental leave

Job summary

Elastic is seeking a Principal AI Engineer to own the end-to-end improvement loop for Context Engine, working at the intersection of engineering, data science, and product. You will write production code, design evaluation telemetry, and set the technical bar for how agentic behaviour evolves in production with real customers.

You will collaborate with data scientists, backend engineers, product, and UX, shipping changes safely and transparently with an emphasis on eval-driven decisions,

Qualifications

• 10+ years of software engineering experience shipping AI-driven products on real production traffic.
• Experience executing eval-driven product improvements with traces and user feedback.

Responsibilities

• Own the production improvement loop for Context Engine: understand extraction automations, retrieval tools and memory, fix failure modes and prove fixes.
• Define how we iterate on agents and skills safely: versioning, rollout, regression coverage, and guardrails.
• Design telemetry to support data-driven engineering decisions: captures from agent traces, tool calls and knowledge retrieval; integrate into dashboards and evaluation.
• Collaborate with data science for evaluation strategy: golden datasets, gate evaluators, latency and cost.
• Review designs and PRs; mentor engineers; write technical proposals shaping the roadmap.

Skills

Python

TypeScript

Backend APIs

Eval-driven development

Agent frameworks

Telemetry design

Experimentation

LangGraph

CrewAI

Claude Agent SDK

Elasticsearch

Tools

LangGraph

CrewAI

Claude Agent SDK

Elasticsearch

Job description

Elastic is seeking a Principal AI Engineer to own the end-to-end improvement loop for Context Engine, working at the intersection of engineering, data science, and product. You will write production code, design evaluation telemetry, and set the technical bar for how agentic behaviour evolves in production with real customers.

You will collaborate with data scientists, backend engineers, product, and UX, shipping changes safely and transparently with an emphasis on eval-driven decisions,