Principal AI Engineer - Context - Agents and Context

Elastic

Poland

Hybrid

PLN 420,000 - 540,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Elastic, the Search AI Company, is seeking a Principal AI Engineer to own end-to-end improvement loops for Context Engine. You will shape how agents, automations and skills operate in production, design robust telemetry, and collaborate with data scientists to drive product decisions.

You will work with data scientists and engineers, shipping production code in a TypeScript/Python stack and contributing to public APIs and evolving data models, while mentoring peers in an async, low-ego team.

Qualifications

  • Extensive software engineering background with AI-driven products.
  • Proven ability to diagnose and improve agent/LLM behavior from traces and feedback.
  • Experience designing telemetry to guide engineering and product decisions.
  • Experience running end-to-end product experiments with instrumentation.

Responsibilities

  • Own production improvement loop for Context Engine including extraction and memory behavior.
  • Define safe iteration for prompts, skills, and automations with regression coverage.
  • Design telemetry for agent traces, tool calls and knowledge retrieval for dashboards.
  • Collaborate with data science to define evaluation datasets and gate quality.
  • Mentor engineers, review designs, and draft technical proposals shaping roadmaps.

Skills

10+ years software engineering
Eval-driven product improvement
Agents with state and memory
Telemetry design
Product experiments end-to-end
Public APIs & evolving data models
Backend engineering: Python/TypeScript
Cross-functional collaboration
Trade-off communication
Pragmatic, low-ego mindset

Tools

MCP
LangGraph
Claude Agent SDK
Elasticsearch

Job description

Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data - securing and protecting private information more effectively - Elastic's complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI.

What is The Role

The Context Engine team builds the knowledge layer that AI agents use to work with enterprise data in Elasticsearch. We extract knowledge from any data sources into a structured AI Index, serve it to agents through public APIs, MCP tools and framework integrations, and close the loop with agent traces so that what the engine knows improves from real usage. Any agent can use it: Elastic's own Agent Builder, Claude Code, LangChain and other third-party harnesses.

As a Principal AI Engineer, you own the improvement loop of this product end to end: how agents, automations and skills behave in production, how we observe them, how we evaluate them, and how we ship changes to them safely. This is a hybrid role at the intersection of engineering, data science, and product. You will write production code, design evaluation and telemetry that product decisions can rest on, and set the technical bar for how the team iterates on agentic behaviour. You will work alongside data scientists, backend engineers, product, and UX, and your work will show up directly in what customers build on top of Elastic.

The codebase is TypeScript and we build it in the open, so you'll be shipping code, designs and discussions in public alongside the rest of the Elastic Stack.

What You Will Be Doing
  • Own the production improvement loop for Context Engine: understand how extraction automations, retrieval tools and memory behave, based on offline evaluations and customer conversations and telemetry. You help find the failure modes, fix them, and prove the fix.
  • Define how we iterate on agents and skills safely: versioning and rollout of prompts, skills and automations, regression coverage, staged and shadow evaluation, and the guardrails that let us change behaviour without breaking customers.
  • Design the telemetry we need to make data-informed engineering decisions: what to capture from agent traces, tool calls and knowledge retrieval, how it lands in Elasticsearch, and how it feeds evaluation, dashboards and the feedback loop.
  • Partner with the data science team on evaluation strategy: golden datasets, evaluators to gate on quality, latency and cost.
  • Raise the bar across the team: review designs and PRs, mentor engineers in eval-driven development, and write the technical proposals that shape the roadmap.
What You Bring
  • 10+ years of software engineering experience, with the recent years spent shipping and operating AI-driven products on real production traffic, ideally products with public APIs and data models that had to evolve without breaking customers.
  • A track record of eval-driven product improvement: you have diagnosed agent or LLM behaviour from traces and user feedback, designed the evaluation that exposed the problem, shipped the fix and measured the outcome.
  • Direct experience building agents with state and memory, and iterating on prompts, skills and tool behaviour safely in production.
  • Familiarity with MCP, including exposing public MCP servers and tools.
  • Experience designing telemetry for AI systems, and using it to make engineering and product decisions.
  • Experience running product experiments end to end: instrumentation, unattended execution, and interpreting results.
  • Experience building products with public APIs and evolving data models, and the judgement that comes with maintaining external contracts as a product changes.
  • Strong backend engineering skills in either Python or TypeScript: APIs, stateful workflows, data pipelines and production services.
  • Comfort working with data scientists, engineers, and product managers as peers, translating between measurement and shipping, and communicating trade-offs clearly.
  • A pragmatic, low-ego style suited to a distributed, async-first team.
Bonus Points
  • Experience with agent frameworks such as LangGraph, CrewAI, Claude Agent SDK, or similar.
  • Agentic retrieval experience, including knowledge representation.
  • Practical Elasticsearch experience.
Compensation

Compensation for this role is in the form of base salary. This role does not have a variable compensation component.

At Elastic, our compensation philosophy aims to provide fair, competitive and transparent remuneration. Salary ranges are established based on a combination of external market benchmarks, internal pay equity considerations, and the responsibilities and complexity associated

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AI Engineer - Context - Agents and Context
Principal AI Engineer - Context - Agents and Context

Elastic • Polska

Hybrid
PLN 369,000 - 584,000
Health coverage
Flexible locations and schedules
Generous vacation days
+1
Senior AI Engineer – Context Engine & Agents
Senior AI Engineer – Context Engine & Agents

Elastic • Polska

Hybrid
PLN 369,000 - 584,000
Health coverage
Flexible locations and schedules
Generous vacation days
+1
AI Platform Engineer: Context & Agent Intelligence
AI Platform Engineer: Context & Agent Intelligence

Elastic • Poland

Hybrid
PLN 420,000 - 540,000
Senior Software Engineer - Integrations 3P - Platform
Senior Software Engineer - Integrations 3P - Platform

Elastic • Poland

Remote
PLN 240,000 - 360,000
Senior Engineering Manager - Agents and Context - Platform
Senior Engineering Manager - Agents and Context - Platform

Elastic • Poland

On-site
PLN 369,000 - 584,000
Senior Engineering Manager - Agents and Context - Platform
Senior Engineering Manager - Agents and Context - Platform

Elasticsearch B.V. • Polska

On-site
PLN 369,000 - 584,000
Competitive pay based on work done
Health coverage for you and family
Flexible locations & schedules
+4
Senior Java Engineer - Core/Infra - Elasticsearch
Senior Java Engineer - Core/Infra - Elasticsearch

Elastic • Poland

On-site
PLN 320,000 - 520,000
Senior Software Integrations Engineer - AI Ecosystem Remote
Senior Software Integrations Engineer - AI Ecosystem Remote

Elastic • Polska

Remote
PLN 308,000 - 487,000
Competitive pay
Health coverage for you and family
Flexible locations and schedules
+3
Senior Engineer, Competitive Benchmarking & Performance
Senior Engineer, Competitive Benchmarking & Performance

Elastic • Poland

On-site
PLN 180,000 - 320,000
Principal Full Stack Engineer, AI Platform & Agents
Principal Full Stack Engineer, AI Platform & Agents

C T Corporation System (DE) • Warszawa

On-site
PLN 300,000 - 600,000
Top locations