Senior AI Engineer — Evaluation & Production Systems

Synera

France

Hybride

EUR 77 000 - 97 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Home office setup
Office in Bremen
Personal development budget
Flexible working
JobRad
Wellbeing program
Team off-sites

Résumé du poste

Synera is seeking an experienced AI engineer to join the Agentic Ants team. You will design and ship agent graphs in production, build evaluation frameworks, and ensure changes are trusted through Golden datasets, LLM-as-judge pipelines, and regression suites.

Collaborate with Danny and the R&D department, work on customer insights data, and help automate engineering work while shaping the next AI-native generation of Synera.

Qualifications

  • You’ve designed and shipped agent graphs in production with LangGraph or equivalent, including supervisor / sub‑agent patterns, tool design, prompt iteration.
  • You’ve built or meaningfully contributed to an LLM evaluation pipeline: LLM-as-judge design, calibration against human labels, dataset versioning, and the statistical reasoning behind it (CIs, sample sizes, false positives).
  • You write production‑grade Python (using FastAPI and PostgreSQL).
  • You’ve worked with at least two of the following AI platforms: Anthropic, OpenAI, Azure Froundry, Bedrock, or Vertex AI.
  • You’re familiar with Langfuse, LangSmith, or similar tracing tools.
  • You handle reliability when it shows up in your work, implementing retries, error handling, or graceful degradation.
  • You communicate clearly and push back when you disagree.

Responsabilités

  • Design and ship agent graphs in production with LangGraph and related tooling.
  • Build and improve an LLM evaluation framework gating changes before release.
  • Collaborate with R&D to analyze customer insights data and automate engineering workflows.
  • Contribute to sprint activities and help ensure production-readiness of agent systems.

Connaissances

Agent graphs
LLM evaluation
Python (FastAPI)
Langfuse tracing
Reliability engineering
Communication

Outils

PostgreSQL
FastAPI
LangGraph
Langfuse

Description du poste

Most AI teams talk about evaluation. At Synera, you will own it: end-to-end, in production, for multiple real agentic products used by companies like BMW, Airbus, and NASA.


WHAT YOU WILLDO

You’ll join the Agentic Ants team as their second native AI engineer. You’ll build and extend agentic systems alongside the rest of the team, including new tools, sub-agents and prompt iterations. But most importantly, you will contribute to an evaluation framework that gates every change: Golden datasets, LLM-as-judge pipelines, regression suites, production-trace mining. Your job is to prove that the agents the team is shipping can be trusted.

You’ll not only improve our existing software but also shape the next AI-native generation of Synera. Partnering with Danny and the wider R&D department, you’ll help the teams go deeper on customer insights data and come up with new ways to automate engineering work.

What a week at Synera could look like:
  • Monday: Join our company-wide all-hands meeting to stay in the loop, then review Langfuse traces from the weekend and flag any new failure modes worth triaging.

  • Tuesday: Work on the golden dataset for the supervisor routing surface, curating examples, versioning the set, and writing evaluators with Ahmed.

  • Wednesday: Join a cross-team sync with QA and product to align on new eval coverage for an upcoming agent feature, then push a CI integration so eval regressions block the next PR.

  • Thursday: Show off your latest work to other departments in the sprint review, use your lunch break to go for a quick run, then kick off sprint planning with the Agentic Ants.

  • Friday: Pair with the AI and software engineers on extending our agentic system, then write the eval that gates the change before it ships.

In 6 months:
  • The evaluation framework is live and in use across multiple agent, CI gates are blocking on regressions, and the team can actually trust the results.

  • You’ve shipped multiple meaningful changes to the agent graphs (new tools, sub-agents, or routing improvements) that are measurably better in production.

In 12 months:
  • The agents improve themselves: Production traces feed continuously back into datasets, and the improvement loop is running without manual intervention.

  • You co-own at least one agent surface with the team and have become the go-to person for evaluation methodology at Synera. The combination has measurably improved product quality.

Here is our team at the summer event - join us at the next one!

WHAT'S IN IT FOR YOU?

We believe in transparent conversations about compensation from the start. For this role, our planned salary ranges are:

  • Experienced Level: 77,000 - 97,000 EUR annually

We determine the level we hire you for based on your experience, the scope of responsibilities you'll take on, and the impact you can drive. While we typically hire within these bands, we're open to some flexibility for candidates who bring exceptional value to the role.

Check out this page to learn how we approach salary, career growth, and creating an environment where everyone can shine.

What we offer beyond salary:
  • Flexible working: you decide when & where to work (as long as you have a residency in Germany).

  • Flexible public holidays: swap days off according to your values and beliefs!

  • Home office setup support + access to our office in Bremen.

  • Personal development budget of €2,000 to attend conferences and trainings or buy interesting books to improve in an area of your choice.

  • We don't count your vacation days, as we trust all our team members to decide what's best for them and the company.

  • Prefer two wheels over four? We’ve got you covered with JobRad.

  • To support your personal and professional well-being, we offer company fitness with Wellpass and mental health platform nilo.

  • Regular team events, virtual coffee breaks, and spontaneous afterworks. We also get together as a whole company for 2-3 day off-sites twice a year!

Requirements:
WHAT YOU NEED TO SUCCEED

Even if you don't meet these criteria perfectly but believe you have lots to bring to the role, we encourage you to apply. We know it's tough, but please keep in mind that you don't have to match all the listed requirements exactly to be considered for this role.

  • You resonate with Synera's Core Values - they're central to how we work, and we'll explore them together in your first interview.

  • You’ve designed and shipped agent graphs in production with LangGraph or equivalent, including supervisor / sub-agent patterns, tool design, prompt iteration.

  • You’ve built or meaningfully contributed to an LLM evaluation pipeline: LLM-as-judge design, calibration against human labels, dataset versioning, and the statistical reasoning behind it (CIs, sample sizes, false positives).

  • You write production-grade Python (using FastAPI and PostgreSQL).

  • You’ve worked with at least two of the following AI platforms: Anthropic, OpenAI, Azure Froundry, Bedrock, or Vertex AI.

  • You’re familiar with Langfuse, LangSmith, or similar tracing tools.

  • You handle reliability when it shows up in your work, implementing retries, error handling, or graceful degradation.

  • You communicate clearly and push back when you disagree.

P.S. Synera is a place where everyone can grow. So, however you identify and whatever background you bring with you, please apply if this is a role that would make you excited to come to work every day, and be prepared to share with us how your perspective will bring something unique and valuable to our Agentic Ants team.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior AI Engineer (f/m/d) - Remote in Germany
Senior AI Engineer (f/m/d) - Remote in Germany

Synera • France

Hybride
EUR 77 000 - 97 000
Home office setup
Office in Bremen
Personal development budget
+4
Technical Deployment Lead
Technical Deployment Lead

FDE Times • Paris

Hybride
EUR 120 000 - 180 000
French speaking Sales Development Representative (f/m/d) - Remote in France
French speaking Sales Development Representative (f/m/d) - Remote in France

Synera • France

À distance
EUR 52 000 - 87 000
Flexible working: remote or in-office
Home office setup support
Personal development budget
+4
Staff AI Engineer: Enterprise Agentic Frameworks (Remote)
Staff AI Engineer: Enterprise Agentic Frameworks (Remote)

Believe • Paris

Hybride
EUR 120 000 - 180 000
Remote working policy
Wellness program Pauses
Health insurance
+1
Staff Engineer Agentic AI
Staff Engineer Agentic AI

Believe • Paris

Hybride
EUR 120 000 - 180 000
Remote working policy
Wellness program Pauses
Health insurance
+1
AI Native Software Engineer (Mid-Level & Senior)
AI Native Software Engineer (Mid-Level & Senior)

Accenture PLC • Paris

Sur place
EUR 90 000 - 130 000
Senior AI Workflows Engineer — Production-Grade Automation
Senior AI Workflows Engineer — Production-Grade Automation

Prismic • France

Hybride
EUR 90 000 - 130 000
Latest Macbook
Budget to equip home office
English classes for all levels
+2
Senior AI Workflows Engineer
Senior AI Workflows Engineer

Prismic • France

Hybride
EUR 90 000 - 130 000
Latest Macbook
Home office budget
English classes for all levels
+2
Senior AI Systems Engineer
Senior AI Systems Engineer

Lucentive • Eu

À distance
EUR 90 000 - 140 000
Applied AI Engineer, Enterprise
Applied AI Engineer, Enterprise

Precision Labs • Paris

Hybride
EUR 220 000 - 235 000