Senior AI Engineer — Evaluation & Production Systems

Synera; France; Hybride; EUR 77 000 - 97 000; Plein temps

Avantages offerts par ce poste

Home office setup

Office in Bremen

Personal development budget

Flexible working

JobRad

Wellbeing program

Team off-sites

Résumé du poste

Synera is seeking an experienced AI engineer to join the Agentic Ants team. You will design and ship agent graphs in production, build evaluation frameworks, and ensure changes are trusted through Golden datasets, LLM-as-judge pipelines, and regression suites.

Collaborate with Danny and the R&D department, work on customer insights data, and help automate engineering work while shaping the next AI-native generation of Synera.

Qualifications

• You’ve designed and shipped agent graphs in production with LangGraph or equivalent, including supervisor / sub‑agent patterns, tool design, prompt iteration.
• You’ve built or meaningfully contributed to an LLM evaluation pipeline: LLM-as-judge design, calibration against human labels, dataset versioning, and the statistical reasoning behind it (CIs, sample sizes, false positives).
• You write production‑grade Python (using FastAPI and PostgreSQL).
• You’ve worked with at least two of the following AI platforms: Anthropic, OpenAI, Azure Froundry, Bedrock, or Vertex AI.
• You’re familiar with Langfuse, LangSmith, or similar tracing tools.
• You handle reliability when it shows up in your work, implementing retries, error handling, or graceful degradation.
• You communicate clearly and push back when you disagree.

Responsabilités

• Design and ship agent graphs in production with LangGraph and related tooling.
• Build and improve an LLM evaluation framework gating changes before release.
• Collaborate with R&D to analyze customer insights data and automate engineering workflows.
• Contribute to sprint activities and help ensure production-readiness of agent systems.

Connaissances

Agent graphs

LLM evaluation

Python (FastAPI)

Langfuse tracing

Reliability engineering

Communication

Outils

PostgreSQL

FastAPI

LangGraph

Langfuse

Description du poste

Synera is seeking an experienced AI engineer to join the Agentic Ants team. You will design and ship agent graphs in production, build evaluation frameworks, and ensure changes are trusted through Golden datasets, LLM-as-judge pipelines, and regression suites.

Collaborate with Danny and the R&D department, work on customer insights data, and help automate engineering work while shaping the next AI-native generation of Synera.