Lead LLM Engineer — Build Fast, Reliable AI Systems

Leonar; Paris; Sur place; EUR 90 000 - 140 000; Plein temps

Résumé du poste

Licorne Society is partnering with a fast-growing AI startup to recruit a Lead LLM Engineer. You will design and evolve our LLM/agent architecture to deliver reliable, fast outputs that are indispensable in real workflows.

You will own evaluation systems, datasets, and metrics, improve retrieval and tool use, ensure production reliability, and work directly with product and founders on what to build and why.

Qualifications

• Experience shipping production-grade LLM systems.
• Built production systems, not demos.
• Knowledge of evaluation, metrics, and data pipelines.

Responsabilités

• Design and evolve LLM/agent architecture.
• Own output quality across key use cases (emails, document analysis).
• Build evaluation systems and datasets (metrics, regression detection).
• Drive fast iteration loops from production data; improve retrieval, reasoning, and tool usage.
• Ensure production reliability (latency, failure modes, fallback).
• Work directly with product + founders on what to build and why.

Connaissances

LLM systems

Production systems

RAG & tools

Structured outputs

Evaluation-driven

Quality metrics

Datasets from usage

Continuous evals

Debugging failures

Prompts vs pipelines

Speed of iteration

Logs & traces

Strong judgment

Reliability focus

Outils

Postgres

Google Cloud

LangChain

LangGraph

PostHog

Langfuse

Azure OpenAI

Description du poste

Licorne Society is partnering with a fast-growing AI startup to recruit a Lead LLM Engineer. You will design and evolve our LLM/agent architecture to deliver reliable, fast outputs that are indispensable in real workflows.

You will own evaluation systems, datasets, and metrics, improve retrieval and tool use, ensure production reliability, and work directly with product and founders on what to build and why.