Senior LLM Systems Architect

Leonar; Paris; Sur place; EUR 90 000 - 140 000; Plein temps

Résumé du poste

Licorne Society in Paris is looking for a Lead LLM Engineer to design and evolve scalable LLM and agent architectures that solve real workstreams. You will own output quality across critical use cases, from emails to document analysis, and collaborate with product and founders to decide what to build and why.

You will build evaluation systems, datasets from real usage, and run continuous evals to prevent regressions while ensuring reliability and fast iteration.

Qualifications

• Shipping real LLM systems in production.
• Built systems used in production, not demos.
• Design full pipelines, not just prompts.
• Evaluation-driven development with measurable metrics.
• You can define quality metrics and build datasets from real usage.
• Run continuous evals to prevent regressions and debug failures.

Responsabilités

• Design and evolve LLM/agent architecture.
• Own output quality across key use cases (emails, document analysis, etc.).
• Build evaluation systems (datasets, metrics, regression detection).
• Drive fast iteration loops from production data.
• Improve retrieval, reasoning, and tool usage.
• Ensure production reliability (latency, failure modes, fallback).

Connaissances

LLM systems

Evaluation-driven development

Debugging complex failures

System architecture

Logs & tracing

Outils

LangChain

LangGraph

Azure OpenAI

PostHog

PostgreSQL

Google Cloud

FastAPI

Description du poste

Licorne Society in Paris is looking for a Lead LLM Engineer to design and evolve scalable LLM and agent architectures that solve real workstreams. You will own output quality across critical use cases, from emails to document analysis, and collaborate with product and founders to decide what to build and why.

You will build evaluation systems, datasets from real usage, and run continuous evals to prevent regressions while ensuring reliability and fast iteration.