Lead LLM Architect for Production AI Pipelines

Leonar; Paris; Sur place; EUR 90 000 - 140 000; Plein temps

Résumé du poste

Licorne Society partners with a fast-growing AI startup to hire a Lead LLM Engineer. You will design and evolve our LLM/agent architecture and own output quality across core use cases.

This role requires building production-grade pipelines, evaluation frameworks, and fast iteration from real data, with focus on reliability, latency, and meaningful user value. You’ll collaborate with product and founders on what to build and why.

Qualifications

• Experience building real LLM systems in production.
• Understanding of RAG, tools, and structured outputs.
• Ability to design full pipelines, not just prompts.
• Strong evaluation mindset and measurable outcomes.

Responsabilités

• Design and evolve LLM/agent architecture.
• Own output quality across core use cases (emails, docs, etc.).
• Build evaluation datasets and metrics.
• Drive rapid iteration loops from production data.
• Improve retrieval, reasoning, and tool usage.
• Ensure production reliability (latency, failures, fallbacks).
• Collaborate with product and founders on roadmap.

Connaissances

LLM systems

Production debugging

Evaluation-driven development

Pipelines design

Retrieval & tools

Strong judgment

Speed of iteration

Data-driven decision making

Incident analysis

Outils

LangGraph / LangChain

Langfuse

LangChain

Azure OpenAI

Python (FastAPI)

Postgres

Google Cloud

PostHog

Description du poste

Licorne Society partners with a fast-growing AI startup to hire a Lead LLM Engineer. You will design and evolve our LLM/agent architecture and own output quality across core use cases.

This role requires building production-grade pipelines, evaluation frameworks, and fast iteration from real data, with focus on reliability, latency, and meaningful user value. You’ll collaborate with product and founders on what to build and why.