Lead AI Evaluation & Orchestration Architect

WeHireYou; Paris (IN); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive salary

Equity

Job summary

Gorgias is seeking a Principal AI Engineer to architect and scale our internal evaluation platform for AI systems, including agent orchestration and rigorous evaluation loops. You will mentor engineers, define reliable metrics, and partner with product squads to raise the bar for production-grade AI capabilities.

You’ll lead end-to-end platform ownership, drive time-to-market for AI features, and work with data and infra teams to ensure observability and reliability at scale.

Qualifications

• 8+ years of engineering experience; staff-level engineer focused on scalable systems.
• Experience with AI agents, orchestration, and non-deterministic model handling.
• Proven ability to mentor engineers and raise engineering bar.

Responsibilities

• Architect and own internal evaluation platform for AI systems.
• Scale AI evaluation workflows and agent simulations across teams.
• Lead, mentor, and align product squads around reliable AI capabilities.

Skills

Backend engineering

Distributed systems

Python

LLMs & agents

System design

Observability

APIs

Tools

Kafka

Pub/Sub

Vector databases

Semantic caching

Job description

Gorgias is seeking a Principal AI Engineer to architect and scale our internal evaluation platform for AI systems, including agent orchestration and rigorous evaluation loops. You will mentor engineers, define reliable metrics, and partner with product squads to raise the bar for production-grade AI capabilities.

You’ll lead end-to-end platform ownership, drive time-to-market for AI features, and work with data and infra teams to ensure observability and reliability at scale.