Principal AI Engineer

WeHireYou

Paris (IN)

On-site

USD 180,000 - 240,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Equity

Job summary

Gorgias is seeking a Principal AI Engineer to architect and scale our internal evaluation platform for AI systems, including agent orchestration and rigorous evaluation loops. You will mentor engineers, define reliable metrics, and partner with product squads to raise the bar for production-grade AI capabilities.

You’ll lead end-to-end platform ownership, drive time-to-market for AI features, and work with data and infra teams to ensure observability and reliability at scale.

Qualifications

  • 8+ years of engineering experience; staff-level engineer focused on scalable systems.
  • Experience with AI agents, orchestration, and non-deterministic model handling.
  • Proven ability to mentor engineers and raise engineering bar.

Responsibilities

  • Architect and own internal evaluation platform for AI systems.
  • Scale AI evaluation workflows and agent simulations across teams.
  • Lead, mentor, and align product squads around reliable AI capabilities.

Skills

Backend engineering
Distributed systems
Python
LLMs & agents
System design
Observability
APIs

Tools

Kafka
Pub/Sub
Vector databases
Semantic caching

Job description

Principal AI Engineer

We believe conversations will become the #1 way to shop.

At Gorgias, we’re building the platform that makes this real: a unified AI agent that sells, supports, and re‑engages customers across the entire journey. Conversational Commerce is the future of ecommerce, and we’re leading that shift.

Our mission is to turn every interaction between a brand and its customers into a relationship: personal, seamless, and intelligent. By combining deep product expertise with the latest in AI, we’re making shopping feel more natural, human, and connected than ever before.

To win, we focus relentlessly on:

  • Quality: conversations that feel authentic and on-brand.
  • Experience: effortless shopping from chat to checkout.
  • Re‑engagement: personal, 1-1 dialogue instead of noisy marketing.

The opportunity is massive. As AI reshapes how people buy, Gorgias is building the foundation for the next decade of ecommerce, where every brand has its own intelligent agent and every customer feels understood.

Join us to make Conversational Commerce real.

Team & Context

Gorgias is an AI‑first company building products powered by LLMs and agent‑based systems.

As we scale our AI capabilities, we need to improve how we evaluate, iterate, and operate these systems in production. Today, parts of this process remain manual or fragmented, especially around prompt iteration, validation, and evaluation workflows.

This role will focus on building and scaling the systems that support AI evaluation and iteration, helping the team move faster and more reliably.

About the Role

You’ll have a chance to:

  • Work on production AI systems used by thousands of businesses
  • Define how we evaluate and improve AI performance at scale
  • Build internal platforms and tooling used by AI and engineering teams
  • Reduce manual processes and improve iteration speed on AI features
  • Collaborate across AI, ML, and product teams
  • Raise the engineering bar and mentor others
What You’ll Do
1. Architect the Evaluation "Factory"
  • End-to-End Platform Ownership: Architect and lead the development of our internal evaluation platform, moving the needle from manual testing to a fully automated lifecycle (from LLM-as-a-judge creation to production monitoring).
  • Accelerate Time-to-Market: Directly impact our primary KPI by designing tools and workflows that drastically reduce the time it takes to deliver a calibrated, production‑ready agent.
  • Infrastructure Collaboration: Partner with the Orchestration team to build the robust, scalable infrastructure required to run complex evals and agentic simulations at scale.
2. Scaling AI Expertise
  • Squad Empowerment: Serve as the "AI Technical Lead" for product squads, guiding them through the complexities of agent design, failure analysis, and prompting best practices.
  • Decentralize Quality: Instead of being a bottleneck, you will build the "paved road" that allows product squads to become autonomous in measuring and maintaining their own agent quality.
  • Standard Setting: Define what "good" looks like for AI at [Company Name]. You’ll translate non-deterministic AI behavior into predictable engineering metrics that the whole organization can trust.
3. Engineering Leadership
  • Mentor & Level Up: Bridge the gap between traditional software engineering and AI. You’ll mentor engineers on how to apply rigorous system design to the world of LLMs and agents.
  • Continuous Observability: Take ownership of the feedback loop, ensuring that production insights from our agents directly inform the next iteration of our evaluation datasets.
Who You Are
  • 8+ Years of Engineering Excellence: You are a Staff-level engineer first. You’ve built systems that handle high scale, and you know how to architect for long‑term maintainability and performance.
  • Agentic Curiosity: You’ve moved beyond the "chatbot" phase and are actively experimenting with AI Agents. You understand that the challenge isn’t the prompt, but the orchestration, state management, and reliability of the agent's actions.
  • Systems Thinker (Non‑Deterministic Mindset): You recognize that AI is probabilistic. You are excited by the challenge of building deterministic "wrappers" and Evaluation loops around models to make them safe for production.
  • The "Applied" Edge: You likely come from a background in distributed systems, internal platforms, or developer tooling, and you’re now applying that rigor to the AI stack.
What We’re Looking For
  • Beyond the Wrapper: You have serious experience moving beyond simple API calls to architecting multi‑stage AI orchestrations (agents, chained workflows, or custom runtime logic).
  • Orchestration Experience: Even if you aren't an AI researcher, you have experience building complex, multi‑step workflows (e.g., temporal systems, state machines, or event‑driven architectures) and want to apply this to Agentic loops.
  • Reliability Obsession: You understand why "vibes‑based" testing doesn't work. You’ve started exploring or building Eval frameworks to measure how models perform against real‑world data.
  • Infrastructure Mindset: You are comfortable with the "glue" that makes AI work: vector databases, semantic caching, and API integration with third‑party tools.
Tech Stack & Experience
  • Strong backend experience (Python preferred)
  • Experience with distributed systems and event‑driven architectures
  • Familiarity with tools like Kafka, Pub/Sub, or equivalent
  • Experience working with LLMs (prompting, RAG, agents, evaluation workflows)
  • Experience building APIs and scalable services
  • Understanding of monitoring, observability, and system performance
  • Hiring Process
    • Recruiter phone screen
    • HM Interview
    • System Design Interview
    • AI Case Study (take‑home, ~1–2 hours)
    • Technical Deep Dive of case study
    • Final Leadership Interview
    Perks and Benefits
    • Competitive salary & equity (90th percentile...
    Get your free, confidential resume review.

    or drag and drop your file here.

    Similar jobs

    Similar jobs worth comparing

    Principal AI Engineer
    Principal AI Engineer

    WeHireYou • Belgrade (MT)

    On-site
    USD 180,000 - 240,000
    Software Engineer - Internal AI Platform
    Software Engineer - Internal AI Platform

    WeHireYou • Paris (IN)

    On-site
    USD 120,000 - 180,000
    Senior AI Solutions Manager, Enterprise
    Senior AI Solutions Manager, Enterprise

    Gorgias • San Francisco (CA)

    On-site
    USD 120,000 - 180,000
    FullStack Engineer
    FullStack Engineer

    WeHireYou • Belgrade (MT)

    On-site
    USD 60,000 - 90,000
    5-week vacation
    Paid sick leave
    Paid parental leave
    +8
    AI Engineer
    AI Engineer

    Valsoft Corporation • Northern (KY)

    On-site
    USD 120,000 - 180,000
    AI Engineer
    AI Engineer

    Valsoft Corporation • United States

    On-site
    USD 140,000 - 230,000
    AI / GenAI Solutions Engineer
    AI / GenAI Solutions Engineer

    SOUM • United States

    Remote
    USD 120,000 - 180,000
    Sr AI Engineer II - Global Commercial Services Technology
    Sr AI Engineer II - Global Commercial Services Technology

    American Express • United States

    On-site
    USD 180,000 - 260,000
    AI Engineer (III)
    AI Engineer (III)

    BravoTECH • Richardson (TX)

    On-site
    USD 140,000 - 210,000
    Health, dental, and vision insurance
    Retirement savings plan with company 1
    Paid time off and holidays
    +1
    Staff AI Builder
    Staff AI Builder

    Robots and Pencils • United States

    Remote
    USD 125,000 - 172,000