Senior AI Evaluation Platform Architect

WeHireYou; Belgrade (MT); On-site; USD 180,000 - 240,000; Full time

Job summary

Gorgias is hiring a Principal AI Engineer to lead the design and scaling of internal evaluation systems for production AI agents. You will own the end-to-end lifecycle from model evaluation to production monitoring and play a key role in raising engineering standards across AI initiatives.

You’ll work with AI, ML, and product teams to reduce manual steps and accelerate feature delivery, shaping the future of conversational commerce for thousands of enterprises.

Responsibilities

• Architect the Evaluation "Factory" for an internal evaluation platform and automated lifecycle.
• Accelerate time-to-market by designing tools to produce calibrated, production-ready agents.
• Collaborate with AI, ML, product, and orchestration teams to scale evaluation workflows.

Job description

Gorgias is hiring a Principal AI Engineer to lead the design and scaling of internal evaluation systems for production AI agents. You will own the end-to-end lifecycle from model evaluation to production monitoring and play a key role in raising engineering standards across AI initiatives.

You’ll work with AI, ML, and product teams to reduce manual steps and accelerate feature delivery, shaping the future of conversational commerce for thousands of enterprises.