AI Evaluation & Systems Integration Lead

Bain & Company, Inc.; Warszawa; Sur place; PLN 350 000 - 550 000; Plein temps

Avantages offerts par ce poste

401(k) matching

Generous vacation and benefits

Résumé du poste

Bain & Company, Inc. is seeking an AI Engineering Lead, Evals and Systems Integration to own the evaluation framework for a multi-module Growth AI Performance System.

You will coordinate across Data Ontology, Agentic Core, and Platform teams, ensuring quality gates before deployment and working directly with consulting teams post-live deployments. The role combines the rigour of enterprise-grade AI evaluation with the speed of startup-style iteration, offering real influence over architecture

Qualifications

• Experience designing and running evaluations for AI systems
• Strong Python proficiency and CI/CD familiar
• Ability to articulate evaluation criteria and metrics
• Experience with data ontology and knowledge graphs

Responsabilités

• Design and own evaluation framework across the Growth AI platform
• Evaluate integration points between data ontology and agentic core
• Coordinate evaluation work across distributed teams
• Present findings to senior stakeholders
• Ensure security/compliance in evaluation infrastructure

Connaissances

LLM evaluation

Agentic AI

Python

Systems integration

Formation

Bachelor's degree in CS/Engineering

Outils

Knowledge graph

Ontology

Description du poste

Bain & Company, Inc. is seeking an AI Engineering Lead, Evals and Systems Integration to own the evaluation framework for a multi-module Growth AI Performance System.

You will coordinate across Data Ontology, Agentic Core, and Platform teams, ensuring quality gates before deployment and working directly with consulting teams post-live deployments. The role combines the rigour of enterprise-grade AI evaluation with the speed of startup-style iteration, offering real influence over architecture