Lead AI Engineer 4C

BrightClaim; Philippines; On-site; PHP 1,800,000 - 2,400,000; Full time

Job summary

Genpact in the Philippines is seeking a Lead AI Engineer to drive evaluation frameworks for AI models, including performance, safety, and user experience. You will lead large-scale human evaluations, curate test datasets, and translate results into strategic guidance for research, engineering, and product teams.

The role requires expertise in AI/ML evaluation, strong Python and data-analysis skills, and the ability to communicate insights to executives and stakeholders.

Qualifications

• Experience in AI/ML evaluation, model testing, or related technical roles.
• Strong understanding of machine learning concepts, model behavior, and evaluation metrics.
• Experience designing and running human‑in‑the‑loop evaluations or annotation workflows.
• Proficiency with Python, data analysis tools, and experiment‑tracking frameworks.
• Demonstrated ability to synthesize complex findings into clear, actionable insights.

Responsibilities

• Develop comprehensive evaluation frameworks, benchmarks, and success metrics for AI models (text, agents).
• Define evaluation methodologies for performance, safety, robustness, fairness, and user experience.
• Build scalable processes for continuous model assessment throughout the development lifecycle.
• Lead large‑scale human evaluations, including designing tasks, guidelines, and quality controls.
• Create and maintain high‑quality test datasets, including adversarial, edge‑case, and domain‑specific scenarios.
• Analyze evaluation results to identify failure patterns, risks, and opportunities for improvement.
• Translate findings into actionable recommendations for research, engineering, and product teams.
• Partner with model researchers, data scientists, product managers, and safety teams to align evaluation goals with product requirements.
• Communicate insights clearly to technical and non‑technical stakeholders, including executives.
• Influence model development roadmaps based on evaluation outcomes and risk assessments.
• Ensure evaluations meet internal safety standards and external regulatory expectations.
• Contribute to the development of responsible AI policies, red‑team strategies, and risk‑mitigation plans.
• Monitor emerging risks and industry best practices to keep evaluation approaches current.

Skills

AI/ML evaluation

Python

Data analysis

Experiment-tracking

Insight synthesis

Education

Bachelor’s or Master’s degree in Computer Science / ML / Data Science

Job description

Lead AI Engineer

Ready to turn bold ideas into real-world impact?
At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory, our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large-scale models or agentic AI, our breakthrough solutions tackle companies’ most complex challenges.
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment.
Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes. With a strong partner ecosystem and decades of client trust, we provide innovative solutions that transform how businesses run. Powered by a team with an active learning mindset and client centricity at its core, we deliver lasting value for the world’s leading enterprises.
Get to know us at genpact.com and on LinkedIn, YouTube, X, and Facebook.

Job Description

Responsibilities

• Evaluation Strategy and Frameworks
  • Develop comprehensive evaluation frameworks, benchmarks, and success metrics for AI models (text, agents).
  • Define evaluation methodologies for performance, safety, robustness, fairness, and user experience.
  • Build scalable processes for continuous model assessment throughout the development lifecycle.
• Execution and Analysis
  • Lead large‑scale human evaluations, including designing tasks, guidelines, and quality controls.
  • Create and maintain high‑quality test datasets, including adversarial, edge‑case, and domain‑specific scenarios.
  • Analyze evaluation results to identify failure patterns, risks, and opportunities for improvement.
  • Translate findings into actionable recommendations for research, engineering, and product teams.
• Cross Functional Collaboration
  • Partner with model researchers, data scientists, product managers, and safety teams to align evaluation goals with product requirements.
  • Communicate insights clearly to technical and non‑technical stakeholders, including executives.
  • Influence model development roadmaps based on evaluation outcomes and risk assessments.
• Governance and Safety
  • Ensure evaluations meet internal safety standards and external regulatory expectations.
  • Contribute to the development of responsible AI policies, red‑team strategies, and risk‑mitigation plans.
  • Monitor emerging risks and industry best practices to keep evaluation approaches current.

Qualifications we seek in you!

Minimum Qualifications

• Relevant years of experience in AI/ML evaluation, model testing, data science, or related technical roles.
• Strong understanding of machine learning concepts, model behavior, and evaluation metrics.
• Experience designing and running human‑in‑the‑loop evaluations or annotation workflows.
• Proficiency with Python, data analysis tools, and experiment‑tracking frameworks.
• Demonstrated ability to synthesize complex findings into clear, actionable insights.

Preferred Qualifications/ Skills

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Human‑Computer Interaction, Cognitive Science, or a related field

Qualifications

Certifications

Required Skills

Agile Delivery, Agile Software Development Lifecycle, AI/ML Ops, AI Prompting, Data Science, Prompt Design, Prompt Engineering

Language

English, English

Language Proficiency -

Advanced - C1

Additional Job Location -

Job Type

Regular

Master Skill List -

Advanced Analytics / AI / ML

Remote Type -

Office

Work Shift -

Any (Philippines)

Why join Genpact?

• Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter
• Make an impact – Help global enterprises solve business challenges that matter
• Accelerate your career – Gain hands‑on experience, mentorship, and world‑class learning opportunities to stay ahead
• Work with the best – Join 140,000+ bold thinkers and problem‑solvers who push boundaries every day
• Thrive in a values‑driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress

Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.

Let’s build tomorrow together.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a ‘starter kit,’ paying to apply, or purchasing equipment or training.