AI Evaluation & Validation Engineer — Test Automation

NNIT; Philippines; Hybrid; PHP 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Competitive Compensation

13th Month Pay

Hybrid set up

Medical Allowance

HMO

Job summary

NNIT's AI Center of Excellence in the Philippines seeks an Evaluation & Validation Engineer to design evaluation frameworks, validate enterprise AI, and ensure production readiness across global clients.

You will collaborate with AI engineers, solution architects, consultants, and business stakeholders to measure AI quality, detect model drift, and support responsible AI governance within an Agile, enterprise IT context.

Qualifications

• At least 4 years of Quality Engineering, Test Automation, Validation, AI Engineering, or Software Engineering experience.
• Experience designing automated testing or evaluation frameworks.
• Experience validating enterprise software or AI applications.
• Experience working within Agile delivery environments.

Responsibilities

• Design AI evaluation frameworks for enterprise applications and define quality metrics, benchmarks, and acceptance criteria.
• Build scalable validation processes with automated evaluation and regression testing.
• Collaborate with AI engineers, architects, consultants, and product owners to meet business, operational, and regulatory expectations.

Skills

Quality Engineering

Test Automation

AI Engineering

Software Engineering

Agile Delivery

OpenAI Evals

LangChain

Python

Git

CI/CD

REST APIs

Test Automation Frameworks

Tools

Python

Git

CI/CD

REST APIs

Test Automation Frameworks

LangChain

LangGraph

Job description

NNIT's AI Center of Excellence in the Philippines seeks an Evaluation & Validation Engineer to design evaluation frameworks, validate enterprise AI, and ensure production readiness across global clients.

You will collaborate with AI engineers, solution architects, consultants, and business stakeholders to measure AI quality, detect model drift, and support responsible AI governance within an Agile, enterprise IT context.