Enterprise AI QA & Evaluation Engineer

APTIV INDIA; Dublin; On-site; EUR 70,000 - 110,000; Full time

Benefits offered by this job

Personal holidays

Healthcare

Pension

Tax saver scheme

Free onsite breakfast & lunch

Discounted corporate gym membership

Multicultural environment

Learning and development

Internal & external training

Job summary

Aptiv is seeking an AI QA / Evaluation Engineer (Enterprise AI Agents) in Dublin to define and advance testing and evaluation practices for AI agents and agentic workflows. You will collaborate with stakeholders and engineering teams to ensure reliability, compliance, and fit-for-purpose solutions before release.

Reporting to the AI Platform Manager, you will own evaluation frameworks, test standards, and environment maintenance, supporting user acceptance testing and validation of end-user

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Information Systems or a related field.
• Experience in software testing, QA engineering or validation roles within enterprise technology environments.
• Strong understanding of test design, test execution and defect management practices.
• Experience working with development teams in agile or Kanban-based delivery environments.
• Ability to define structured test approaches for complex systems, including integration and end-to-end scenarios.
• Experience working across engineering, architecture and control functions in a governed enterprise environment.
• Strong analytical and problem-solving skills with attention to detail.
• Understanding of AI/ML or automation solutions and their unique testing considerations is highly desirable.

Responsibilities

• Define and implement testing and evaluation frameworks for AI agents and agentic workflows, covering functional quality, groundedness, safety, reliability, and performance.
• Develop and execute test plans, test cases, evaluation criteria, test data, datasets, and benchmark scenarios to ensure consistent and repeatable validation.
• Partner with DevOps Agent Engineers and Release / Operations Engineers to validate AI solutions throughout build, integration, pre-production, and deployment phases.
• Work with AI Architects to ensure evaluation approaches align with solution design, risk profiles, enterprise standards, and responsible AI requirements.
• Own and maintain development and test environments for AI agents, ensuring stability, availability, and alignment with enterprise platform standards.
• Support business users during user acceptance testing and validate end-user developed agents prior to publishing, ensuring solutions are fit for purpose and meet enterprise quality and governance requirements.
• Identify, log, and track defects, working closely with engineering teams to support resolution, retesting, and continuous improvement of testing practices, tooling, and automation.
• Collaborate with Cyber Security, Legal, and Data Privacy teams to ensure testing addresses compliance, security, and responsible AI requirements, while maintaining clear documentation of test results, quality metrics, and evaluation outcomes.

Skills

Software testing

QA engineering

Test design

Agile / Kanban

Structured test approaches

Governed enterprise environments

Analytical thinking

AI/ML testing considerations

Education

Bachelor's degree in Computer Science / Software Engineering / Information Systems

Tools

Test automation tools

Scripting

CI/CD integrated testing

Job description

Aptiv is seeking an AI QA / Evaluation Engineer (Enterprise AI Agents) in Dublin to define and advance testing and evaluation practices for AI agents and agentic workflows. You will collaborate with stakeholders and engineering teams to ensure reliability, compliance, and fit-for-purpose solutions before release.

Reporting to the AI Platform Manager, you will own evaluation frameworks, test standards, and environment maintenance, supporting user acceptance testing and validation of end-user