QA Validation Engineer for AI Initiatives (Teradyne, North Reading, MA)

Teradyne; Reading (MA); On-site; USD 126,000 - 202,000; Full time

Benefits offered by this job

Health benefits

Retirement plans

Tuition assistance

Job summary

Teradyne in North Reading, MA seeks a QA Validation Engineer for AI initiatives to lead end-to-end validation of AI/ML systems with a data-centric focus. You will ensure data sources, structures, and pipelines meet governance standards while driving accuracy, bias assessment, and robust testing practices.

The role combines strategic QA leadership with hands-on validation across generative AI, agentic systems, and human-in-the-loop workflows, reporting to the IT Quality Assurance Manager.

Qualifications

• 7+ years in QA/validation engineering; 2+ years focused on AI/ML or data-intensive systems.
• Preferably a software test automation engineer with hands-on coding experience.
• Solid understanding of databases to assess structural correctness; familiar with regulatory and compliance standards to support audit activities.
• Experience with data-centric QA for AI/ML systems and governance.

Responsibilities

• Validate AI/ML models consuming accurate, authorized data sources.
• Design data quality test strategies for completeness, consistency, lineage, timeliness.
• Identify data hallucinations and edge cases linked to data issues.
• Lead test strategies for AI/ML systems including accuracy, bias, robustness, and regression tests.
• Oversee scenario-based testing for generative AI and multi-agent outputs.
• Automate validation suites for agentic systems and CI/CD pipelines.
• Assess model performance with emphasis on data quality impact.
• Validate prompt engineering outputs against verified data sources.

Skills

Python

SQL

Test automation

Data profiling

Data governance

AI/ML testing

Leadership

Communication

Education

Bachelor’s degree in business, information technology or related field

Master’s in Computer Science, Data Science, Engineering, or related field preferred

Tools

Test automation frameworks

ML metrics

Data profiling tools

Job description

Select how often (in days) to receive an alert:

QA Validation Engineer for AI Initiatives (Teradyne, North Reading, MA)

Date: Aug 18, 2026

Location: North Reading, MA, US

We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every electronic device you use, Teradyne's test technology ensures your device works right the first time, every time! Our portfolio of automation solutions help manufacturers to develop and deliver products quickly, efficiently and cost-effectively. Together,Teradyne companies deliver manufacturing automation across industries and applications around the world!

We attract, develop, and retain a high-performance workforce, comprised of people with diverse backgrounds and a shared drive for excellence. We strive to foster a positive and inclusive work environment that helps employees, and communities, thrive.

Our Purpose

TERADYNE, where experience meets innovation and driving excellence in every connection. We are fueled by creativity and diversity of thought and in our workforce. Our employees are supportedto innovate and learn something new every day.

We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results.

Opportunity Overview

The QA/Validation Lead Engineer for AI Initiatives is responsible for leading the end-to-end validation, testing, and quality assurance of all AI/ML systems from a data-centric perspective. This role ensures that proper data sources, structures, pipelines, and governance frameworks are validated and maintained across all AI initiatives, including generative AI, agentic systems, and human-in-the-loop workflows. The role combines strategic QA leadership with hands-on technical validation to safeguard the accuracy, reliability, compliance, and ethical use of data powering AI solutions. This position reports to the IT Quality Assurance Manager .

• Validate that AI/ML models are consuming accurate, authorized, and properly structured data sources.
• Design and execute data quality test strategies to assess completeness, consistency, lineage, and timeliness of training and inference data.
• Identify and flag data hallucinations, logic errors, and edge cases in AI model outputs traceable to data issues.
• Develop and lead comprehensive test strategies for AI/ML systems, including accuracy, bias, robustness, and regression testing.
• Oversee scenario-based testing and output validation for generative AI and LLM-driven applications.
• Automate validation suites for agentic/multi-agent systems, integration testing, and CI/CD pipelines for ML models.
• Assess AI model performance through both manual and automated review, with emphasis on data quality impact on outputs.
• Validate prompt engineering outputs from a data accuracy standpoint, ensuring responses are grounded in verified data sources.
• Conduct scenario testing to identify cases where data gaps or structural flaws produce unreliable outputs.
• Partner with prompt engineers to optimize data retrieval and grounding strategies.
• Ensure all AI data sources and structures meet governance, regulatory, and compliance standards.
• Lead audit processes, documentation, and risk assessments related to data usage in AI systems
• Conduct bias detection and explainability testing to ensure ethical and compliant AI use
• Maintain traceability of data lineage for regulatory reporting and audit readiness.
• Validate data flows across human-plus-AI workflows and agent orchestration systems.
• Ensure seamless data integration across multi-agent architectures and API interfaces.
• Collaborate with data engineering, data science, AI/ML engineering, and product teams to establish data quality standards.

All About You

We seek individuals who share our passion and determination. Our commitment to customer success drives us to go the extra mile. If you’re ready to join us in this mission, take a closer look at the minimum criteria for the position.

Education and Training

• Bachelor’s degree in business, information technology or related field (Master's in Computer Science, Data Science, Engineering, or related field preferred).

Experience

• 7+ years in QA/validation engineering; 2+ years focused on AI/ML or data-intensive systems.
• Preferably a software test automation engineer with hands-on coding experience. He/she should also have a solid understanding of databases to assess structural correctness, along with familiarity with regulatory and compliance standards to support or lead audit-related activities.

Technical Skills

• Programming languages such as Python, Java, or similar; SQL; test automation frameworks; ML metrics; and data profiling tools.
• Generative AI, agent orchestration, prompt engineering advanced skills.
• Data lineage, data governance, schema validation, ETL/ELT testing, data lake/warehouse structures.
• Familiar with AI ethics, risk management, audit processes.
• Leadership, cross-functional collaboration, change management, technical documentation, stakeholder communication.
• Analytical Expertise: Advanced skills in data analysis, process optimization, and problem-solving.
• Communication: Exceptional written, verbal, and visual communication skills, with the ability to engage both technical and non-technical audiences.
• Collaboration: Proven ability to work effectively with stakeholders across multiple levels and departments, including balancing competing priorities (negotiation skills).
• Adaptability: Ability to manage ambiguity and shifting priorities in a fast-paced environment.

Preferred Qualifications

• Experience with multi-agent testing and API integration validation.
• Knowledge of AI-human interaction design and workflow optimization.
• Certifications in AI/ML, data governance, or quality engineering.
• Experience establishing QA Centers of Excellence for AI programs.

Compensation

The base salary range for this role is$126,100 to 201,800.This range is a good faith estimate, and the amount of base salary will correspond with experience and skill set. This range can also fluctuate depending on demand and location.

Incentive Plan

This job is eligible for discretionary bonus(es) based on financial performance.

Benefits

Teradyne offers a variety of robust health and well-being benefit programs, including medical, dental, vision, Flexible Spending Accounts, retirement savings plans, life and disability insurance, paid vacation & holidays, tuition assistance programs, and more. Please clickhere to see details.

Job Segment: Testing, Quality Assurance, Compliance, QA Engineer, Computer Science, Technology, Legal, Engineering