Senior AI Validation & Data Quality Engineer

Teradyne; North Reading (MA); On-site; USD 126,000 - 202,000; Full time

Job summary

Teradyne in North Reading, MA seeks a Senior QA Validation Engineer for AI Initiatives to lead end-to-end validation and QA of AI/ML systems from a data-centric perspective. You will design data quality tests, validate data sources and governance, and oversee scenario-based testing for generative AI and agentic applications.

This role blends strategic QA leadership with hands-on validation, collaborating with data engineering, data science, and product teams to ensure trustworthy AI outputs and

Qualifications

• 7+ years of QA/validation engineering experience, with at least 2+ years in AI/ML or data-intensive systems.
• Preferably a software test automation engineer with coding experience and knowledge of databases to assess structural correctness.
• Familiarity with regulatory and compliance standards to support or lead audit-related activities.

Responsibilities

• Validate AI/ML models for accurate, authorized data sources and proper data structure.
• Design data quality test strategies for completeness, consistency, lineage, and timeliness of training and inference data.
• Identify data hallucinations, logic errors, and edge cases in AI model outputs linked to data issues.
• Develop and lead test strategies for AI/ML systems including accuracy, bias, robustness, and regression tests.
• Oversee scenario-based testing for generative AI and LLM-driven applications.
• Automate validation suites for multi-agent systems, and CI/CD pipelines for ML models.
• Assess AI model performance via manual and automated reviews focusing on data quality impact.
• Validate prompt engineering outputs against verified data sources.

Skills

Python

Java

SQL

Test automation

Data profiling

AI/ML validation

Data governance

Education

Bachelor’s degree in Information Technology or related field

Master’s in Computer Science / Data Science / Engineering (preferred)

Tools

SQL databases

ETL/ELT testing tools

Data profiling tools

Job description

Teradyne in North Reading, MA seeks a Senior QA Validation Engineer for AI Initiatives to lead end-to-end validation and QA of AI/ML systems from a data-centric perspective. You will design data quality tests, validate data sources and governance, and oversee scenario-based testing for generative AI and agentic applications.

This role blends strategic QA leadership with hands-on validation, collaborating with data engineering, data science, and product teams to ensure trustworthy AI outputs and