Sr. AI Software Engineer (Compute Test, North Reading) (North Reading, MA, US)

LitePoint; North Reading (MA); On-site; USD 162,000 - 259,000; Full time

Benefits offered by this job

Medical, dental, vision

Flexible Spending Accounts

Retirement savings plans

Life and disability insurance

Paid vacation & holidays

Tuition assistance

Job summary

Teradyne’s AI Ops team is advancing a knowledge and retrieval infra to aid engineers using AI agents and developer tools across a large codebase. As a Senior AI Software Engineer, you will shape the retrieval platform’s direction while staying hands-on in design, implementation, testing, and operations.

You will work independently on complex problems, evaluate tradeoffs, and collaborate across engineering disciplines to deliver reliable, measurable tooling and integrations.

Qualifications

• Production experience building and operating backend or platform systems, with the ability to take technical ownership and contribute hands-on.
• Experience with search, code intelligence, or retrieval-augmented generation (RAG), including architecture, failure modes, operational tradeoffs, and retrieval-quality measurement.
• Strong Python and systems engineering skills for designing and debugging services, pipelines, indexing, APIs, tests, and operational tools.
• Knowledge of lexical and vector retrieval, re-ranking, chunking, freshness and invalidation, and techniques for finding relevant evidence in documents and code.
• Ability to evaluate retrieval with representative questions and labeled evidence, distinguish retrieval performance from generated-answer quality, and use error analysis to guide decisions.
• Ability to become effective in unfamiliar codebases and engineering domains; prior semiconductor-test experience is not required.
• Clear cross-functional communication skills and the ability to share technical context through documentation, runbooks, and engineering patterns.
• Experience using AI-assisted development tools productively and verifying generated code through testing, review, and evidence.

Responsibilities

• Lead the technical direction, design, implementation, testing, and operation of the retrieval platform.
• Develop Python services and pipelines that index source repositories and engineering documents while preserving permissions.
• Build repeatable evaluations for lexical and vector search, ranking, chunking, freshness, and code- and document-aware retrieval.
• Collaborate with partner teams that own source systems and access rules to deliver practical API and MCP-compatible integrations.
• Ensure operational health is visible through measures for index freshness, failures, retrieval quality, latency, and relevant cost.
• Support platform adoption through hands-on code, tests, operational tooling, documentation, and shared engineering patterns.

Skills

Python

Backend systems

Search / retrieval

RAG

Code intelligence

Engineering tools

Documentation

Tools

APIs

Tests

Job description

We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every electronic device you use, Teradyne's test technology ensures your device works right the first time, every time! Our portfolio of automation solutions help manufacturers to develop and deliver products quickly, efficiently and cost-effectively. Together, Teradyne companies deliver manufacturing automation across industries and applications around the world!

We attract, develop, and retain a high-performance workforce, comprised of people with diverse backgrounds and a shared drive for excellence. We strive to foster a positive and inclusive work environment that helps employees, and communities, thrive.

Our Purpose

TERADYNE, where experience meets innovation and driving excellence in every connection. We are fueled by creativity and diversity of thought and in our workforce. Our employees are supported to innovate and learn something new every day.

We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results.

Opportunity Overview

Teradyne’s AI Ops team is building knowledge and retrieval infrastructure that helps engineering teams use AI agents and developer tools across a large technical codebase and documentation set. As a Senior AI Software Engineer, you will help evolve an existing proof of concept into an owned, reliable, and measurable platform.

This senior individual-contributor role sets technical direction for the retrieval platform while remaining hands-on in design, implementation, testing, and operation. You will work independently on complex technical problems, evaluate tradeoffs, and collaborate across engineering disciplines.

• Lead the technical direction, design, implementation, testing, and operation of the retrieval platform.
• Develop Python services and pipelines that index source repositories and engineering documents while preserving permissions.
• Build repeatable evaluations for lexical and vector search, ranking, chunking, freshness, and code- and document-aware retrieval.
• Collaborate with partner teams that own source systems and access rules to deliver practical API and MCP-compatible integrations.
• Ensure operational health is visible through measures for index freshness, failures, retrieval quality, latency, and relevant cost.
• Support platform adoption through hands-on code, tests, operational tooling, documentation, and shared engineering patterns.

All About You

We seek individuals who share our passion and determination. Our commitment to customer success drives us to go the extra mile. If you’re ready to join us in this mission, take a closer look at the minimum criteria for the position.

• Production experience building and operating backend or platform systems, with the ability to take technical ownership and contribute hands-on.
• Experience with search, code intelligence, or retrieval-augmented generation (RAG), including architecture, failure modes, operational tradeoffs, and retrieval-quality measurement.
• Strong Python and systems engineering skills for designing and debugging services, pipelines, indexing, APIs, tests, and operational tools.
• Knowledge of lexical and vector retrieval, re-ranking, chunking, freshness and invalidation, and techniques for finding relevant evidence in documents and code.
• Ability to evaluate retrieval with representative questions and labeled evidence, distinguish retrieval performance from generated-answer quality, and use error analysis to guide decisions.
• Ability to become effective in unfamiliar codebases and engineering domains; prior semiconductor-test experience is not required.
• Clear cross-functional communication skills and the ability to share technical context through documentation, runbooks, and engineering patterns.
• Experience using AI-assisted development tools productively and verifying generated code through testing, review, and evidence.

Compensation:

The base salary range for this role is $161,700 - $258,800. This range is a good faith estimate, and the amount of base salary will correspond with experience and skill set. This range can also fluctuate depending on demand and location.

Incentive Plan:

This job is eligible for discretionary bonus(es) based on financial performance.

Benefits:

Teradyne offers a variety of robust health and well-being benefit programs, including medical, dental, vision, Flexible Spending Accounts, retirement savings plans, life and disability insurance, paid vacation & holidays, tuition assistance programs, and more. Please click here to see details.