Senior AI Quality & Validation Engineer

InterSystems Corporation; Boston (MA); On-site; USD 115,000 - 164,000; Full time

Benefits offered by this job

Medical, vision and dental insurance

Disability and life insurance

401(k) profit sharing contribution

Paid time off and holidays

Job summary

InterSystems Corporation is seeking a technically skilled AI validation specialist to join a cross‑functional agile team focused on product quality in healthcare IT. You will develop AI test strategies, validate non‑deterministic AI applications, and ensure performance and security across systems and APIs.

The role requires 3+ years of experience with AI tools, SDLC knowledge, and programming experience. A positive, collaborative mindset and strong communication are essential to success in our

Qualifications

• 3+ years professional experience.
• Comprehensive understanding of AI tools’ capabilities and limitations.
• Experience working with interdisciplinary teams.
• Good understanding of the SDLC and software testing principles.
• Qualifications and/or certifications in AI.

Responsibilities

• Develop, maintain, and implement AI validation methodologies and tools to validate non‑deterministic AI‑enabled applications.
• Define and standardize non‑functional and structural testing strategies to validate performance and interoperability across various LLMs.
• Collaborate with Agile teams to incorporate end‑user needs and prioritize testing efforts.
• Research and maintain up‑to‑date industry knowledge in AI.
• Evaluate and optimize LLM performance, including accuracy and safety.
• Lead the development of AI test strategies and detailed test plans for releases.
• Support QA teams with test design, execution, triage, and reporting practices.
• Perform system management tasks to support testing activities.
• Design and build custom tools for UI, API, and AI/ML validation.

Skills

AI tooling knowledge

Programming languages

SDLC understanding

Team collaboration

Education

Tertiary qualification in Computer Science

Tools

Python

Java

Shell scripting

Job description

InterSystems Corporation is seeking a technically skilled AI validation specialist to join a cross‑functional agile team focused on product quality in healthcare IT. You will develop AI test strategies, validate non‑deterministic AI applications, and ensure performance and security across systems and APIs.

The role requires 3+ years of experience with AI tools, SDLC knowledge, and programming experience. A positive, collaborative mindset and strong communication are essential to success in our