Principal Quality Development Engineer Boston, MA

InterSystems Corporation; Boston (MA); On-site; USD 115,000 - 164,000; Full time

Benefits offered by this job

Medical, vision and dental insurance

Disability and life insurance

401(k) profit sharing contribution

Paid time off and holidays

Job summary

InterSystems Corporation is seeking a technically skilled AI validation specialist to join a cross‑functional agile team focused on product quality in healthcare IT. You will develop AI test strategies, validate non‑deterministic AI applications, and ensure performance and security across systems and APIs.

The role requires 3+ years of experience with AI tools, SDLC knowledge, and programming experience. A positive, collaborative mindset and strong communication are essential to success in our

Qualifications

• 3+ years professional experience.
• Comprehensive understanding of AI tools’ capabilities and limitations.
• Experience working with interdisciplinary teams.
• Good understanding of the SDLC and software testing principles.
• Qualifications and/or certifications in AI.

Responsibilities

• Develop, maintain, and implement AI validation methodologies and tools to validate non‑deterministic AI‑enabled applications.
• Define and standardize non‑functional and structural testing strategies to validate performance and interoperability across various LLMs.
• Collaborate with Agile teams to incorporate end‑user needs and prioritize testing efforts.
• Research and maintain up‑to‑date industry knowledge in AI.
• Evaluate and optimize LLM performance, including accuracy and safety.
• Lead the development of AI test strategies and detailed test plans for releases.
• Support QA teams with test design, execution, triage, and reporting practices.
• Perform system management tasks to support testing activities.
• Design and build custom tools for UI, API, and AI/ML validation.

Skills

AI tooling knowledge

Programming languages

SDLC understanding

Team collaboration

Education

Tertiary qualification in Computer Science

Tools

Python

Java

Shell scripting

Job description

Join InterSystems and help us build the next generation of the EMR. The sheer scale of our capabilities and client engagements, and the way we collaborate, operate, and deliver value provides an unparalleled opportunity to grow and advance. InterSystems is the place for someone looking for a challenging IT career and access to the kind of training, expertise and development tools that only a large company can offer. Our international reach also means you have the opportunity to be part of a truly global organization of smart, technically minded people.

InterSystems employs IT professionals as technical specialists to enhance the quality, performance and usability of innovative products that transform healthcare organizations. Apply your technical skills with cutting‑edge tools and technologies to improve patient outcomes while working as a technical specialist embedded in a cross‑functional agile development team focusing on product quality.

About the Product

Healthcare organizations in 25 countries are making breakthroughs in patient care with TrakCare and IntelliCare, a unified healthcare information system that enables coordinated care within a hospital or across care settings throughout a region—facilitating a seamless patient journey. Clinicians and administrators use TrakCare and IntelliCare to improve safety and outcomes, control costs by eliminating duplicate tests, reduce medication errors, expedite billing, maximize resource utilization, and achieve other strategic initiatives. Built on InterSystems’ health informatics platform, HealthShare, TrakCare and IntelliCare create a consolidated view of each patient’s history, provide secure access to records at every point of care and on any Internet‑connected device, enable interoperability with legacy and future applications, and perform analytics that provide real‑time insights to drive fully informed actions.

Responsibilities

• Develop, maintain, and implement AI validation methodologies and tools to validate non‑deterministic AI‑enabled applications in alignment with industry best practices.
• Define and standardize non‑functional and structural testing strategies to validate application performance, security, and interoperability across various LLM.
• Collaborate with Agile teams in TrakCare and HealthShare to incorporate end‑user needs and prioritize testing efforts to deliver work of high caliber.
• Research and maintain up‑to‑date industry knowledge and developments in the AI space.
• Evaluate and optimize LLM performance, including accuracy, safety, and hallucination detection.
• Identify, evaluate, document, and provide clear reporting of results for configuration testing and optimization.
• Lead the development of AI test strategies and detailed test plans for releases.
• Support QD teams with test design, execution, triage, and reporting practices.
• Perform system management tasks to support testing activities.
• Design and build custom tools for UI, API, and AI/ML validation.
• Provide governance across AI validation activities, operating with managerial and stakeholder oversight.
• Perform other duties as directed by the company from time to time.

Requirements

• Tertiary qualification in Computer Science or related discipline.
• 3+ years professional experience.
• Comprehensive understanding of AI tools’ capabilities and limitations.
• A flexible and adaptable approach to learning and developing new methodology, technologies and software products.
• Possesses intellectual curiosity and have a collaborative and personable demeanor.
• Experience working with interdisciplinary teams.
• Good understanding of the SDLC and software testing principles.
• Qualifications and/or certifications in AI.
• Technical proficiency in multiple programming languages.
• System administration or DevOps experience is advantageous.

Benefits

• Medical, vision, and dental insurance
• Short‑term and long‑term disability and life insurance
• 401(k) profit sharing contribution
• Paid time off and holidays

Compensation

The estimated base compensation range for this role is: $115,000 – $164,000 USD.

Other compensation may include a discretionary annual variable target incentive.

Equal Opportunity Employment

We are an equal‑opportunity employer and do not discriminate because of race, color, religion, sex, national origin, ancestry, marital status, veteran status, age, disability, sexual orientation or gender identity or expression or any other legally protected category. InterSystems is an E‑Verify Employer in the United States.

About InterSystems

InterSystems, a creative data technology provider, delivers a unified foundation for next‑generation applications for healthcare, finance, manufacturing, and supply chain customers in more than 80 countries. Our data platforms solve interoperability, speed, and scalability problems for large organizations around the globe to unlock the power of data and allow people to perceive data in imaginative ways. Established in 1978, InterSystems is committed to excellence through its 24×7 support for customers and partners around the world. Privately held and headquartered in Boston, Massachusetts, InterSystems has 38 offices in 28 countries worldwide. For more information, please visit InterSystems.com.