Senior QA Engineer for AI Evaluation & Reliability

Meet Life Sciences; New York (NY); On-site; USD 110,000 - 170,000; Full time

Job summary

Meet Life Sciences seeks a senior quality and test automation engineer to lead QA for probabilistic LLMs and agentic workflows. You will own evaluation pipelines, CI/CD gates, and regression testing in a fast-paced startup.

In this ground-floor role, you will shape the quality function, design novel test strategies, and ensure the safety and reliability of enterprise platforms backed by top investors.

Qualifications

• 1 to 5 years of professional software engineering and testing experience with Python.
• Experience with end-to-end and UI test automation using Playwright.
• Experience or strong interest in testing non-deterministic ML/LLM systems.
• Ability to translate agent behaviors into regression tests.

Responsibilities

• Design LLM eval systems and evaluation pipelines.
• Establish CI/CD quality gates for AI software.
• Build end-to-end UI test suites with Playwright.
• Perform hands-on exploratory testing and defect analysis.

Skills

Python

CI/CD pipelines

Exploratory testing

End-to-end testing

ML/LLM testing

Tools

Playwright

Job description

Meet Life Sciences seeks a senior quality and test automation engineer to lead QA for probabilistic LLMs and agentic workflows. You will own evaluation pipelines, CI/CD gates, and regression testing in a fast-paced startup.

In this ground-floor role, you will shape the quality function, design novel test strategies, and ensure the safety and reliability of enterprise platforms backed by top investors.