First QA Engineer for AI-Driven Pharma Platform

Storm3; New York (NY); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

401(k)

Relocation support

Unlimited PTO

Equity

Job summary

Storm3 is seeking a Member of Technical Staff (QA Engineer) to own quality for an AI-driven platform. You will build evaluation frameworks for LLM and agentic systems, implement automated testing across AI, backend, and frontend, and drive end-to-end testing and release quality with leadership collaboration.

You will work with Playwright and modern automation tools, applying rigorous evaluation methods to ensure reliability and compliance. This role offers frontline impact and equity upside.

Qualifications

• Experience building testing frameworks for AI/LLM systems.
• Proficient with Playwright and CI/CD processes.
• Ability to operate independently from 0 → 1

Responsibilities

• Build and own evaluation frameworks for LLM and agentic systems
• Create automated testing infrastructure across AI, backend, and frontend systems
• Design tests that identify agent failures, regressions, and compliance risks
• Own end-to-end testing using Playwright and manual exploratory QA
• Implement CI/CD quality gates, test automation, and release sign-off processes
• Partner with Engineers and leadership to define the company's quality standards

Skills

Python

Testing infrastructure

LLM testing

Tools

Playwright

Automation frameworks

Job description

Storm3 is seeking a Member of Technical Staff (QA Engineer) to own quality for an AI-driven platform. You will build evaluation frameworks for LLM and agentic systems, implement automated testing across AI, backend, and frontend, and drive end-to-end testing and release quality with leadership collaboration.

You will work with Playwright and modern automation tools, applying rigorous evaluation methods to ensure reliability and compliance. This role offers frontline impact and equity upside.