Software Development Engineer in Test

Pantera Capital; United States; On-site; USD 130,000 - 180,000; Full time

Job summary

Ease Health is hiring a Software Development Engineer in Test (SDET) to ensure the platform stays rock-solid as we scale AI-native healthcare software. You’ll build core automation frameworks and integrate testing into fast release cycles while navigating complex clinical workflows and compliance.

This highly technical role requires automation-first thinking, testing AI stacks, LLM outputs, and autonomous agents.

Qualifications

• Strong engineer with a quality mindset.
• Interest in evaluating LLMs and testing AI-native workflows.
• Fast learner with ability to master behavioral health workflows quickly.
• Bias toward automation and building test infrastructure.
• Ownership mindset in a fast-growing startup.

Responsibilities

• Design, architect, and maintain scalable automated testing frameworks across our entire stack.
• Develop strategies for testing non-deterministic AI systems, LLM outputs, and autonomous agents across clinical workflows, intake, and documentation.
• Embed automation tightly into our CI/CD pipelines so we can keep shipping in days, not quarters, with absolute confidence.
• Partner with product and software engineers to bake testability and quality into features before a single line of production code is written.
• Hunt for edge cases, race conditions, and compliance gaps in complex billing and clinical scheduling systems.
• Help define how we test and where the product goes.

Skills

Test architecture

Automation

AI testing

CI/CD pipelines

Job description

About Ease Health

Ease Health is building the AI-native operating system for behavioral health. Today, providers rely on fragmented systems across EHR, CRM, billing, scheduling, and documentation. This creates operational drag, staff burnout, and lost revenue. Ease consolidates these into a single platform powered by AI.

We’ve raised $41M led by Andreessen Horowitz. We are growing extremely fast, partnering with leading behavioral health organizations across the country, and rapidly expanding both our product and team.

The Role

We’re hiring a Software Development Engineer in Test (SDET) to ensure that as we scale rapidly, our platform stays rock-solid. You won’t just be clicking buttons or writing passive test scripts. You’ll build the core automation frameworks and infrastructure that let us ship AI-native software at lightning speed without breaking.

This is a highly technical, product-minded engineering role. We need engineers who care deeply about how things work, how they fail, and how to prevent those failures automatically. Testing an AI-native stack, where LLMs and autonomous agents handle complex clinical workflows, is an open engineering challenge. Behavioral health workflows are dense, compliance-heavy, and specific, and you’ll need to master them quickly to build testing systems that mirror real-world clinical behavior.

We move fast. We work hard. We don’t trade off quality to do it. As an SDET, you are the guardian of that promise.

What you build makes sure clinicians treating vulnerable patients can trust our software every single second of the day. Fixing healthcare tech has real consequences for real patients, and your code is what makes sure it works flawlessly.

What you’ll do

• Design, architect, and maintain scalable automated testing frameworks across our entire stack
• Develop strategies for testing non-deterministic AI systems, LLM outputs, and autonomous agents across clinical workflows, intake, and documentation
• Embed automation tightly into our CI/CD pipelines so we can keep shipping in days, not quarters, with absolute confidence
• Partner with product and software engineers to bake testability and quality into features before a single line of production code is written
• Hunt for edge cases, race conditions, and compliance gaps in complex billing and clinical scheduling systems
• Help define how we test and where the product goes

Who you are

• Strong engineer with a quality mindset. You chose to focus on test architecture because you love the challenge of building bulletproof infrastructure.
• AI-curious or experienced. You’re intrigued by evaluating LLMs, managing prompt regression, and testing autonomous agent workflows.
• Fast learner. We want someone who jumps in, picks up the domain quickly, and becomes an expert in behavioral health workflows. That’s a big part of the job.
• Bias toward automation. If you have to do it twice manually, you write code to automate it, and you build tools that make the whole engineering team faster.
• Hungry for ownership. You want massive scope and the autonomy to define the testing philosophy and infrastructure for a fast-growing startup.
• Comfortable in ambiguity. There’s no playbook for testing AI-native healthcare operating systems. You’ll figure out the right path yourself.
• Candidates of all backgrounds welcome. No CS degree required, no minimum years of experience, no brand-name résumé needed. We care about the code and systems you can build.

Why this role

• Your frameworks directly protect the software used by clinicians treating patients who need critical care
• Big scope and equity from day one
• Fast-growing, well-capitalized company, led by a16z
• Be at the forefront of figuring out how to reliably test and validate AI-native systems in a highly regulated industry
• Get in early enough to define our engineering quality culture from day one