Software Development Engineer in Test

Pantera Capital; United States; On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Equity from day one

Job summary

Ease Health is hiring a Software Development Engineer in Test (SDET) to build core automation frameworks for an AI-native healthcare platform. You will ensure reliability as the product scales, focusing on AI/NLP workflows, LLM outputs, and robust testability across clinical processes.

This is a highly technical, product-minded role where you’ll shape the testing strategy, own automation infrastructure, and partner with engineers to prevent failures in production.

Qualifications

• We’re looking for a strong engineer with a quality mindset and a focus on test architecture.
• Experience evaluating LLMs, prompt regression, and autonomous agent workflows is highly valued.
• No CS degree is required, but strong coding and systems thinking are essential.

Responsibilities

• Design, architect, and maintain scalable automated testing frameworks across the stack.
• Develop strategies for testing AI systems and non-deterministic components.
• Embed automation into CI/CD pipelines to enable rapid, confident releases.
• Partner with product and engineers to build testability into features from start.
• Identify edge cases, race conditions, and compliance gaps in complex systems.
• Help define testing philosophy and infrastructure for the company.

Skills

Test architecture

Automation

AI/LLM testing

CI/CD integration

Ownership mindset

Tools

CI/CD tooling

Testing frameworks

Job description

No recruiting agencies. We do not use recruiting agencies and do not want to be contacted by them about this or any other role.

About Ease Health

Ease Health is building the AI-native operating system for behavioral health. Today, providers rely on fragmented systems across EHR, CRM, billing, scheduling, and documentation. This creates operational drag, staff burnout, and lost revenue. Ease consolidates these into a single platform powered by AI.

We’ve raised $41M led by Andreessen Horowitz. We are growing extremely fast, partnering with leading behavioral health organizations across the country, and rapidly expanding both our product and team.

The Role

We’re hiring a Software Development Engineer in Test (SDET) to ensure that as we scale rapidly, our platform stays rock-solid. You won’t just be clicking buttons or writing passive test scripts. You’ll build the core automation frameworks and infrastructure that let us ship AI-native software at lightning speed without breaking.

This is a highly technical, product-minded engineering role. We need engineers who care deeply about how things work, how they fail, and how to prevent those failures automatically. Testing an AI-native stack, where LLMs and autonomous agents handle complex clinical workflows, is an open engineering challenge. Behavioral health workflows are dense, compliance-heavy, and specific, and you’ll need to master them quickly to build testing systems that mirror real-world clinical behavior.

We move fast. We work hard. We don’t trade off quality to do it. As an SDET, you are the guardian of that promise.

What you build makes sure clinicians treating vulnerable patients can trust our software every single second of the day. Fixing healthcare tech has real consequences for real patients, and your code is what makes sure it works flawlessly.

What you’ll do

• Design, architect, and maintain scalable automated testing frameworks across our entire stack
• Develop strategies for testing non-deterministic AI systems, LLM outputs, and autonomous agents across clinical workflows, intake, and documentation
• Embed automation tightly into our CI/CD pipelines so we can keep shipping in days, not quarters, with absolute confidence
• Partner with product and software engineers to bake testability and quality into features before a single line of production code is written
• Hunt for edge cases, race conditions, and compliance gaps in complex billing and clinical scheduling systems
• Help define how we test and where the product goes

Who you are

• Strong engineer with a quality mindset. You chose to focus on test architecture because you love the challenge of building bulletproof infrastructure.
• AI-curious or experienced. You’re intrigued by evaluating LLMs, managing prompt regression, and testing autonomous agent workflows.
• Fast learner. We want someone who jumps in, picks up the domain quickly, and becomes an expert in behavioral health workflows. That’s a big part of the job.
• Bias toward automation. If you have to do it twice manually, you write code to automate it, and you build tools that make the whole engineering team faster.
• Hungry for ownership. You want massive scope and the autonomy to define the testing philosophy and infrastructure for a fast-growing startup.
• Comfortable in ambiguity. There’s no playbook for testing AI-native healthcare operating systems. You’ll figure out the right path yourself.
• Candidates of all backgrounds welcome. No CS degree required, no minimum years of experience, no brand-name résumé needed. We care about the code and systems you can build.

Why this role

• Your frameworks directly protect the software used by clinicians treating patients who need critical care
• Big scope and equity from day one
• Fast-growing, well-capitalized company, led by a16z
• Be at the forefront of figuring out how to reliably test and validate AI-native systems in a highly regulated industry
• Get in early enough to define our engineering quality culture from day one