Senior Release QA Analyst

Level AI; Austin (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

Level AI is seeking a Senior Release QA Analyst to own release quality, conduct end-to-end release-readiness testing, and drive improvements. You will work closely with Engineering, Product, and Support to ensure safe, fast ship cycles.

You will design risk-based tests, automate regressions, and help define testing coverage while mentoring junior QA professionals in a fast-moving SaaS environment.

Qualifications

• Several years of QA experience with ownership of release or regression testing for a production product.
• Strong test design ability to convert release needs into risk-based test plans.
• Hands-on experience with test automation and CI/CD pipelines (Playwright, Cypress, Selenium) and GitHub Actions or similar.
• Fluency with defect tracking and test management tools, and with API testing.
• Clear written and verbal communication, including explaining technical problems to non-technical audiences.
• A proactive, self-driven approach: takes initiative on improvements.

Responsibilities

• Own release-readiness testing end to end: test planning, regression, smoke, and post-deploy verification.
• Run go/no-go checks and provide evidence-based quality recommendations to release owners.
• Resolve release issues independently and implement preventive actions through root-cause analysis and new test coverage.
• Report on release quality using defect escape rate, regression pass rate, and release cycle time.
• Lead small projects, such as automating a regression suite or improving the release checklist.
• Proactively identify and fix issues slowing the team down and prioritize across releases.
• Build consensus on release timing, defect severity, and testing scope.
• Partner with Engineering, Product, Support, and cross-functional teams to ship releases.
• Contribute to recruiting, onboarding, and mentoring, including interviewing QA candidates.

Skills

Release testing

Regression testing

Test automation

CI/CD pipelines

Defect tracking

API testing

Communication

Proactive improvements

Tools

Playwright

Cypress

Selenium

GitHub Actions

Job description

Level is a learning technology company dedicated to helping students build real academic and life skills with confidence and joy. We combine proven curriculum principles with world-class interactive design to make meaningful practice something students want to come back to, not something they struggle through.

We support what teachers, schools, and parents are already doing by increasing student engagement with high-quality, standards-aligned practice that reinforces classroom learning. That’s why we’re building:

For students: Rewarding and motivating learning experiences that meet students where they are to build real academic proficiency.

For educators: Tools that fit naturally into instruction and help students stay engaged while reducing teacher workload.

For parents: Activities that help kids catch up or get ahead, build confidence, and minimize homework battles, whether learning at school or at home.

We are committed to helping every person maximize their potential and live a life of meaning. It’s a difficult problem that requires brilliant people and tremendous effort over time.

Level is looking for a Senior Release QA Analyst to own release quality: giving the team clear, evidence-based confidence on whether a build is ready to ship. You’ll run release-readiness and regression testing, drive defects to resolution, and make each release safer and faster than the last, working closely with Engineering, Product, and Support.

This is a senior-level individual contributor role on a small, fast-moving team. You’ll be given the goal of shipping reliably and will figure out what to test and how, then do it, resolving issues without guidance and acting to prevent them from recurring.

What You Will Do:

• Own release-readiness testing end to end: test planning, regression, smoke, and post-deploy verification.

• Run go/no-go checks and give release owners a clear, evidence-based quality recommendation.

• Resolve release issues without guidance, and take action to prevent them from recurring through root-cause analysis and new test coverage.

• Report on release quality using defect escape rate, regression pass rate, and release cycle time.

• Lead small projects, such as automating a regression suite or improving the release checklist, including running meetings and communicating with all relevant parties.

• Proactively find and fix problems slowing the team down, and prioritize across competing releases and tasks.

• Build consensus and resolve conflicts on release timing, defect severity, and scope of testing.

• Partner with Engineering, Product, Support, and other cross-functional teams to get releases out the door.

• Contribute to recruiting, onboarding, and mentoring, including interviewing junior to mid-level QA candidates and giving specific hire/no-hire feedback.

Qualifications

Need to Have:

• Several years of QA experience, with a track record of owning release or regression testing for a production product.

• Strong test design: you can turn a loosely defined release into a risk-based test plan without a spec for every case.

• Hands-on experience with test automation and CI/CD pipelines (for example Playwright, Cypress, or Selenium, and GitHub Actions or similar).

• Fluency with defect tracking and test management tools, and with API testing.

• Clear written and verbal communication, including explaining technical problems to non-technical audiences.

• A proactive, self-driven approach: you ask for help early and take initiative on improvements.

Nice to Have:

• Experience in a SaaS or ed tech environment.

• Accessibility testing experience.

• Experience mentoring junior QA staff.