Senior Quality Engineer, AI

Descript; United States; Remote; USD 140,000 - 181,000; Full time

Job summary

Join a forward-thinking company at the forefront of AI technology, where your expertise in Quality Assurance will help shape revolutionary products. In this role, you'll work closely with a talented AI team to create test plans, evaluate models, and ensure the highest quality standards are met. This is your opportunity to dive into the fast-paced world of AI and make a tangible impact on tools that creators love. With a flexible work environment and a commitment to collaboration, you'll thrive in a culture that values your contributions and encourages growth. If you're passionate about quality and eager to be part of something special, this is the perfect fit for you.

Benefits

Generous healthcare package

Catered lunches

Flexible vacation time

Qualifications

• 5+ years of QA experience with a focus on AI model evaluation.
• Ability to collaborate effectively with cross-functional teams.

Responsibilities

• Create test plans and run experiments to identify improvements.
• Mentor others and collaborate across teams for quality assurance.

Skills

Quality Assurance

Collaboration

AI Model Evaluation

Documentation

Education

Bachelor’s degree in Computer Science

Engineering degree or equivalent experience

Tools

SQL

Python

Job description

Help Us Shape the Future of AI at Descript!

Are you obsessed with quality, detail-oriented to a fault, and fascinated by the world of AI? Perfect—because we’re on the hunt for a QA pro to make sure our groundbreaking AI-powered products are as reliable and polished as they are revolutionary. At Descript, we’re not just changing how content creators work with audio and video—we’re making magic. And we need someone like you to help make sure that magic happens, every time.

This is your chance to dive into the fast-paced world of AI technology, take quality to the next level, and put your stamp on tools that creators will actually love using.

This role can be remote in the US or based in the SF Bay Area.

What You'll Do

• Work hand-in-hand with our brilliant AI team to create test plans, run experiments, and identify areas for improvement or inconsistencies in model behavior.
• Set the gold standard for model quality by creating baselines, benchmarks, and rating systems.
• Build scalable processes for evaluating AI models—both quantitatively and qualitatively—so we can stay ahead of the game.
• Keep everything organized with clear test plans, documentation, and bug reports that your future self (and team) will thank you for.
• Tap into internal and external resources to gather the data we need to refine and perfect our models.
• Be the go-to expert for working with third-party service providers to ensure they meet our sky-high quality standards.
• Continuously improve testing tools and methodologies.
• Share the QA love by mentoring others and collaborating across teams to make sure everything works beautifully together.

What You Bring

• Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience.
• 5+ years QA experience.
• 2+ years experience leading evaluation of AI models.
• 2+ years experience as a test lead on a team, product area, or feature.
• Experience working with AI research teams.
• Ability to collaborate effectively with cross-functional teams and stakeholders.

Nice to Haves

• Experience evaluating AI speech or video models.
• Experience writing SQL queries.
• Experience using Python for scripting.

The base salary range for this role is $140,000-$181,000. Final offer amounts will carefully consider multiple factors, including prior experience, expertise, and location, and they may vary from the amount above.

About Descript

Descript is building a simple, intuitive, fully-powered editing tool for video and audio — an editing tool built for the age of AI. We are a team of 150 — with a proven CEO and the backing of some of the world's greatest investors (OpenAI, Andreessen Horowitz, Redpoint Ventures, Spark Capital).

Descript is the special company that's in possession of both product market fit and the raw materials (passionate user community, great product, large market) for growth, but is still early enough that each new employee has a measurable influence on the direction of the company.

Benefits include a generous healthcare package, catered lunches, and flexible vacation time. Our headquarters are located in the Mission District of San Francisco, CA. We're looking to hire people who are local and able to join us at the office when needed. We're flexible, and you're an adult—we don't expect or mandate that you're in the office every day. But we do believe there are valuable and serendipitous moments of discovery and collaboration that come from working together in person.

Descript is an equal opportunity workplace—we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We believe in actively building a team rich in diverse backgrounds, experiences, and opinions to better allow our employees, products, and community to thrive.