Senior Quality Engineer, AI

Descript; San Francisco (CA); Hybrid; USD 140,000 - 181,000; Full time

Job summary

Descript seeks a QA professional to ensure the reliability of its AI-powered products. The successful candidate will have significant experience in quality assurance and AI model evaluation, collaborating with cross-functional teams to maintain high-quality standards. This role can be remote or based in San Francisco, offering competitive salary benefits along with flexible working arrangements.

Benefits

Generous healthcare package

Catered lunches

Flexible vacation time

Qualifications

• 2+ years of experience leading evaluation of AI models.
• 5+ years of overall QA experience.
• Experience working with AI Research teams.

Responsibilities

• Build scalable processes for evaluating AI models.
• Work closely with AI Research to create test plans.
• Continuously improve testing tools and methodologies.

Skills

Detail-oriented

Collaboration

Leadership

Education

Bachelor’s degree in Computer Science, Engineering, or equivalent

Tools

Python

Job description

Help Us Shape the Future of AI at Descript!

Are you obsessed with quality, detail-oriented to a fault, and fascinated by the world of AI? Perfect—because we’re on the hunt for a QA pro to make sure our groundbreaking AI-powered products are as reliable and polished as they are revolutionary. At Descript, we’re not just changing how content creators work with audio and video—we’re making magic . And we need someone like you to help make sure that magic happens, every time.

This is your chance to dive into the fast-paced world of AI technology, take quality to the next level, and put your stamp on tools that creators will actually love using.

This role can be remote in the US or based in the SF Bay Area.

What You'll Do

• Build scalable processes for evaluating AI models—both quantitatively and qualitatively—so we can stay ahead of the game.
• Work hand-in-hand with our brilliant AI Research team to create test plans, run experiments, and identify areas for improvement or inconsistencies in model behavior.
• Set the gold standard for model quality by creating baselines, benchmarks, and rating systems.
• Keep everything organized with clear test plans, documentation, and bug reports that your future self (and team) will thank you for.
• Tap into internal and external resources to gather the data we need to refine and perfect our models.
• Be the go-to expert for working with third-party service providers to ensure they meet our sky-high quality standards.
• Continuously improve testing tools and methodologies.
• Share the QA love by mentoring others and collaborating across teams to make sure everything works beautifully together.

What You Bring

• 2+ years experience leading evaluation of AI models.
• 2+ years experience as a test lead on a team, product area, or feature.
• 5+ years QA experience.
• Experience working with AI Research teams.
• Ability to collaborate effectively with cross-functional teams and stakeholders.
• Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience.

Nice to Haves

• Experience evaluating AI speech or video models.
• Experience using Python for scripting.

The base salary range for this role is $140,000-$181,000. Final offer amounts will carefully consider multiple factors, including prior experience, expertise, and location, and they may vary from the amount above.

Descript is the special company that's in possession of both product market fit and the raw materials (passionate user community, great product, large market) for growth, but is still early enough that each new employee has a measurable influence on the direction of the company.

Benefits include a generous healthcare package, catered lunches, and flexible vacation time. Our headquarters are located in the Mission District of San Francisco, CA. We're looking to hire people who are local and able to join us at the office when needed. We're flexible, and you're an adult—we don't expect or mandate that you're in the office every day. But we do believe there are valuable and serendipitous moments of discovery and collaboration that come from working together in person.

Descript is an equal opportunity workplace—we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We believe in actively building a team rich in diverse backgrounds, experiences, and opinions to better allow our employees, products, and community to thrive.

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile

Website

From which zip code do you intend to work? *

Do you have experience evaluating AI models? * Select...