Quality Assurance & Standards Manager

Airbnb, Inc.

United States

Remote

USD 156,000 - 195,000

Full time

38 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Airbnb, Inc. is seeking a Senior Manager, Quality & Testing within Fraud & Safety Delivery (FSD) in the US. You will own the quality framework, targets, and calibration across Scaled Services, ensuring consistent judgments, audits, and governance for reviewed cases across risk domains.

You will collaborate with policy, analytics, product and data science teams, shaping how quality is measured and improved while maintaining strong cross-functional influence. Remote eligibility applies.

Qualifications

  • 8+ years of experience in quality assurance, operations, risk, audit, or program management within a high-volume, high-stakes decisioning environment.
  • Built a quality program from scratch with sampling, scorecards, error taxonomies, calibration and governance.
  • Able to drive quality standards through partner or vendor teams and external review bodies.

Responsibilities

  • Own the quality standard and measurement system for FSD within Scaled Services.
  • Define framework, targets, thresholds, guidelines and calibration method.
  • Set governance for changes to the framework and escalation paths.
  • Analyze causes and patterns across reviewed cases and overturned decisions.
  • Handoff remediation to owning function; maintain standard, targets and verdicts.

Skills

Quality assurance
Operations
Risk management
Audit
Program management
Sampling methodology
Data literacy
Cross-functional influence
Model/AI evaluation

Job description

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.

The Community You Will Join:

Fraud & Safety Delivery (FSD) is at the heart of keeping Airbnb safe for the millions of hosts and guests who trust our platform every day. As part of Global Operations, FSD reviews and resolves potential fraud and safety cases across the full user lifecycle, with internal and partner specialists operating 24/7 across the globe.

You'll join Scaled Services, the pillar that builds the tools, processes and data that help FSD scale — and that checks the quality of the work independently of the domains that do it. You'll own the quality standard for FSD within Scaled Services: the framework, targets, thresholds, guidelines and sampling methodology that define what a good decision looks like and how it is measured, and the governance model that controls how that standard changes.

You'll work alongside the Manager, Quality & Testing, whose team applies the standard, and with CS Quality Assurance, the domain teams, Frontline Delivery, Policy, Analytics, Product and Data Science.

The Difference You Will Make:

You own the quality standard and the measurement system behind FSD's quality program: a system that tells the organization how accurate its decisions are, where quality breaks down, and what to change. You set the framework, targets and methodology, and keep them current as policy, product and workflow change. The Manager, Quality & Testing applies them through reviews, audits, calibration and launch testing, with CS Quality Assurance, working to your methodology.

Precision matters in both directions: a missed signal puts our community at risk, and an incorrect enforcement affects someone's livelihood or their travel plans. When decisions are reversed or work goes wrong, you define how the cause is attributed, whether a policy gap, a tool limitation, a product bug, a workflow problem, or a decision the specialist got wrong, and analyze the pattern across cases, so the Manager, Quality & Testing can take each finding to the team that can fix it.

Success looks like one documented quality framework that holds across every risk domain, standards and thresholds that internal teams and partner sites interpret the same way, errors attributed consistently to their real causes, an accuracy standard for decisions made by models and AI agents, and a standard that holds on evidence when someone disagrees with it and changes only through a clear route.

A Typical Day:
  • Own the quality framework: a model that measures both workflow adherence and the accuracy of the enforcement decision, with published standards and severity definitions across every risk domain.
  • Decide how we determine the correct outcome for judgment-based decisions, through expert review panels, blind double-review, and a library of benchmark cases.
  • Maintain the error taxonomy and own the risk-weighted sampling methodology: which populations are sampled, how cases are selected, and how many. CS Quality Assurance executes it.
  • Set the quality targets and thresholds, author the guidelines, and publish the performance bars and escalation paths the organization holds itself to.
  • Define the calibration method that keeps reviewers across internal teams and partner sites scoring the same way, and use the findings from audits of partner scoring to keep the standard current as policy, product, and workflow evolve.
  • Own the governance model for the quality standard: how changes to the framework, targets, thresholds, guidelines and calibration method are proposed, reviewed, approved and versioned, how disagreements from domain teams and partner sites are heard and resolved, how exceptions are recorded, and the escalation path used when a quality gap is not closed (the Senior Manager, Scaled Services, then the domain team senior managers).
  • Own the measurement requirements for quality tooling: the scoring fields, severity levels, error taxonomy and cause tags the tooling must capture to support the standard.
  • Own the method for attributing the cause of an error to workflow, policy, tooling, training, or a specialist's decision, and build it into the guidelines and calibration method so reviewers apply it the same way when they tag cases.
  • Analyze the pattern of causes across reviewed cases and reversed decisions, and report the distribution of drivers, not only the overturn rate.
  • You'll be consulted on the audit coverage plan, audits of partner quality analysts' scoring, quality tooling requirements, test design, UAT and launch verdicts.
  • Hand off remediation to the owning function. The standard, its targets and thresholds, and the methodology stay with you. The audit plan, the reviews, the launch verdict and the application of the standard stay with the Manager, Quality & Testing.
Your Expertise:
  • 8+ years of experience in quality assurance, operations, risk, audit, or program management within a high-volume, high-stakes decisioning environment.
  • Has built a quality program from scratch, not just run one — you have designed sampling methodology, scorecards, error taxonomies, calibration processes, and governance from a blank page.
  • Able to drive quality standards through partner or vendor teams, and through review teams, that you don't manage — you sit outside the teams whose work you measure, and the teams applying your standard report elsewhere. Your standard holds on evidence and influence, not authority.
  • Has measured quality in subjective, judgment-based work, with adjacent fields welcome: fraud and financial crime, content moderation, claims review, credit decisioning, regulatory compliance, or trust and safety.
  • Strong grasp of measurement rigor — you understand sampling design, statistical significance, and inter-rater reliability, and can defend a quality number to a skeptical executive or a partner site that disagrees with it.
  • Strong data literacy — you can pull and interrogate your own data, work fluently with analytics partners, and build reporting that diagnoses rather than describes.
  • Able to attribute cause, not blame — you can define how a specialist error is told apart from a policy gap, a tool limitation or a product bug, and make the distinction stick across reviewers.
  • Exceptional writing skills — your guidelines need to be clear enough that reviewers across regions and partner sites reach the same conclusion.
  • Strong cross-functional influence — you can tell teams their workflows, policies, or models are producing the wrong outcomes without losing them as partners, and work alongside a peer who applies your standard and owns the launch verdict.
  • Experience evaluating model or AI-assisted decision quality is a plus, as is experience in Trust, Fraud, or Safety, but neither is required — the right instincts for precision, user impact, and intellectual honesty matter more.
Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.

Our Commitment To Inclusion & Belonging:

Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply.

We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at: reasonableaccommodations@airbnb.com. Please include your full name, the role you’re applying for and the accommodation necessary to assist you with the recruiting process.

We ask that you only reach out to us if you are a candidate whose disability prevents you from being able to complete our online application.

Equal Employment Opportunity:

Airbnb values diversity & belonging and is proud to be an Equal Employment Opportunity employer. All individuals seeking employment at Airbnb are considered without regard to race, color, religion, national origin, age, gender, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, gender expression, sexual orientation, or any other legally protected characteristic.

How We'll Take Care of You:

Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.

Pay Range

$156,000—$195,000 USD

Reasonable Accommodations:

We are committed to providing reasonable accommodations throughout the recruitment process for applicants with disabilities. If you need assistance, or an accommodation, please let your recruiter know once you are contacted about a role.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Development Lead
Senior AI Development Lead

Job Envoy • United States

Remote
USD 157,000 - 171,000
Senior AI Development Lead
Senior AI Development Lead

Airbnb • United States

Remote
USD 157,000 - 171,000
Lead, Quality, Elevated Support
Lead, Quality, Elevated Support

Airbnb, Inc. • Oregon

Hybrid
USD 106,000 - 125,000
Senior Staff Engineer, Guest & Host (Host Listings & Quality)
Senior Staff Engineer, Guest & Host (Host Listings & Quality)

Airbnb • United States

Remote
USD 248,000 - 310,000
Lead, Quality, Elevated Support
Lead, Quality, Elevated Support

Airbnb, Inc. • United States

Remote
USD 106,000 - 125,000
Senior Manager, Technical Brand & Content
Senior Manager, Technical Brand & Content

Airbnb, Inc. • United States

Remote
USD 192,000 - 237,000
Employee Travel Credits
Senior Manager, Technical Brand & Content
Senior Manager, Technical Brand & Content

Airbnb, Inc. • United States

Remote
USD 192,000 - 237,000
Senior Staff Software Engineer, Trust
Senior Staff Software Engineer, Trust

Airbnb, Inc. • United States

Remote
USD 248,000 - 310,000
Senior Manager, Quality, Volume Tiers
Senior Manager, Quality, Volume Tiers

Airbnb, Inc. • United States

Remote
USD 112,000 - 140,000
Senior Manager, Content & Knowledge Architecture
Senior Manager, Content & Knowledge Architecture

Airbnb, Inc. • California

On-site
USD 196,000 - 245,000