Quality Analyst

Game Companies

Gurugram District

On-site

INR 800,000 - 1,200,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Roblox is seeking a Quality Assurance professional in India to lead the creation and maintenance of the answer key for moderator training and policy work. You will calibrate vendor QA teams, analyze quality data, and drive data-driven decisions to improve moderation accuracy.

You will build calibration materials, audit reviewer performance, and present briefs to leadership. The role emphasizes cross-functional collaboration with Policy, Operations, Engineering, and vendors, with office onsite

Qualifications

  • 3+ years in quality assurance, content moderation, Trust & Safety, or related operations.
  • Strong understanding of content policy and sound judgment on close calls.
  • Experience building answer keys, test sets, or calibration materials.
  • Experience auditing and calibrating reviewers, including outsourced or vendor teams.
  • Knowledge of sampling and basic statistics (accuracy, inter-rater agreement).
  • Experience doing root-cause analysis and turning findings into practical recommendations.
  • Spreadsheet skills for pulling and analyzing data.
  • Clear written and verbal communication, including leadership summaries.
  • Experience working with cross-functional partners such as Policy, Operations, Engineering, and vendors.

Responsibilities

  • Build and maintain the answer key for moderator training and QA.
  • Make final calls on disputed moderation decisions.
  • Calibrate vendor QA teams and measure accuracy.
  • Identify root causes and trends in quality data.
  • Propose fixes and write briefs for stakeholders.
  • Publish weekly quality reports with metrics and confidence intervals.
  • Incorporate appeals, escalations, and customer feedback for a fuller quality view.
  • Re-audit queues after changes to verify improvements.

Skills

Quality assurance
Content moderation
Policy understanding
Auditing reviewers
Statistics basics
Root-cause analysis
Data analysis
Communication
Cross-functional collaboration

Tools

Spreadsheets

Job description

2–5 years

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

You will
  • Build and maintain the answer key. Use your policy and enforcement expertise to create correctly labeled image cases for moderator training, QA, and policy work. Add new cases as policies and content trends change.
  • Make final calls on disputed decisions. Blind-audit sampled cases and resolve disagreements between moderators, vendor QA, and automated systems.
  • Calibrate vendor QA teams. Measure vendor auditors’ accuracy against the answer key and lead calibration sessions to close gaps.
  • Find root causes and trends. Tag every error using a standard error taxonomy, and analyze quality data to find patterns, bottlenecks, and ways to improve. Flag new risks early and run deep dives on the biggest problems.
  • Recommend fixes. Write short briefs for weekly stakeholder reviews. Each brief should size the problem, describe its impact, and name the team best placed to fix it.
  • Report on quality. Pull statistically valid samples and publish weekly quality reports with accuracy metrics and confidence intervals.
  • Use outside quality signals. Include data from user appeals, escalations, partner feedback, and customer support to get a fuller picture of quality.
  • Confirm that fixes worked. Audit affected queues again after each change to check that quality improved.
You have
  • 3+ years in quality assurance, content moderation, Trust & Safety, or a related operations role
  • A strong understanding of content policy, plus sound judgment on close calls
  • Experience building answer keys, test sets, or calibration materials
  • Experience auditing and calibrating reviewers, including outsourced or vendor teams
  • Working knowledge of sampling and basic statistics, including accuracy rates, inter-rater agreement, and confidence intervals
  • Experience doing root-cause analysis and turning findings into practical recommendations
  • Skill with spreadsheets for pulling and analyzing data
  • Clear written and verbal communication, including writing short summaries for leadership
  • Experience working with cross-functional partners such as Policy, Operations, Engineering, and vendors

Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process.

For US based roles only, please note the Company may not be able to employ candidates for this role who have United States work authorization related to certain U.S. visa categories, or support future H-1B sponsorship at this time.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Quality Analyst
Quality Analyst

Roblox • Gurugram District

On-site
INR 900,000 - 1,200,000
Quality Analyst
Quality Analyst

Roblox Corporation • Gurugram District

On-site
INR 800,000 - 1,400,000
Senior Internal Auditor – SOX & Compliance
Senior Internal Auditor – SOX & Compliance

Roblox Corporation • Gurugram District

On-site
INR 1,200,000 - 2,300,000
Senior Internal Auditor – SOX & Compliance
Senior Internal Auditor – SOX & Compliance

Speedrun Talent Network • Gurugram District

Remote
INR 900,000 - 1,500,000
Proactive Moderation Operations Specialist
Proactive Moderation Operations Specialist

Roblox Corporation • Gurugram District

On-site
INR 900,000 - 1,300,000
On-site in Gurugram
Equal employment opportunity
Accommodations for disabilities
Quality Analyst at Roblox, Gurugram
Quality Analyst at Roblox, Gurugram

Roblox Corporation • Gurugram District

On-site
INR 600,000 - 900,000
Senior Internal Auditor SOX And Compliance
Senior Internal Auditor SOX And Compliance

Roblox Corporation • Gurugram District

On-site
INR 1,800,000 - 3,000,000
Senior Product Support Specialist
Senior Product Support Specialist

Roblox Corporation • Gurugram District

On-site
INR 1,800,000 - 3,000,000
Moderation Escalation Specialist
Moderation Escalation Specialist

Game Companies • Gurugram District

Hybrid
INR 11,268,000 - 15,962,000
Manager, Product Support Incident Management
Manager, Product Support Incident Management

Game Companies • Gurugram District

On-site
INR 4,000,000 - 6,500,000