QA Engineering Lead (AI)

Meta; Menlo Park (CA); On-site; USD 138,000 - 191,000; Full time

Benefits offered by this job

Bonus

Equity

Benefits

Job summary

Meta is seeking a QA Engineering Lead to own end-to-end quality for GenAI products. You will design evaluation frameworks, run hands-on testing, and partner with engineering and research teams to ship confidently.

You will mentor engineers, define metrics, and drive quality initiatives across product areas, systems, and AI models in a fast-moving environment.

Qualifications

• Bachelor's degree or equivalent practical experience in a technical field.
• 7+ years in quality assurance and test engineering for software products or services.
• 2+ years in AI model testing or evaluation, including developing evaluation methods and standards.
• Experience independently leading quality engineering for a complex product or system.
• Experience developing test automation or evaluation tooling in Python, PHP, Java, C/C++, or equivalent.
• Hands-on testing of consumer-facing and business-facing applications, APIs, and AI models.

Responsibilities

• Own end-to-end quality strategy for a GenAI product area from development to launch and improvements.
• Perform hands-on testing of applications, APIs, and AI models.
• Design and evolve AI model evaluation processes with datasets and scoring frameworks.
• Establish product-specific quality standards for model behavior with cross-functional teams.
• Assess quality risks and drive resolution across model behavior, apps, servers, and infrastructure.
• Plan and execute risk-based test strategies including performance, stress, and cross-platform testing.
• Build and maintain reusable test automation and evaluation tooling; integrate quality checks into workflows.
• Define quality metrics and use data to improve test effectiveness and user experience.
• Lead cross-team quality projects and provide evidence-based release readiness recommendations.
• Investigate failures, identify root causes, and prevent recurring defects.
• Mentor QA engineers in test design, automation, and AI evaluation.

Skills

QA Leadership

AI Quality

Test Automation

Model Evaluation

Python

Cross-functional collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Python

Java

C/C++

Job description

We’re looking for QA Engineering Leads to help shape the quality of our GenAI products at Meta. You enjoy solving complex quality challenges, building scalable testing and evaluation solutions, and partnering with engineering and research teams to ship products rapidly and with confidence. In this role, you will independently lead quality engineering for a product area, turn ambiguous requirements into measurable quality standards, and drive improvements across the teams that build and support it.

QA Engineering Lead (AI) Responsibilities:

• Own the end-to-end quality strategy for a Gen AI product area, from early development and model evaluation through launch and ongoing product improvements
• Perform hands‑on testing of consumer-facing and business-facing applications, APIs, and AI models
• Design, implement, and evolve AI model evaluation processes, including representative datasets, product‑aligned weighted scoring frameworks, automated evaluations, human review, and regression coverage
• Establish product‑specific quality standards for model behavior, including correctness, relevance, safety, and robustness, in partnership with engineering, product, and research teams
• Assess quality risks, identify coverage gaps, and drive resolution of issues across model behavior, client applications, server systems, and infrastructure
• Plan and execute risk‑based test strategies covering functional, integration, end‑to‑end, performance, stress, and cross‑platform testing
• Build and maintain reusable test automation and evaluation tooling, integrate quality checks into development workflows, and improve the reliability and speed of test feedback
• Define quality metrics and use data to improve test effectiveness, testing efficiency, regression prevention, and the overall user experience
• Lead cross‑team quality projects, align stakeholders on priorities and dependencies, and provide evidence‑based recommendations on release readiness
• Investigate complex failures, identify root causes, and partner with engineering and infrastructure teams to prevent recurring defects
• Mentor QA engineers in test design, automation, and AI evaluation, and contribute to a quality‑driven engineering culture

Minimum Qualifications:

• Currently has, or is in the process of obtaining, a Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience. A degree must be completed prior to joining Meta
• 7+ years of experience in quality assurance and test engineering for software products or services
• 2+ years of experience in AI model testing or evaluation, including developing evaluation methods and defining model quality standards
• Experience independently leading quality engineering for a complex product or system, and delivering measurable quality improvements
• Experience developing test automation or evaluation tooling in Python, PHP, Java, C/C++, or an equivalent programming language
• Hands‑on experience testing and debugging consumer‑facing and business‑facing web or mobile applications, APIs, and backend services, and evaluating AI models
• Hands‑on experience with test planning, test design and execution, performance and stress testing, and maintaining client and server test automation
• Experience using metrics and failure analysis to prioritize quality improvements and inform release decisions
• Experience coordinating work across engineering and cross‑functional partners, resolving dependencies, and adapting priorities in a fast‑moving development environment
• Experience in communicating technical risks and trade‑offs to stakeholders and mentoring other engineers

Preferred Qualifications:

• Demonstrated improvements in product coverage, test signal quality, automation reliability, or testing efficiency within medium to large engineering teams
• Experience in leveraging data and quality metrics to identify trends, prioritize coverage gaps, and drive product quality improvements
• Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
• Experience in building reusable testing or evaluation frameworks adopted by multiple engineering teams
• Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
• Experience combining human evaluation with automated model‑based evaluation and validating the reliability of the evaluation results
• Familiarity with frontier AI model evaluation practices, including weighted scoring frameworks for assessing model quality and performance
• Experience evaluating generative text, image, voice, or multimodal models, including nondeterministic behavior and model regressions
• Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
• Experience partnering with AI research teams to translate model capabilities and limitations into product evaluation criteria

About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is proud to be an Equal Employment Opportunity and Aff… We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state, and local law. Meta participates in the E‑Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].

$138,000/year to $191,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.