Job Search and Career Advice Platform

Enable job alerts via email!

People Manager

Amazon

Jeddah

On-site

SAR 150,000 - 200,000

Full time

Today
Be an early applicant

Generate a tailored resume in minutes

Land an interview and earn more. Learn more

Job summary

A leading global technology company is looking for a Benchmark Lead for their Seller AI team. This role involves managing a team that benchmarks AI models to enhance seller experience across the marketplace. The ideal candidate should possess strong leadership, communication skills, and a solid background in AI/LLMs. Key responsibilities include executing benchmarking exercises, preparing reports, and mentoring team members. The position requires proficiency in French, with a preference for candidates holding a master's degree. Join us to shape the future of selling with cutting-edge AI technologies.

Qualifications

  • Experience in validating and improving AI/LLM models.
  • Strong understanding of benchmarking methodologies.
  • Proven ability to manage teams and projects efficiently.

Responsibilities

  • Plan and execute benchmarking exercises for AI models.
  • Lead team responsible for data validation based on guidelines.
  • Prepare comprehensive benchmarking reports for stakeholders.
  • Drive process efficiencies and explore automation opportunities.
  • Mentor team members while managing schedules and risks.

Skills

Leadership
Communication Skills
Team Management
Stakeholder Engagement
Data Analysis

Education

Masters Degree preferred
Min. B1 or B2.2 certified in French Language
Job description

Join the Seller AI team where you'll lead benchmarking and evaluation of AI models that enhance the seller experience across Amazon's global marketplace. You'll manage a team dedicated to validating, testing, and improving Artificial Intelligence (AI) and Large Language Models (LLMs) that power innovative seller tools. This role combines strategic leadership with hands‑on technical oversight, requiring exceptional communication skills, team management, and stakeholder engagement. In this position, you'll drive the development and implementation of comprehensive benchmarking methodologies to evaluate AI model performance across accuracy, robustness, bias, and reliability metrics. Your expertise will be crucial in translating technical findings into actionable insights that improve Seller Assistant's performance and contribute to the growth of Amazon's seller community worldwide.

Key Job Responsibilities
  • Plan and execute benchmarking exercises for AI models, defining test plans, metrics, and acceptance criteria across accuracy, robustness, bias, and reliability dimensions.
  • Lead a team responsible for validating data based on specific annotation guidelines, ensuring accuracy and quality while escalating potential regulatory risks.
  • Prepare comprehensive audit and benchmarking reports, including error ratings, root‑cause analysis, and recommendations for senior stakeholders.
  • Drive process efficiencies and explore automation opportunities to enhance the productivity of data generation initiatives.
  • Mentor team members and help develop their skills while managing overall schedules, proactively mitigating risks, and keeping project scope under control.
A Day in the Life

Your day begins with prioritizing benchmarking tasks for your team based on current business requirements. You'll review progress on ongoing audits, provide guidance where needed, and ensure deliverables meet quality standards. Throughout the day, you'll analyze performance data from Seller Assistant tools, identifying patterns and insights that could improve AI model effectiveness. You'll wrap up by preparing detailed presentations that showcase your team's findings and recommendations to leadership, highlighting opportunities to enhance seller experience.

About the Team

The Seller AI team within International Seller Services is dedicated to creating Gen‑AI/LLM powered tools and agentic solutions that accelerate business growth for Amazon sellers worldwide. We focus on handling annotations for training, measuring, and improving Artificial Intelligence and Large Language Models to deliver superior seller experiences. Our team combines technical expertise with a deep understanding of seller needs to develop innovative solutions that simplify complex tasks and drive business growth. By joining us, you'll play a pivotal role in shaping the future of selling on Amazon, working with cutting‑edge AI technologies that directly impact millions of sellers across global marketplaces.

Basic Qualifications
  • Min. B1 or B2.2 certified in French Language preferred.
Preferred Qualifications
  • Masters Degree or C1 certified in French Language.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Posted: January 19, 2026 (Updated 9 days ago)

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.