Senior Data Scientist — AI Agent Improvement & Quality

Jobgether

México

Remote

MXN 900,000 - 1,300,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Unlimited PTO
Fully remote
Flexible hours around Central Time
Professional development opportunities
International team

Job summary

Jobgether is seeking a Staff Data Scientist to lead evaluation and optimization of AI-powered agents in a fast-paced, international environment. You will design evaluation strategies, analyze production traces, and translate insights into measurable improvements across product, engineering, and customer success teams.

You will mentor colleagues, contribute to the evolution of agent capabilities, and develop production-quality Python and TypeScript tools, shaping the quality and reliability of

Qualifications

  • 8+ years delivering data science solutions with measurable impact.
  • Hands-on evaluation of LLM-based systems and AI agents.
  • Proficient in Python and SQL; TypeScript willingness.
  • Strong software engineering practices and CI/CD experience.
  • Experience with production GenAI systems and tools.
  • Ability to translate traces into actionable insights.

Responsibilities

  • Own and develop the evaluation strategy for AI agents.
  • Analyze agent traces and conversations at scale to identify failure patterns.
  • Drive improvement cycle with actionable fixes and before/after comparisons.
  • Improve agent skills, orchestration, and supporting infrastructure.
  • Collaborate with Delivery and Customer Success to enhance workflows.
  • Design and validate LLM-as-a-judge evaluation systems.
  • Develop production-quality Python and TypeScript code for tools.
  • Mentor data scientists and engineers in measurement and evaluation.

Skills

Python
SQL
TypeScript
CI/CD
LangGraph
LangSmith
LLM evaluation
NLP
A/B testing

Education

Bachelor's/Master's in CS/Stats/Math

Tools

LangGraph
LangSmith
Vertex AI
SageMaker
MLflow

Job description

Jobgether is seeking a Staff Data Scientist to lead evaluation and optimization of AI-powered agents in a fast-paced, international environment. You will design evaluation strategies, analyze production traces, and translate insights into measurable improvements across product, engineering, and customer success teams.

You will mentor colleagues, contribute to the evolution of agent capabilities, and develop production-quality Python and TypeScript tools, shaping the quality and reliability of

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Data Scientist — AI Agent Quality & Improvement Loop
Staff Data Scientist — AI Agent Quality & Improvement Loop

yalochatinc • Ciudad de México

Hybrid
USD 140,000 - 230,000
Unlimited PTO
Remote work available
Flexible time
+3
Staff AI Engineer — Lead Production AI & Platform
Staff AI Engineer — Lead Production AI & Platform

Jobgether • Mexico

On-site
MXN 1,200,000 - 2,100,000
Competitive salary
Broad AI scope
Strategic influence
+1
Senior Data Scientist: GenAI & Applied ML Leader
Senior Data Scientist: GenAI & Applied ML Leader

Jobgether • Estado de México

Hybrid
MXN 900,000 - 1,300,000
Fully remote
Global client exposure
Professional growth opportunities
Staff AI Product Engineer
Staff AI Product Engineer

Jobgether • Estado de México

Hybrid
MXN 3,724,000 - 5,587,000
Senior AI Evaluation & Analytics Scientist
Senior AI Evaluation & Analytics Scientist

Enlighten AI Labs • Ciudad de México

On-site
MXN 900,000 - 1,300,000
Senior AI Product Architect - Remote
Senior AI Product Architect - Remote

Jobgether • Estado de México

Hybrid
MXN 3,724,000 - 5,587,000
Remote Data Science Lead for Enterprise AI & LLM
Remote Data Science Lead for Enterprise AI & LLM

Jobgether • Mexico

Remote
MXN 1,200,000 - 2,000,000
Competitive salary package
Fully remote working model
Comprehensive healthcare coverage
+1
AI Operations Lead - Remote Automation & AI Systems
AI Operations Lead - Remote Automation & AI Systems

Jobgether • Estado de México

Hybrid
MXN 623,000 - 935,000
Fully remote
Full‑time contract
Asynchronous‑first environment
+2
Remote Data QA Engineer - AI-Driven Data Quality
Remote Data QA Engineer - AI-Driven Data Quality

Jobgether • Estado de México

Hybrid
MXN 300,000 - 700,000
Fully Remote Work
35 days of paid holidays per year
International Team
+3
AI Data Quality Analyst - Human Data Signals & Insights
AI Data Quality Analyst - Human Data Signals & Insights

Prolific • Ciudad de México

Hybrid
MXN 350,000 - 550,000
Hybrid work
Equity
Bonus/commission