Senior Data Scientist: Responsible AI & ML Evaluation Lead

NTT DATA Europe & Latam

Ro

On-site

EUR 90,000 - 130,000

Full time

39 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

NTT DATA Europe & Latam is seeking a Senior Data Scientist to own a shared evaluation framework, release gates, and responsible-AI controls across ML, RAG, agent, document and vision use cases. You’ll work directly with delivery teams from baseline creation through release decisions, production monitoring and quality reporting.

The role requires strong Python/SQL skills, production experience with AI/ML systems, and a deep grounding in statistics and experimental design.

Qualifications

  • At least 10 years of professional experience preferred.
  • 6+ years of experience in data science, ML evaluation, model validation, experimentation or responsible AI.
  • 4+ years of strong Python and SQL experience with model, log and monitoring data.
  • Production experience evaluating and monitoring AI or ML systems.
  • Strong foundation in statistics, experimental design, error analysis and calibration.
  • Experience with RAG, LLM or agent evaluation and safety testing.
  • Strong technical communication, stakeholder influence, ownership, mentoring and judgment under ambiguity.
  • Excellent command of English, both written and spoken.

Responsibilities

  • Define evaluation strategies, golden datasets, metrics, thresholds and release gates for ML, RAG, agent, document and vision solutions.
  • Build automated evaluation harnesses, regression tests, red-team and prompt-injection tests, and human-evaluation protocols.
  • Define responsible-AI controls covering explainability, bias, PII, human oversight, traceability and model risk.
  • Integrate evaluation into CI/CD and MLOps or LLMOps pipelines.
  • Specify monitoring, alerts, model cards and audit evidence, and investigate production quality issues.
  • Work hands-on with use-case teams from baseline creation to release decisions and report quality against business measures.
  • Challenge weak evidence or unsafe release decisions constructively.
  • Deliver reusable, tested Python code, evaluation assets and governance templates.

Skills

Python
SQL
ML evaluation
Responsible AI
CI/CD
MLOps
Statistical analysis
RAG/LLM evaluation
Adversarial testing
Stakeholder communication

Tools

CloudWatch
New Relic
Langfuse
Bedrock Guardrails

Job description

NTT DATA Europe & Latam is seeking a Senior Data Scientist to own a shared evaluation framework, release gates, and responsible-AI controls across ML, RAG, agent, document and vision use cases. You’ll work directly with delivery teams from baseline creation through release decisions, production monitoring and quality reporting.

The role requires strong Python/SQL skills, production experience with AI/ML systems, and a deep grounding in statistics and experimental design.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Engineer — GenAI & Production ML Lead
Senior ML Engineer — GenAI & Production ML Lead

NTT DATA Europe & Latam • Bari

On-site
EUR 90,000 - 120,000
Data Scientist - AI Evaluation and Responsible AI
Data Scientist - AI Evaluation and Responsible AI

NTT DATA Europe & Latam • Ro

On-site
EUR 90,000 - 130,000
Senior GenAI Data Scientist — Cloud ML Pipelines
Senior GenAI Data Scientist — Cloud ML Pipelines

NTT DATA Europe & Latam • Turbigo

On-site
EUR 50,000 - 70,000
Senior Data Scientist — GenAI & Production ML Lead (Hybrid)
Senior Data Scientist — GenAI & Production ML Lead (Hybrid)

Ntt Data • Puglia

On-site
EUR 60,000 - 75,000
Senior ML Engineer – Generative AI & MLOps Lead
Senior ML Engineer – Generative AI & MLOps Lead

NTT DATA Europe & Latam • Roma

On-site
EUR 90,000 - 120,000
Senior ML Engineer: Generative AI & Production Pipelines
Senior ML Engineer: Generative AI & Production Pipelines

NTT DATA Europe & Latam • Milano

On-site
EUR 90,000 - 130,000
Global projects
Professional growth
Networking opportunities
Senior ML Engineer - GenAI, Cloud & Production Pipelines
Senior ML Engineer - GenAI, Cloud & Production Pipelines

Ntt Data • Lazio

On-site
EUR 90,000 - 120,000
Data Scientist Senior - GenAI Solutions
Data Scientist Senior - GenAI Solutions

NTT DATA Europe & Latam • Turbigo

On-site
EUR 50,000 - 70,000
Senior GenAI ML Engineer — Lead, Deploy & Scale AI
Senior GenAI ML Engineer — Lead, Deploy & Scale AI

NTT DATA Europe & Latam • Torino

On-site
EUR 60,000 - 90,000
Senior Technical Architect: Cloud-Native AI Platform Lead
Senior Technical Architect: Cloud-Native AI Platform Lead

NTT DATA Europe & Latam • Ro

On-site
EUR 90,000 - 130,000