Senior Deep Learning Evaluation Engineer

NVIDIA; España; Presencial; EUR 90.000 - 150.000; Jornada completa

Descripción de la vacante

NVIDIA is seeking senior engineers to pioneer evaluation methodologies for cutting-edge deep learning models, including LLMs, RAG, agents, and vision systems. You will collaborate across teams to bring flagship models to life and shape the future of AI at a fast-growing company at the forefront of the AI revolution.

You will design decision-grade evaluation environments, build evaluation pipelines and CI tooling, and translate signals into release decisions, training direction, and competitive

Formación

• BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or a related field.
• 6+ years of hands-on experience with LLMs, designing and running evaluations for large language models or multimodal AI systems.
• Strong statistical foundations: experimental design, significance testing, regression analysis, and the ability to distinguish signal from noise in benchmark results at scale.
• Proven experience building evaluation infrastructure (pipelines, benchmark harnesses, reproducible CI systems).
• Clear, precise communicator who can translate quantitative results into decisions for researchers, product teams, and leadership.

Responsabilidades

• Design and build evaluation environments for frontier models spanning reasoning, multimodal, long-context, and agentic systems.
• Research and develop novel evaluation methodologies for emerging model families and domains.
• Build and operate the evaluation infrastructure and pipelines, including CI and analytics tooling.
• Partner with model research, training, and customer teams to translate signals into release decisions and competitive positioning.

Conocimientos

LLM evaluation

Statistical analysis

Experimentation design

CI pipelines

Communication

Educación

BS/MS/PhD in CS/ML

Herramientas

MLflow

Weights & Biases

Slurm

Descripción del empleo

NVIDIA is seeking senior engineers to pioneer evaluation methodologies for cutting-edge deep learning models, including LLMs, RAG, agents, and vision systems. You will collaborate across teams to bring flagship models to life and shape the future of AI at a fast-growing company at the forefront of the AI revolution.

You will design decision-grade evaluation environments, build evaluation pipelines and CI tooling, and translate signals into release decisions, training direction, and competitive