Senior Deep Learning Evaluation Engineer

NVIDIA Corporation; Polska; Hybrid; PLN 375,000 - 650,000; Full time

Job summary

NVIDIA Corporation seeks senior engineers to pioneer evaluation methodologies for frontier deep learning models, including LLMs, RAG, agents, and vision systems. You will design decision-grade evaluation environments, run large-scale experiments, and translate signals into release decisions impacting roadmap.

You will collaborate across model research, training, and product teams, building infrastructure, CI pipelines, and benchmarks enabling reproducible results on HPC clusters.

Qualifications

• BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or related field.
• 6+ years of hands-on experience with LLMs and evaluating large language/multimodal models.
• Experience building evaluation infrastructure and scalable benchmarks.

Responsibilities

• Design and build decision-grade evaluation environments for frontier models (reasoning, multimodal, long-context, agentic).
• Research and develop novel evaluation methodologies for emerging model families and capabilities.
• Build and operate evaluation pipelines, benchmarks, and reproducible CI systems used by cross-functional teams.

Skills

Model evaluation

LLMs

Statistical analysis

CI pipelines

HPC clusters

Communication

Education

BS/MS/PhD in CS/ML/Statistics

Tools

Open-source eval frameworks

Benchmark harnesses

MLflow

W&B

Job description

NVIDIA Corporation seeks senior engineers to pioneer evaluation methodologies for frontier deep learning models, including LLMs, RAG, agents, and vision systems. You will design decision-grade evaluation environments, run large-scale experiments, and translate signals into release decisions impacting roadmap.

You will collaborate across model research, training, and product teams, building infrastructure, CI pipelines, and benchmarks enabling reproducible results on HPC clusters.