Staff AI Research Infra Engineer - Scale GPU Clusters

Fdetimes

New York (NY)

On-site

USD 199,000 - 270,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Databricks is seeking a Staff Software Engineer for AI Research Infrastructure in the United States. You will design and run the research stack powering AI research, building services to schedule, orchestrate, and observe large-scale experiment workloads across thousands of GPUs.

Collaboration with researchers, ML engineers, and platform teams will be essential to turn experiments into robust pipelines. You will influence the roadmap for research compute, develop tooling to improve productivity,

Qualifications

  • 5+ years of software engineering experience in large-scale distributed systems or infrastructure.
  • Experience building and operating distributed systems, data pipelines, or backend services with GPUs/clusters.
  • Proficient in one or more systems languages (C++, Rust, Go, Java, Scala).
  • Experience with cluster schedulers, resource managers, or job orchestration systems (e.g., Kubernetes, Slurm, Ray).
  • Understanding ML training/inference workflows and scalable experimentation practices.

Responsibilities

  • Design infrastructure to support large-scale experiments, data processing, and model training (GPU fleets, HPC clusters, or cloud systems).
  • Build abstractions for job submission, scheduling, and monitoring to accelerate experiments.
  • Create tooling to boost research developer productivity (CI/testing infra, experiment management).
  • Influence the long-term roadmap for research compute and model training pipelines.
  • Mentor and empower engineers working on compute, infra, and AI systems.

Skills

Distributed systems
Systems programming
Kubernetes
Ray/Slurm

Education

CS degree or higher

Job description

Databricks is seeking a Staff Software Engineer for AI Research Infrastructure in the United States. You will design and run the research stack powering AI research, building services to schedule, orchestrate, and observe large-scale experiment workloads across thousands of GPUs.

Collaboration with researchers, ML engineers, and platform teams will be essential to turn experiments into robust pipelines. You will influence the roadmap for research compute, develop tooling to improve productivity,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Research Infra Engineer - GPU Scale & Equity
Staff AI Research Infra Engineer - GPU Scale & Equity

Databricks Inc. • New York (NY)

On-site
USD 199,000 - 270,000
Staff AI Training Infra Architect GPU HPC & Multi-Node
Staff AI Training Infra Architect GPU HPC & Multi-Node

The Briefed • Mountain View (CA)

On-site
USD 190,000 - 260,000
Equity grants
Comprehensive medical, dental, and vis
Generous PTO and flexible work options
Staff AI Runtime Systems Engineer (GPU Training)
Staff AI Runtime Systems Engineer (GPU Training)

FDE Times • Mountain View (CA)

On-site
USD 190,000 - 265,000
Senior AI Infrastructure Lead: Scale GPU Clusters
Senior AI Infrastructure Lead: Scale GPU Clusters

Partner Company • United States

Remote
USD 170,000 - 210,000
Staff Software Engineer, AI Runtime: GPU Training Systems
Staff Software Engineer, AI Runtime: GPU Training Systems

Databricks Inc. • San Francisco (CA)

On-site
USD 190,000 - 265,000
Senior AI Runtime Engineer: Scale GPU Training
Senior AI Runtime Engineer: Scale GPU Training

FDE Times • Mountain View (CA)

On-site
USD 160,000 - 225,000
Senior Staff AI Runtime Architect (GPU Training)
Senior Staff AI Runtime Architect (GPU Training)

Databricks Inc. • Mountain View (CA)

On-site
USD 229,000 - 343,000
Senior AI Training Systems Architect
Senior AI Training Systems Architect

Databricks Inc. • Mountain View (WY)

On-site
USD 229,000 - 343,000
Senior AI Runtime & GPU Training Systems Engineer
Senior AI Runtime & GPU Training Systems Engineer

Neon • San Francisco (CA)

On-site
USD 190,000 - 265,000
Equity
Annual performance bonus
Comprehensive benefits
Senior AI Runtime Systems Engineer - GPU Training
Senior AI Runtime Systems Engineer - GPU Training

The Briefed • Mountain View (CA)

On-site
USD 190,000 - 240,000
Equity grants
Bonus eligibility
Healthcare coverage
+2