Senior AI Research Infra Engineer - Scalable Pipelines

Neon

San Francisco (CA)

On-site

USD 190,000 - 270,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Comprehensive benefits
Equity options
Annual performance bonus

Job summary

Databricks is seeking a Staff Software Engineer for AI Research Infrastructure in San Francisco. The role involves designing and implementing systems for large-scale data processing, developing the research stack for AI research, and partnering with teams to create robust pipelines. You will need a BS/MS or PhD in Computer Science and 5+ years of experience in software engineering focusing on large-scale distributed systems. The position offers a competitive salary range of $190,000 to $270,000 USD.

Qualifications

  • 5+ years of software engineering experience on large-scale distributed systems.
  • Deep experience with building and operating distributed systems and data pipelines.
  • Experience contributing to or building cluster schedulers.

Responsibilities

  • Develop research infrastructure for Databricks AI.
  • Design and implement systems for large-scale data processing.
  • Mentor engineers and influence the research computation roadmap.

Skills

Large-scale distributed systems
Infrastructure programming languages (C++, Rust, Go, Java, Scala)
Cluster scheduling and resource management systems
ML training and inference workflows

Education

BS/MS or PhD in Computer Science or related field

Tools

Kubernetes
Slurm
Ray

Job description

Databricks is seeking a Staff Software Engineer for AI Research Infrastructure in San Francisco. The role involves designing and implementing systems for large-scale data processing, developing the research stack for AI research, and partnering with teams to create robust pipelines. You will need a BS/MS or PhD in Computer Science and 5+ years of experience in software engineering focusing on large-scale distributed systems. The position offers a competitive salary range of $190,000 to $270,000 USD.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Research Infra Engineer - GPU Scale & Equity
Staff AI Research Infra Engineer - GPU Scale & Equity

Databricks Inc. • New York (NY)

On-site
USD 199,000 - 270,000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Anthropic Limited • San Francisco (CA)

Hybrid
USD 315,000 - 560,000
Competitive compensation
Generous vacation and parental leave
Flexible working hours
Staff AI Research Infra Engineer - Scale GPU Clusters
Staff AI Research Infra Engineer - Scale GPU Clusters

Fdetimes • New York (NY)

On-site
USD 199,000 - 270,000
Senior Staff Data Infrastructure Architect – Pipelines
Senior Staff Data Infrastructure Architect – Pipelines

Neon • San Francisco (CA)

On-site
USD 228,600 - 314,250
Senior Staff Data Pipelines Architect
Senior Staff Data Pipelines Architect

Databricks Inc. • San Francisco (CA)

Hybrid
USD 228,600 - 314,250
Comprehensive benefits
Diversity and inclusion commitment
Senior AI Data Engineer: Databricks, Spark & ML Pipelines
Senior AI Data Engineer: Databricks, Spark & ML Pipelines

HCL Global Systems Inc • Princeton (NJ)

On-site
USD 150,000 - 190,000
Senior Staff Software Engineer, Data Infrastructure & AI
Senior Staff Software Engineer, Data Infrastructure & AI

Neon • Mountain View (CA)

On-site
USD 228,600 - 314,250
Annual performance bonus
Equity
Comprehensive benefits
Senior Data Engineer: Scalable Pipelines & Data Platforms
Senior Data Engineer: Scalable Pipelines & Data Platforms

Samba • Warsaw (IN)

On-site
USD 85,609 - 108,384
Health insurance
Wellness offerings
Life and disability insurance
+2
Senior Data Engineer - AI Systems & Scalable Pipelines
Senior Data Engineer - AI Systems & Scalable Pipelines

Permute • Chicago (IL)

On-site
USD 100,000 - 130,000
Senior Database Architect, Scalable Infrastructure
Senior Database Architect, Scalable Infrastructure

Anthropic Limited • San Francisco (CA)

Hybrid
USD 405,000 - 485,000
Competitive compensation
Flexible working hours
Generous vacation and parental leave
+2