Staff Engineer: Foundation Model API & GPU Inference

Databricks Inc.; San Francisco (CA); On-site; USD 192,000 - 260,000; Full time

Benefits offered by this job

Comprehensive benefits

Diversity and inclusion initiatives

Job summary

A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams to ensure operational excellence in GPU serving workloads. Competitive salary range of $192,000 to $260,000 is offered with comprehensive benefits.

Qualifications

• 10+ years of experience building and operating large-scale distributed systems.
• Experience leading high-scale operationally sensitive backend systems.
• Strong foundation in algorithms, data structures, and system design.

Responsibilities

• Design and implement core systems and APIs for Foundation Model Serving.
• Drive architectural decisions and trade-offs for GPU serving workloads.
• Collaborate cross-functionally to translate customer needs into reliable systems.

Skills

Building large-scale distributed systems

Leading backend systems

Algorithms and data structures

Mentoring engineers

Job description

A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams to ensure operational excellence in GPU serving workloads. Competitive salary range of $192,000 to $260,000 is offered with comprehensive benefits.