Staff Backend Engineer, Foundation Model Serving

Menlo Ventures; San Francisco (CA); On-site; USD 192,000 - 260,000; Full time

Benefits offered by this job

Comprehensive benefits

Annual performance bonus

Equity options

Job summary

A leading data and AI company is seeking a Staff Engineer to design and implement core systems for their Foundation Model Serving. The position focuses on large-scale distributed systems, optimizing GPU workloads, and collaborating across teams. Applicants should have over 10 years of experience and a strong foundation in algorithms and system design. This role offers competitive compensation and significant impact on technology strategy.

Qualifications

• 10+ years of experience building and operating large-scale distributed systems.
• Experience leading high-scale operationally sensitive backend systems.
• Strong foundation in algorithms and data structures.

Responsibilities

• Design and implement core systems and APIs for Databricks Foundation Model Serving.
• Partner with leadership to define the technical roadmap.
• Optimize performance and scalability for GPU serving workloads.

Skills

Large-scale distributed systems

Backend systems

Algorithms

Data structures

System design

Collaboration

Mentoring engineers

Job description

A leading data and AI company is seeking a Staff Engineer to design and implement core systems for their Foundation Model Serving. The position focuses on large-scale distributed systems, optimizing GPU workloads, and collaborating across teams. Applicants should have over 10 years of experience and a strong foundation in algorithms and system design. This role offers competitive compensation and significant impact on technology strategy.