Lead AI Infrastructure Engineer - GPU & Model Serving

Sarah Smith Fund; Palo Alto (CA); Hybrid; USD 140,000 - 180,000; Full time

Benefits offered by this job

Competitive salary

Equity

Health benefits

Company retreats

Job summary

The Sarah Smith Fund in Palo Alto is seeking a Staff/Lead Software Engineer to build core infrastructure for AI capabilities. You will design GPU infrastructure, lead the technical direction, and mentor engineers.

Applicants must have over 5 years of experience in systems infrastructure and proficiency in languages such as Python. The role offers competitive salary, equity, and comprehensive benefits while fostering a collaborative office environment.

Qualifications

• 5+ years experience as a software engineer in systems infrastructure with ML serving and GPU orchestration.
• Deep knowledge of distributed systems and cloud-native infrastructure.
• Proficiency in backend languages like Python, Go, or C++.

Responsibilities

• Design and maintain scalable GPU infrastructure for AI models.
• Optimize APIs for AI model serving.
• Lead GPU resource orchestration for high-performance applications.

Skills

Systems infrastructure

GPU orchestration

Distributed systems

API optimization

Collaboration

Tools

Kubernetes

AWS

TensorFlow Serving

Job description

The Sarah Smith Fund in Palo Alto is seeking a Staff/Lead Software Engineer to build core infrastructure for AI capabilities. You will design GPU infrastructure, lead the technical direction, and mentor engineers.

Applicants must have over 5 years of experience in systems infrastructure and proficiency in languages such as Python. The role offers competitive salary, equity, and comprehensive benefits while fostering a collaborative office environment.