Software Engineer, AI Infra

Makers Fund; Palo Alto (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Equity

Health benefits

Monthly stipends

Company retreats

Job summary

Makers Fund is seeking a senior engineer to lead the design and implementation of scalable GPU infrastructure and high-performance AI model serving APIs. You will architect distributed systems to optimize AI workloads and mentor engineers to set the technical vision for AI infrastructure.

The role requires 5+ years in systems infrastructure with deep Kubernetes, cloud platforms, and AI serving frameworks, and proficiency in Python, Go, or C++. Experience managing large GPU fleets is essential.

Qualifications

• 5+ years in systems infrastructure with Kubernetes, cloud platforms and AI serving frameworks.
• Proficiency in Python, Go or C++ and experience managing large GPU fleets.

Responsibilities

• Lead design and implementation of scalable GPU infrastructure and AI model serving APIs.
• Architect robust distributed systems for optimized AI workloads.
• Mentor engineers to set the technical vision for AI infrastructure.

Skills

GPU infrastructure

Distributed systems

Kubernetes

Cloud platforms

Python

Go

C++

AI model serving

MLOps

System architecture

Job description

Lead the design and implementation of scalable GPU infrastructure and high-performance AI model serving APIs. Architect robust distributed systems to optimize AI workloads and mentor engineers to set the technical vision for AI infrastructure.

Requirements

Requires over 5 years of experience in systems infrastructure with deep expertise in Kubernetes, cloud platforms, and AI serving frameworks. Proficiency in Python, Go, or C++ and a proven track record of managing large-scale GPU fleets are essential.

Key Skills

GPU Infrastructure, AI Model Serving, Distributed Systems, Kubernetes, Cloud-native Infrastructure, API Optimization, Python, Go, C++, GPU Orchestration, TensorFlow Serving, Triton, TorchServe, Model Deployment, MLOps, System Architecture

Benefits

Equity, Comprehensive health benefits, Monthly stipends, Company retreats