Senior SRE: AI Inference Platform - Remote

Jaide Health; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

An open and inclusive culture and work environment

Weekly lunch stipend, in-office lunches & snacks

Full health and dental benefits

100% Parental Leave top-up for up to 6 months

6 weeks of vacation (30 working days)

Job summary

Jaide Health is seeking a Site Reliability Engineer to join the Model Serving team. This role involves developing and deploying AI platforms that deliver high-performance language models through easy-to-use API endpoints. Collaboration with multiple teams and direct customer interface are essential to meet specific deployment needs.

The ideal candidate will have extensive experience in operational infrastructure, particularly in distributed systems and Kubernetes technologies. Remote work flexibility is part of the offer, enhancing work-life balance.

Qualifications

• 5+ years of engineering experience running production infrastructure at a large scale.
• Experience with Kubernetes and multi-cloud environments.
• Strong understanding of compute/storage/network resource management.

Responsibilities

• Develop, deploy, and operate the AI platform delivering large language models.
• Interface with customers to create customized deployments.
• Ensure smooth operations and efficient teamwork.

Skills

Engineering experience running production infrastructure at a large scale

Designing large, highly available distributed systems with Kubernetes

Experience with GCP, Azure, AWS, OCI

Collaboration and troubleshooting skills

Understanding of distributed systems

Tools

Kubernetes

Golang

C++

Job description

Jaide Health is seeking a Site Reliability Engineer to join the Model Serving team. This role involves developing and deploying AI platforms that deliver high-performance language models through easy-to-use API endpoints. Collaboration with multiple teams and direct customer interface are essential to meet specific deployment needs.

The ideal candidate will have extensive experience in operational infrastructure, particularly in distributed systems and Kubernetes technologies. Remote work flexibility is part of the offer, enhancing work-life balance.