Staff SWE, Inference Infrastructure — High-Scale ML

Jaide Health; San Francisco (CA); Hybrid; USD 130,000 - 170,000; Full time

Benefits offered by this job

Open and inclusive culture

Weekly lunch stipend and snacks

Full health and dental benefits

Parental Leave top-up for 6 months

6 weeks of vacation

Remote-flexible work options

Job summary

Jaide Health is seeking experienced Members of Technical Staff to join their Model Serving team. This role involves developing and deploying high-performance AI platforms that power advanced NLP applications. You will enhance model delivery through optimized API endpoints by closely collaborating with various teams on critical projects.

The ideal candidate will have significant experience in engineering, especially with distributed systems. The company offers a hybrid work model and extensive benefits aimed at fostering a healthy and inclusive culture.

Qualifications

• 5+ years of engineering experience in production infrastructure.
• Experience designing large, highly available distributed systems.
• Familiarity with GPUs and TPUs in production environments.

Responsibilities

• Develop, deploy, and operate AI platform for Cohere's large language models.
• Interface with customers for customized deployments.

Skills

Engineering experience running production infrastructure

Designing highly available distributed systems

Kubernetes

GCP/Azure/AWS expertise

Linux-based computing environments

Collaboration and troubleshooting

Golang or C++

Resource and cost management

Job description

Jaide Health is seeking experienced Members of Technical Staff to join their Model Serving team. This role involves developing and deploying high-performance AI platforms that power advanced NLP applications. You will enhance model delivery through optimized API endpoints by closely collaborating with various teams on critical projects.

The ideal candidate will have significant experience in engineering, especially with distributed systems. The company offers a hybrid work model and extensive benefits aimed at fostering a healthy and inclusive culture.