ML Infrastructure Engineer - Model Inference & Scale

Abridge; San Francisco (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Generous Time Off

Comprehensive Health Plans

401(k) Matching

Paid Parental Leave

Mental Health Support

Job summary

A healthcare technology firm in San Francisco is seeking an ML Infrastructure Engineer, Model Inference to build and optimize AI-driven solutions. You will design scalable Kubernetes clusters, enhance ML model serving infrastructure, and collaborate with cross-functional teams. Ideal candidates have strong experience in deploying models in production environments and expertise in Kubernetes. This innovative firm promotes a culture of ownership and offers comprehensive benefits for personal and professional growth.

Qualifications

• Strong experience in building and deploying machine learning models in production.
• Deep understanding of container orchestration and distributed systems architecture.
• Expertise in Kubernetes administration with custom resource definitions.

Responsibilities

• Design and maintain scalable Kubernetes clusters for AI model inference.
• Develop and optimize ML model serving infrastructure for low-latency.
• Collaborate with ML teams for scaling backend infrastructure.

Skills

Building and deploying machine learning models

Container orchestration

Distributed systems architecture

Kubernetes administration

API development and management

Tools

NVIDIA Triton Server

PyTorch

Tensorflow

Job description

A healthcare technology firm in San Francisco is seeking an ML Infrastructure Engineer, Model Inference to build and optimize AI-driven solutions. You will design scalable Kubernetes clusters, enhance ML model serving infrastructure, and collaborate with cross-functional teams. Ideal candidates have strong experience in deploying models in production environments and expertise in Kubernetes. This innovative firm promotes a culture of ownership and offers comprehensive benefits for personal and professional growth.