Senior ML Infra Engineer (Kubernetes, GPUs, MLOps)

Philo, Inc.; San Francisco, New York, Cambridge (CA, NY, MA); Hybrid; USD 195.000 - 250.000; Vollzeit

Benefits dieser Stelle

Health benefits

401(k) with employer match

Flexible working hours

Parental leave (up to 20 weeks)

Unlimited PTO

Annual vacation bonus

Home office + TV stipend

Zusammenfassung

Philo, Inc. is seeking an Infrastructure MLOps Software Engineer to advance our ML infrastructure in a highly distributed, cloud-based environment.

You’ll own model serving, evaluation pipelines, and observability, while scaling GPU workloads on Kubernetes and enforcing IaC practices. You will partner with engineering teams across discovery, video delivery, and analytics to ship reliable infrastructure and drive efficiency in compute and data pipelines.

Qualifikationen

• 8+ years of software development and infrastructure management experience.
• 4+ years of experience developing and deploying ML systems at scale.
• Experience with Linux and containerized environments (Docker).
• Experience with cloud computing environments (AWS or GCP) and configuring cloud services.

Aufgaben

• Manage the core infrastructure at Philo focusing on ML/LLM workloads.
• Design, build, and maintain cloud infrastructure components (AWS and Kubernetes).
• Scale model serving and inference infrastructure for real-time recommendations and LLM workloads.
• Manage GPU and accelerator infrastructure on Kubernetes, including cost optimization.
• Develop monitoring/observability systems for system health and model quality.
• Build and operate model evaluation infrastructure including offline/online eval pipelines.
• Maintain CI/CD systems to enable pipelines for testing and deployment.
• Promote Infrastructure as Code and collaborate across teams.

Kenntnisse

Software development

Infra management

Distributed systems

Linux

Golang

TypeScript

Python

Tools

Kubernetes

Docker

AWS

GCP

CloudWatch

Terraform

CloudFormation

Prometheus

Grafana

GitLab

Jenkins

Jobbeschreibung

Philo, Inc. is seeking an Infrastructure MLOps Software Engineer to advance our ML infrastructure in a highly distributed, cloud-based environment.

You’ll own model serving, evaluation pipelines, and observability, while scaling GPU workloads on Kubernetes and enforcing IaC practices. You will partner with engineering teams across discovery, video delivery, and analytics to ship reliable infrastructure and drive efficiency in compute and data pipelines.