ML Infra Platform Engineer for LLM Benchmarks

Segment (Twilio); San Francisco (CA); On-site; USD 175,000 - 220,000; Full time

Benefits offered by this job

Comprehensive health coverage

Retirement benefits

Learning and development stipend

Generous PTO

Commuter stipend

Job summary

Dormont Manufacturing Co is seeking a Software Engineer for its ML Infrastructure team in San Francisco. You will develop platforms for orchestrating post-training and model evaluation jobs, ensuring performance and correctness while managing ML workflows.

Ideal candidates have 4+ years in ML platform development, experience in benchmarking LLMs, and skills in Python, Docker, and Kubernetes. The compensation includes a base salary ranging from $175,000 to $220,000, along with benefits such as health coverage and PTO.

Qualifications

• 4+ years of experience developing ML platforms.
• Experience training and/or benchmarking LLMs.
• Experience working with cloud technology stack (e.g., AWS or GCP).

Responsibilities

• Develop re-usable platforms for running in-house and open-source LLM-benchmarks.
• Ensure correctness and performance of post-training and eval jobs on the platform.
• Improve APIs for managing ML workflows.
• Contribute to foundational infrastructure for model inference and training.
• Participate in on-call process to ensure availability of services.
• Own projects end-to-end in a collaborative environment.

Skills

Machine learning fundamentals

Backend system design

ML Infrastructure experience

Python

Docker

Kubernetes

Infrastructure as code (Terraform)

Job description

Dormont Manufacturing Co is seeking a Software Engineer for its ML Infrastructure team in San Francisco. You will develop platforms for orchestrating post-training and model evaluation jobs, ensuring performance and correctness while managing ML workflows.

Ideal candidates have 4+ years in ML platform development, experience in benchmarking LLMs, and skills in Python, Docker, and Kubernetes. The compensation includes a base salary ranging from $175,000 to $220,000, along with benefits such as health coverage and PTO.