ML Ops Engineer (Boston, MA)

Foundation EGI; Boston (MA); On-site; USD 110,000 - 140,000; Full time

Job summary

Foundation EGI, located in Boston, Massachusetts, is seeking a skilled AI/ML Ops Engineer to design and implement end-to-end machine learning pipelines on Google Cloud and AWS. The candidate will collaborate across teams, ensuring high performance and availability of systems, and drive CI/CD automation. A background in computer graphics or physics-based simulation is a bonus. Ideal candidates should have over 5 years of experience with expert skills in Python and TypeScript, along with experience with Docker and Kubernetes.

Qualifications

• 5+ years of experience as an AI/ML Ops, DevOps, Infrastructure Engineer or equivalent.
• Expert-level Python and TypeScript skills.
• Deep understanding of machine learning models, including LLMs.
• Experience designing and maintaining CI/CD pipelines.

Responsibilities

• Architect, build, and operate end-to-end ML pipelines on Google Cloud and AWS.
• Define, instrument, and maintain logging, monitoring, and alerting for model performance.
• Automate CI/CD for ML artifacts using GitHub Actions.
• Collaborate with cross-functional teams including engineers and researchers.
• Help ensure high availability and performance of systems.

Skills

Python

TypeScript

CI/CD pipelines

Docker

Kubernetes

Machine learning models

Infrastructure as Code (Terraform)

Google Cloud

AWS

Education

BS in Computer Science or a related field

Tools

Prometheus

Grafana

ELK Stack

Vertex AI

Domain-Specific Languages

Job description

Requirements

• Architect, build, and operate end-to-end ML pipelines for training, validation and deployment on Google Cloud and AWS.
• Define, instrument, and maintain logging, monitoring, and alerting for model performance and data drift.
• Automate CI/CD for ML artifacts and infrastructure using GitHub Actions or equivalent.
• Collaborate with cross-functional teams, including frontend engineers, backend engineers, research engineers, and infrastructure engineers.
• Write clean, well-documented, fast, and maintainable code.
• Help ensure our systems have high availability and performance.
• Experience in computer graphics or physics-based simulation.
• Background in setting up Prometheus/Grafana, ELK, or similar monitoring stacks.
• Experience with Vertex AI.
• Experience working with custom Domain-Specific Languages.

About Us

We are an MIT-born, venture-backed Silicon Valley startup building a real-life 'Jarvis'—an AI Copilot for design and manufacturing. Our goal is to utilize advanced AI, physics simulation, and computer graphics to reduce costs and improve engineering productivity across all steps of the design and manufacturing process.

What we're looking for

• BS in Computer Science or a related field.
• 5+ years of experience as an AI/ML Ops, DevOps, Infrastructure Engineer or equivalent.
• Expert-level Python and TypeScripts skills.
• Experience with Docker, Kubernetes, Terraform, Google Cloud and AWS.
• Deep understanding of machine learning models, including LLMs.
• Experience designing and maintaining CI/CD pipelines to fine-tune or train ML models.
• Excellent written and verbal communication skills.

Bonus Points

• Experience in computer graphics or physics-based simulation.
• Background in setting up Prometheus/Grafana, ELK, or similar monitoring stacks.
• Experience with Vertex AI.
• Experience working with custom Domain-Specific Languages.

Our tech stack

• Google Cloud, AWS
• Python, TypeScript
• Protobuf, gRPC
• Next.JS, React.JS
• GitHub Actions
• Docker, Kubernetes, Spinnaker
• PostgreSQL