GenAI ML Infrastructure Engineer: Scale AI Workloads

Point72; New York (NY); On-site; USD 180,000 - 300,000; Full time

Benefits offered by this job

Fully-paid health care benefits

Parental and family leave policies

Volunteer opportunities

Support for employee-led affinityroups

Mental and physical wellness programs

Tuition assistance

401(k) with employer match

Job summary

Point72’s Technology team is building scalable GenAI infrastructure to accelerate model development and deployment. You will design high-performance compute environments, and partner with ML researchers to deliver end-to-end ML workflows in cloud and on‑prem settings.

This role emphasizes CI/CD for models, observability, cost management, and strong collaboration. A degree in a technical field and 3–7 years of infra experience are expected.

Qualifications

• Bachelor's or master's degree in CS/EE or related field.
• 3–7 years of experience building scalable compute or ML infra.
• Experience with Kubernetes and cloud platforms (AWS/GCP/Azure).
• Proficiency in Python and systems-level programming (Go/C++/Rust).
• Hands-on with MLops tools: MLflow, Ray, Airflow, Kubeflow, Terraform.

Responsibilities

• Design and implement infrastructure for high-performance generative AI and ML workloads.
• Operate distributed systems for training, tuning, inference, and data preprocessing pipelines.
• Collaborate with ML researchers to optimize compute, throughput, and latency.
• Develop and automate deployment, orchestration, and CI/CD for models and data workflows.
• Implement observability and cost-management for GPU/accelerator environments.
• Benchmark emerging hardware/software to improve scalability and throughput.
• Drive security, compliance, and runbooks for GenAI infrastructure.
• Troubleshoot and optimize GPU/CPU compute stacks for reliability.
• Document architecture and mentor engineers to expand team capability.

Skills

Python

Systems programming

Distributed thinking

Education

Bachelor's or Master's in CS/EE or related

Tools

MLflow

Ray

Airflow

Kubeflow

Terraform

Kubernetes

Job description

Point72’s Technology team is building scalable GenAI infrastructure to accelerate model development and deployment. You will design high-performance compute environments, and partner with ML researchers to deliver end-to-end ML workflows in cloud and on‑prem settings.

This role emphasizes CI/CD for models, observability, cost management, and strong collaboration. A degree in a technical field and 3–7 years of infra experience are expected.