Senior ML Platform Engineer - Scalable ML Infrastructure

Testing Site - JPMC; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

JPMorgan Chase in New York seeks a seasoned Software Engineer III (Machine Learning Platform Engineer) to design and deliver scalable ML platforms that empower data scientists and ML engineers to build, deploy, and monitor models securely.

You will collaborate with cross-functional teams to implement CI/CD pipelines, MLOps practices, and robust APIs, while aligning with enterprise standards and driving innovation in ML infrastructure.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Hands-on experience building, deploying, and maintaining machine learning platforms or infrastructure.
• Proficiency in Python and one or more ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn).
• Experience with data processing frameworks and tools (e.g., Spark, Pandas, SQL).
• Practical experience with cloud-based ML platforms (e.g., AWS SageMaker, GCP AI Platform, Azure ML) or on-prem ML infrastructure.
• Strong understanding of MLOps practices, including CI/CD for ML, model versioning, and monitoring.
• Experience developing APIs and platform services for ML workflows.
• Solid knowledge of the software development life cycle and agile methodologies.
• Ability to collaborate with cross-functional teams to deliver platform solutions aligned with business objectives.

Responsibilities

• Design, build, and maintain scalable machine learning platforms and infrastructure to support end-to-end ML workflows.
• Develop and optimize tools for model training, deployment, monitoring, and lifecycle management.
• Integrate data engineering, feature management, and model serving capabilities into unified ML platform solutions.
• Implement secure, high-quality production code for platform services, APIs, and automation pipelines.
• Collaborate with data scientists, ML engineers, and product teams to understand requirements and deliver platform features that accelerate ML development and operations.
• Ensure platform reliability, scalability, and performance through proactive monitoring, troubleshooting, and continuous improvement.
• Produce architecture and design artifacts for platform components, ensuring alignment with enterprise standards and best practices.
• Automate infrastructure provisioning, configuration, and CI/CD pipelines for ML platform services.
• Contribute to the ML platform engineering community of practice and participate in events that explore new and emerging technologies.

Skills

Python

TensorFlow

PyTorch

Scikit-learn

Spark

Pandas

SQL

CI/CD for ML

Agile methodologies

Team collaboration

Education

Software engineering certification

Tools

Docker

Kubernetes

Airflow

Terraform

CloudFormation

Job description

JPMorgan Chase in New York seeks a seasoned Software Engineer III (Machine Learning Platform Engineer) to design and deliver scalable ML platforms that empower data scientists and ML engineers to build, deploy, and monitor models securely.

You will collaborate with cross-functional teams to implement CI/CD pipelines, MLOps practices, and robust APIs, while aligning with enterprise standards and driving innovation in ML infrastructure.