Software Engineer III - Machine Learning Platform

Testing Site - JPMC; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

JPMorgan Chase in New York seeks a seasoned Software Engineer III (Machine Learning Platform Engineer) to design and deliver scalable ML platforms that empower data scientists and ML engineers to build, deploy, and monitor models securely.

You will collaborate with cross-functional teams to implement CI/CD pipelines, MLOps practices, and robust APIs, while aligning with enterprise standards and driving innovation in ML infrastructure.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Hands-on experience building, deploying, and maintaining machine learning platforms or infrastructure.
• Proficiency in Python and one or more ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn).
• Experience with data processing frameworks and tools (e.g., Spark, Pandas, SQL).
• Practical experience with cloud-based ML platforms (e.g., AWS SageMaker, GCP AI Platform, Azure ML) or on-prem ML infrastructure.
• Strong understanding of MLOps practices, including CI/CD for ML, model versioning, and monitoring.
• Experience developing APIs and platform services for ML workflows.
• Solid knowledge of the software development life cycle and agile methodologies.
• Ability to collaborate with cross-functional teams to deliver platform solutions aligned with business objectives.

Responsibilities

• Design, build, and maintain scalable machine learning platforms and infrastructure to support end-to-end ML workflows.
• Develop and optimize tools for model training, deployment, monitoring, and lifecycle management.
• Integrate data engineering, feature management, and model serving capabilities into unified ML platform solutions.
• Implement secure, high-quality production code for platform services, APIs, and automation pipelines.
• Collaborate with data scientists, ML engineers, and product teams to understand requirements and deliver platform features that accelerate ML development and operations.
• Ensure platform reliability, scalability, and performance through proactive monitoring, troubleshooting, and continuous improvement.
• Produce architecture and design artifacts for platform components, ensuring alignment with enterprise standards and best practices.
• Automate infrastructure provisioning, configuration, and CI/CD pipelines for ML platform services.
• Contribute to the ML platform engineering community of practice and participate in events that explore new and emerging technologies.

Skills

Python

TensorFlow

PyTorch

Scikit-learn

Spark

Pandas

SQL

CI/CD for ML

Agile methodologies

Team collaboration

Education

Software engineering certification

Tools

Docker

Kubernetes

Airflow

Terraform

CloudFormation

Job description

Design and deliver market-leading technology products in a secure and scalable way as a seasoned member of an agile team

As a Software Engineer III (Machine Learning Platform Engineer) at JPMorgan Chase within the Consumer & Community Banking (CCB) line of business, you serve as a seasoned member of an agile team focused on building, scaling, and maintaining robust machine learning platforms. You will design and deliver trusted, market-leading infrastructure and tools that empower data scientists and ML engineers to develop, deploy, and monitor models efficiently and securely. You are responsible for implementing critical technology solutions across multiple technical areas to support the firm’s business objectives and drive innovation in ML platform capabilities.

Job responsibilities

• Design, build, and maintain scalable machine learning platforms and infrastructure to support end-to-end ML workflows.
• Develop and optimize tools for model training, deployment, monitoring, and lifecycle management.
• Integrate data engineering, feature management, and model serving capabilities into unified ML platform solutions.
• Implement secure, high-quality production code for platform services, APIs, and automation pipelines.
• Collaborate with data scientists, ML engineers, and product teams to understand requirements and deliver platform features that accelerate ML development and operations.
• Ensure platform reliability, scalability, and performance through proactive monitoring, troubleshooting, and continuous improvement.
• Produce architecture and design artifacts for platform components, ensuring alignment with enterprise standards and best practices.
• Automate infrastructure provisioning, configuration, and CI/CD pipelines for ML platform services.
• Contribute to the ML platform engineering community of practice and participate in events that explore new and emerging technologies.

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience
• Hands-on experience building, deploying, and maintaining machine learning platforms or infrastructure
• Proficiency in Python and one or more ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn)
• Experience with data processing frameworks and tools (e.g., Spark, Pandas, SQL)
• Practical experience with cloud-based ML platforms (e.g., AWS SageMaker, GCP AI Platform, Azure ML) or on-prem ML infrastructure
• Strong understanding of MLOps practices, including CI/CD for ML, model versioning, and monitoring
• Experience developing APIs and platform services for ML workflows
• Solid knowledge of the software development life cycle and agile methodologies
• Ability to collaborate with cross-functional teams to deliver platform solutions aligned with business objectives

Preferred qualifications, capabilities, and skills

• Familiarity with Databricks for scalable data engineering and ML platform integration
• Experience working with Snowflake for cloud-based data warehousing and analytics
• Exposure to Snorkel AI for programmatic data labeling and training data management
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes, Airflow)
• Familiarity with feature stores, model registries, and ML metadata management
• Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation)
• Experience with RESTful APIs and microservices architectures