GCP ML Platform Engineer: Scalable Pipelines & MLOps

New York Technology Partners; Charlotte (NC); On-site; USD 120,000 - 180,000; Full time

Job summary

New York Technology Partners is hiring a Machine Learning Engineer to build and operationalize scalable ML solutions on Google Cloud Platform (GCP). You will deploy models from Data Scientists, run automated pipelines, and monitor production performance to ensure reliability and cost efficiency.

Responsibilities include designing data processing with Dataproc, PySpark, and Spark SQL, maintaining data quality, and collaborating across Data Engineers and DevOps to govern data lifecycles on Vertex

Qualifications

• Bachelor's degree or higher in CS, engineering, data science, or related field.
• 5+ years of data engineering or ML engineering experience.
• Strong experience with Google Cloud Platform (GCP).
• Proficiency in Python and SQL for data processing and ML workflows.
• Experience building distributed data processing and ML pipelines.
• Understanding of MLOps concepts, model lifecycle management, and deployment strategies.

Responsibilities

• Deploy and manage ML models from Data Scientists on Vertex AI.
• Design automated ML pipelines for batch and near real-time scoring.
• Configure Vertex AI training, model registry, and endpoints.
• Monitor model performance, latency, and reliability in production.
• Build scalable data processing with Dataproc, PySpark, and Spark SQL.
• Create robust data ingestion, transformation, and feature engineering pipelines.
• Optimize distributed workloads for performance and cost efficiency.
• Ensure data quality and governance across ML workflows.
• Develop large-scale data lakes using Apache Iceberg with partitioning and versioning.
• Collaborate with data platform teams to enforce enterprise standards.
• Provide technical leadership on cloud-native ML engineering best practices.

Skills

Python

SQL

GCP

ML Pipelines

MLOps

Education

Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Tools

Vertex AI

Dataproc

BigQuery

GCS

Docker

Kubernetes

PySpark

Iceberg

Job description

New York Technology Partners is hiring a Machine Learning Engineer to build and operationalize scalable ML solutions on Google Cloud Platform (GCP). You will deploy models from Data Scientists, run automated pipelines, and monitor production performance to ensure reliability and cost efficiency.

Responsibilities include designing data processing with Dataproc, PySpark, and Spark SQL, maintaining data quality, and collaborating across Data Engineers and DevOps to govern data lifecycles on Vertex