AI Data Engineer: ML Pipelines & Governance

S&P Global

New York (NY)

Ibrido

USD 90.000 - 150.000

Tempo pieno

6 giorni fa
Candidati tra i primi

Aumenta le possibilità di ricevere una risposta da questo datore di lavoro

Il tuo curriculum e una lettera di presentazione personalizzati, che corrispondono esattamente a ciò che sta cercando.

Supera i filtri ATS

Vantaggi offerti da questo lavoro

Health coverage
Retirement plan
Education resources

Descrizione del lavoro

S&P Global Corporate is seeking an AI Data Engineer in New York City to design and optimize ML data pipelines, model metadata, and governance integration. You will build data infrastructure on Databricks with Spark, enable MLflow-powered registry, and collaborate with data scientists to ensure scalable feature stores and secure data handling.

The role focuses on model tracking, lifecycle management, and real-time monitoring, with a mandatory in-person technical evaluation and a US work

Competenze

  • 5+ years of hands-on data engineering with 2+ years in AI/ML workloads.
  • Proficiency in Python and ML frameworks (PyTorch, TensorFlow, scikit-learn).
  • Strong experience with Databricks, Spark, and distributed computing for ML workflows.
  • Deep understanding of the ML lifecycle: training, deployment, monitoring.
  • Experience with feature engineering and ML data pipelines.
  • Knowledge of vector databases, embeddings, and similarity search.
  • SQL proficiency for structured and unstructured data.
  • Understanding of data governance, model governance, and AI ethics.
  • Strong analytical and problem-solving with data quality focus.
  • Excellent collaboration with data scientists and ML engineers.

Mansioni

  • Design data pipelines for AI model metadata, training data lineage, and model performance metrics tracking.
  • Build data infrastructure on Databricks leveraging Spark for large-scale processing.
  • Develop MCP servers and enable AI data distribution via MCP.
  • Create feature engineering pipelines and data preprocessing workflows for training and inference.
  • Implement model versioning, experiment tracking, and model registry integration (MLflow).
  • Create automated workflows for AI agent discovery, classification, and inventory management.
  • Design and maintain knowledge graphs for AI model relationships and data lineage.
  • Build real-time data pipelines for model monitoring, drift detection, and performance tracking.
  • Develop data quality frameworks for AI training and validation data.
  • Collaborate with data scientists to optimize data access patterns and feature stores.
  • Implement security and compliance controls for sensitive AI data and artifacts.
  • Create documentation for AI data architectures and integration patterns.

Conoscenze

Python
PyTorch
TensorFlow
scikit-learn
Databricks
Apache Spark
ML lifecycle
feature engineering
vector databases
SQL
data governance
collaboration

Formazione

Bachelor’s or Master’s degree in CS/DS/ML

Strumenti

Databricks
Neo4j
MLflow

Descrizione del lavoro

S&P Global Corporate is seeking an AI Data Engineer in New York City to design and optimize ML data pipelines, model metadata, and governance integration. You will build data infrastructure on Databricks with Spark, enable MLflow-powered registry, and collaborate with data scientists to ensure scalable feature stores and secure data handling.

The role focuses on model tracking, lifecycle management, and real-time monitoring, with a mandatory in-person technical evaluation and a US work

Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

NYC-Based AI Data Engineer: Pipelines & ML Ops
NYC-Based AI Data Engineer: Pipelines & ML Ops

S&P Global Inc. • New York (NY)

Ibrido
USD 90.000 - 150.000
Health care
Flexible time off
Learning resources
+2
Senior AI Data Engineer: ML Pipelines & Governance
Senior AI Data Engineer: ML Pipelines & Governance

SIDRAM TECHNOLOGIES • Princeton (CA)

Ibrido
USD 180.000 - 240.000
Senior AI Data Engineer: Databricks, Spark & ML Pipelines
Senior AI Data Engineer: Databricks, Spark & ML Pipelines

HCL Global Systems Inc • Princeton (NJ)

In loco
USD 150.000 - 190.000
Senior AI Data Engineer - Pipelines, Lakehouse & Governance
Senior AI Data Engineer - Pipelines, Lakehouse & Governance

BNY • Jersey City (NJ)

In loco
USD 126.000 - 210.000
Generous paid leaves
Volunteer time off
Wellbeing programs
Data Engineer (NYC Onsite) - AI Pipelines & Data Quality
Data Engineer (NYC Onsite) - AI Pipelines & Data Quality

K Health • New York (NY)

In loco
USD 150.000 - 175.000
Stock options
Paid parental leave
Health insurance (medical, dental, and
+1
AI Data Engineer: ML Pipelines & Vector AI
AI Data Engineer: ML Pipelines & Vector AI

Valiant Technologies LLC • Dallas (TX)

In loco
USD 120.000 - 170.000
AI Data Engineer - ML Pipelines & Data Quality
AI Data Engineer - ML Pipelines & Data Quality

Lunon • Stati Uniti

Remoto
USD 120.000 - 160.000
AI Data Engineer — Pipelines for AI/ML & RAG
AI Data Engineer — Pipelines for AI/ML & RAG

Ethereum Technologies LLC • Dallas (TX)

In loco
USD 120.000 - 180.000
Data Engineer for AI/ML & Advanced Analytics Pipelines
Data Engineer for AI/ML & Advanced Analytics Pipelines

Robotics Technologies LLC • Minnetonka (MN)

In loco
USD 77.000 - 110.000
Data Engineer I: Databricks & MLOps for AI Pipelines
Data Engineer I: Databricks & MLOps for AI Pipelines

Travelers • Stati Uniti

In loco
USD 109.000 - 180.000
Health Insurance
401(k) matching
Pension Plan
+3