Head of Data & AI Platform Engineering

S&P Global Inc.

New York (NY)

On-site

USD 185,000 - 265,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

S&P Global Dow Jones Indices is looking for an experienced engineering leader to scale an organization of 100+ data and ML engineers and platform developers. You will drive enterprise lakehouse strategy on Databricks and AWS, and push production‑grade autonomous AI initiatives across the portfolio.

You will establish standards, manage incident response, and mentor managers while aligning technical roadmaps with business goals. This role emphasizes leadership, governance, and measurable impact.

Qualifications

  • 15+ years of engineering experience with 5+ years directly managing and scaling large engineering teams at Director or Head of Engineering level, including experience managing managers and guiding Staff/Principal-level individual contributors through organizational transformation
  • Deep expertise in Databricks Data Intelligence Platform including Unity Catalog, Delta Lake internals, Delta Live Tables, Databricks Workflows, MLflow, and Mosaic AI, with ability to engage in technical discussions and provide strategic guidance on complex platform trade‑offs
  • Extensive experience architecting enterprise‑scale data platforms on AWS including services such as Amazon S3, AWS Glue, Amazon EMR, AWS Lake Formation, with strong understanding of multi‑region deployment strategies and security patterns (IAM, VPC, KMS)
  • Proven technical depth in tools such as Apache Iceberg internals, schema evolution, and cross‑platform table strategies, combined with hands‑on experience in autonomous AI agent deployment and RAG pipeline architecture for production environments
  • Demonstrated ability to build and scale engineering organizations from 20+ to 100+ engineers while establishing rigorous engineering standards, agile delivery practices, and operational SLAs for complex data and AI products
  • Strong leadership and communication skills with experience translating complex technical trade‑offs to non‑technical stakeholders and influencing executive decision‑making through data‑driven recommendations and ROI analysis

Responsibilities

  • Lead and scale an engineering organization of 100+ data engineers, ML engineers, and platform developers, including managing managers and Staff/Principal-level engineers while driving hiring, retention, and talent development strategies
  • Provide strategic technical direction for enterprise‑scale lakehouse architecture using tools such as Databricks Data Intelligence Platform (Unity Catalog, Delta Lake, Delta Live Tables, Mosaic AI) and AWS cloud services, ensuring highly performant, cost‑effective, and interoperable data foundations
  • Drive the organization's transition to production‑grade autonomous AI systems, leveraging tools such as Databricks AI stack including MLflow, Feature Store, Vector Search, and Model Serving to deliver measurable business value beyond proof‑of‑concept implementations
  • Establish rigorous engineering standards and operational excellence practices including SLOs, error budgets, incident management, and infrastructure‑as‑code using tools such as Terraform and Databricks Asset Bundles for reliable platform delivery
  • Oversee enterprise semantic modeling and RAG architecture strategies, ensuring AI systems are grounded in Unity Catalog‑governed data assets with proper access controls, lineage tracking, and auditability to prevent hallucinations
  • Foster a high‑performance engineering culture rooted in psychological safety, continuous learning, and rapid experimentation while partnering with Product, FinOps, and executive leadership to translate business goals into actionable technical roadmaps

Skills

Leadership
Databricks Platform
Unity Catalog
Delta Lake
Delta Live Tables
MLflow
Mosaic AI
AWS
S3
AWS Glue
EMR
Lake Formation
IAM
VPC
KMS
Terraform
Databricks Asset Bundles
RAG
LLMOps
Model Serving

Tools

Databricks
AWS
Terraform

Job description

S&P Global Dow Jones Indices is looking for an experienced engineering leader to scale an organization of 100+ data and ML engineers and platform developers. You will drive enterprise lakehouse strategy on Databricks and AWS, and push production‑grade autonomous AI initiatives across the portfolio.

You will establish standards, manage incident response, and mentor managers while aligning technical roadmaps with business goals. This role emphasizes leadership, governance, and measurable impact.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Head of Data Platform & AI Engineering
Head of Data Platform & AI Engineering

spgi • New York (NY)

On-site
USD 185,000 - 265,000
Head of Data Platform & AI Engineering
Head of Data Platform & AI Engineering

JP Morgan Chase • Jersey City (NJ)

On-site
USD 240,000 - 340,000
Executive Director, Applied AI Platform Engineering
Executive Director, Applied AI Platform Engineering

JP Morgan Chase • Columbus (OH)

On-site
USD 260,000 - 380,000
Executive Director, AI-Driven Data Platform Engineering
Executive Director, AI-Driven Data Platform Engineering

JP Morgan Chase • United States

On-site
USD 180,000 - 240,000
Global Data Platform & AI Engineering Lead (AWS)
Global Data Platform & AI Engineering Lead (AWS)

JP Morgan Chase • Jersey City (NJ)

On-site
USD 250,000 - 350,000
Comprehensive health care coverage
On-site health and wellness centers
A retirement savings plan
+5
Senior Director, Data Platform & AI Engineering
Senior Director, Data Platform & AI Engineering

Aumni • Jersey City (NJ)

On-site
USD 250,000 - 350,000
Head of Engineering - Inbound Data
Head of Engineering - Inbound Data

spgi • New York (NY)

On-site
USD 185,000 - 265,000
AI Platform Director (Data & Governance)
AI Platform Director (Data & Governance)

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 220,000 - 300,000
Executive AI Engineering Director, Data Platform
Executive AI Engineering Director, Data Platform

JP Morgan Chase • Columbus (OH)

On-site
USD 210,000 - 300,000
Data Engineering Manager: Lakehouse & Databricks Lead
Data Engineering Manager: Lakehouse & Databricks Lead

Ledgent Technology • San Diego (CA)

On-site
USD 162,000 - 198,000