Head of Data & AI Engineering

S&P Global; Centreville (VA); On-site; USD 185,000 - 265,000; Full time

Benefits offered by this job

Health

Downtime

Learning

Retirement

Retail discounts

Referral awards

Job summary

S&P Global Dow Jones Indices is seeking a Senior Engineering leader to guide a 100+ team of data and ML engineers and platform developers. You will drive enterprise-scale data lakehouse architecture on Databricks and AWS, pushing for autonomous AI systems and production-ready pipelines.

Responsibilities include establishing engineering standards, IaC, and governance, while collaborating with Product, FinOps, and executives to translate business goals into technical roadmaps.

Qualifications

• 15+ years engineering experience with 5+ years in director-level or head of engineering roles.
• Deep expertise with Databricks Data Intelligence Platform and Unity Catalog; ability to guide platform trade-offs.
• Extensive AWS enterprise-scale data platform experience and security pattern knowledge.

Responsibilities

• Lead and scale an engineering org of 100+ data/ML engineers and platform developers; manage managers and senior ICs.
• Provide strategic tech direction for lakehouse architecture on Databricks and AWS, ensuring high performance and cost efficiency.
• Drive production-grade autonomous AI systems using Databricks AI stack to deliver measurable business value.
• Establish engineering standards, SLOs, incident management, and IaC practices (Terraform, Databricks Asset Bundles).
• Oversee semantic modeling and RAG architectures with Unity Catalog governance, access controls, and auditability.
• Foster high-performance culture with rapid experimentation and cross-functional collaboration with product, FinOps, and exec leadership.

Skills

Engineering leadership

Databricks Unity Catalog

Delta Lake

AWS Cloud

ML/AI platforms

Strategic direction

Stakeholder communication

Tools

Databricks

AWS

Terraform

Iceberg

Job description

S&P Global Dow Jones Indices is seeking a Senior Engineering leader to guide a 100+ team of data and ML engineers and platform developers. You will drive enterprise-scale data lakehouse architecture on Databricks and AWS, pushing for autonomous AI systems and production-ready pipelines.

Responsibilities include establishing engineering standards, IaC, and governance, while collaborating with Product, FinOps, and executives to translate business goals into technical roadmaps.