Director, Data Platform Engineering & AI-Driven Delivery

S&P Global, Inc.; Virginia; Hybrid; USD 110,000 - 225,000; Full time

Job summary

S&P Global Dow Jones Indices is seeking a Director of Software Engineering to drive data platform initiatives and offshore delivery alignment with enterprise standards. You will partner with global teams to foster engineering excellence and scalable platform delivery.

You will lead data ingestion, transformation, and AI-assisted tooling adoption (Claude, Copilot, LLMs) to accelerate velocity while ensuring governance and quality across batch and streaming pipelines.

Qualifications

• 10+ years of experience in data engineering, data platforms, cloud data architecture, software engineering, or related domains.
• Experience as a senior IC or technical lead in complex data platforms.
• Hands-on with batch/streaming data workflows and Databricks-based lakehouse architectures.

Responsibilities

• Plan and execute transition of existing data pipelines to the target enterprise data platform, with repeatable ingestion, transformation, testing, deployment, and monitoring.
• Lead adoption of AI-powered development tools to increase velocity and quality, developing reusable context packs.
• Guide offshore teams in onboarding patterns for various data assets, domains, source systems.
• Integrate pipelines with the enterprise data mastering platform and establish data quality controls.
• Support semantic modeling and data discoverability with governance partnerships.
• Provide senior technical leadership and participate in design/code reviews for complex data platform initiatives.

Skills

Data engineering

Data platforms

Cloud data architecture

Software engineering

Senior IC

Databricks

AI tools

LLMs

Tools

Databricks

Claude

GitHub Copilot

LLMs

Job description

S&P Global Dow Jones Indices is seeking a Director of Software Engineering to drive data platform initiatives and offshore delivery alignment with enterprise standards. You will partner with global teams to foster engineering excellence and scalable platform delivery.

You will lead data ingestion, transformation, and AI-assisted tooling adoption (Claude, Copilot, LLMs) to accelerate velocity while ensuring governance and quality across batch and streaming pipelines.