AI-First Data Engineer Lead

Capital Group

New York (NY)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Generous time-off and health benefits
Company-funded retirement contribution
2-for-1 charitable gifts matching

Job summary

Capital Group seeks a Senior Data Engineer Lead to set a technical direction for data platforms powering portfolio construction and investment research. You will write code, own architecture, and partner with investment, product, and technology leaders in an AI-first engineering approach.

You will design scalable ingestion, transformation, and serving pipelines, influence standards, and lead cross-team data initiatives across Databricks on AWS with a focus on reliability, security, and cost.

Qualifications

  • Senior, hands-on data engineer lead role leading platform and data product delivery.
  • Experience designing data pipelines, storage, and governance at scale.
  • Strong collaboration with investment, product, and technology teams.

Responsibilities

  • Set the data engineering strategy and roadmap, including Lakehouse architecture on Databricks and AWS.
  • Design and build ingestion, transformation, and serving pipelines with Databricks, PySpark, Delta Lake, dbt, and Airflow.
  • Analyze structured and unstructured datasets and map them to data domains.
  • Own delivery of complex, cross-team data initiatives from requirements to production support.
  • Lead AI-first engineering efforts by turning business outcomes into well-defined specs for agents and data products.
  • Create reusable agent workflows and tool integrations for data engineering tasks.
  • Ensure data understandability and reliability for AI with metadata, lineage, and semantic models.

Skills

Databricks
PySpark
Delta Lake
dbt
Airflow
AI-first engineering
Data architecture

Tools

Databricks
PySpark
Delta Lake
dbt
Airflow

Job description

Capital Group seeks a Senior Data Engineer Lead to set a technical direction for data platforms powering portfolio construction and investment research. You will write code, own architecture, and partner with investment, product, and technology leaders in an AI-first engineering approach.

You will design scalable ingestion, transformation, and serving pipelines, influence standards, and lead cross-team data initiatives across Databricks on AWS with a focus on reliability, security, and cost.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI-First Data Engineer Lead, Databricks Lakehouse
AI-First Data Engineer Lead, Databricks Lakehouse

Capital Group • Los Angeles (CA)

On-site
USD 202,000 - 342,000
Time-away from day one
Flexible work options
2-for-1 matching gifts
+1
Data Engineer Lead - AI-First Platform Architect
Data Engineer Lead - AI-First Platform Architect

504 CGCG-US CG Companies Global-US • Los Angeles (CA)

Hybrid
USD 202,000 - 323,000
Senior Data Engineer Lead, AI-First Data Platform
Senior Data Engineer Lead, AI-First Data Platform

CGCG-US CG Companies Global-US • Los Angeles (CA)

On-site
USD 180,000 - 260,000
Time-away benefits
2-for-1 matching gifts
Professional development resources
Data Engineer Lead
Data Engineer Lead

CGCG-US CG Companies Global-US • Los Angeles (CA)

On-site
USD 180,000 - 260,000
Time-away benefits
2-for-1 matching gifts
Professional development resources
Data Engineer Lead
Data Engineer Lead

Capital Group • New York (NY)

On-site
USD 180,000 - 260,000
Generous time-off and health benefits
Company-funded retirement contribution
2-for-1 charitable gifts matching
Senior Data Engineer Lead - AI-Driven Data Platforms
Senior Data Engineer Lead - AI-Driven Data Platforms

Capital One Group • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Engineering Lead: Automation & AI Delivery
Senior AI Engineering Lead: Automation & AI Delivery

504 CGCG-US CG Companies Global-US • United States

On-site
USD 187,000 - 318,000
Time off & health benefits
Charitable matching gifts
Professional development resources
+2
Senior Data Engineer Lead - Cloud Data Platforms & AI
Senior Data Engineer Lead - Cloud Data Platforms & AI

Capital One Group • McLean (VA)

On-site
USD 230,000 - 262,000
AI Engineer Lead: Production GenAI Architect
AI Engineer Lead: Production GenAI Architect

Capital Group • Charlotte (NC)

On-site
USD 154,000 - 246,000
Tuition reimbursement
Wellness programs
Bonus potential
AI-First Data & Support Engineering Lead
AI-First Data & Support Engineering Lead

Databricks Inc. • Plano (TX)

On-site
USD 130,000 - 170,000