Data Engineer Lead - AI-First Platform Architect

504 CGCG-US CG Companies Global-US

Los Angeles (CA)

Hybrid

USD 202,000 - 323,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Capital Group is seeking a Data Engineer Lead in the Capital Solutions Group Technology family to set technical direction for data platforms powering portfolio construction and investment research. You will write code, own architecture, and lead cross‑functional delivery with investment, product, and tech leaders.

You will advance AI‑first engineering practices and build scalable, trustworthy data foundations.

Qualifications

  • 10+ years in data or software engineering with technical leadership of complex production data platforms.
  • Strong Python and SQL, with knowledge of distributed data processing and automated testing.
  • Databricks on AWS including PySpark, Delta Lake, Unity Catalog, Databricks Jobs and SQL.
  • Orchestrated Airflow pipelines (Astronomer) and dbt transformations with retries and backfills.
  • Data modeling, governance incl. slowly changing dims, bi-temporal history and lineage.
  • Data quality, observability, and CI/CD using Deequ, dbt tests, Datadog, Terraform, Harness.
  • Experience preparing governed data for AI via Databricks Genie and related tools.
  • Ability to define specs for AI agents, lead architecture discussions, and mentor engineers.
  • Knowledge of prompt safety, audit trails, and enterprise data access controls.
  • Bachelor’s in CS/Engineering or related field; willingness to lead and influence.

Responsibilities

  • Set data engineering strategy and roadmap for the Lakehouse platform.
  • Design and deliver ingestion, transformation, and serving pipelines with Databricks stack.
  • Own complex, cross‑team data initiatives from requirements to production support.
  • Lead AI‑first engineering evolution and define agent specifications and workflows.
  • Build reusable patterns and patterns for data quality, testing, and monitoring.
  • Collaborate with investment professionals and product managers on outcomes.
  • Lead design reviews, guide day‑to‑day engineering activities, and mentor staff.

Skills

Python
SQL
Data engineering
Airflow
Databricks AWS
PySpark
Data quality
Leadership
AI tooling
Governance

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks
Unity Catalog
Delta Lake
dbt
Airflow
Astronomer
Databricks SQL
Databricks Asset Bundles
PostgreSQL

Job description

Capital Group is seeking a Data Engineer Lead in the Capital Solutions Group Technology family to set technical direction for data platforms powering portfolio construction and investment research. You will write code, own architecture, and lead cross‑functional delivery with investment, product, and tech leaders.

You will advance AI‑first engineering practices and build scalable, trustworthy data foundations.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer Lead, AI-First Data Platform
Senior Data Engineer Lead, AI-First Data Platform

CGCG-US CG Companies Global-US • Los Angeles (CA)

On-site
USD 180,000 - 260,000
Time-away benefits
2-for-1 matching gifts
Professional development resources
AI-First Data Engineer Lead
AI-First Data Engineer Lead

Capital Group • New York (NY)

On-site
USD 180,000 - 260,000
Generous time-off and health benefits
Company-funded retirement contribution
2-for-1 charitable gifts matching
AI-First Data Engineer Lead, Databricks Lakehouse
AI-First Data Engineer Lead, Databricks Lakehouse

Capital Group • Los Angeles (CA)

On-site
USD 202,000 - 342,000
Time-away from day one
Flexible work options
2-for-1 matching gifts
+1
AI Engineer Lead: Production GenAI Architect
AI Engineer Lead: Production GenAI Architect

Capital Group • Charlotte (NC)

On-site
USD 154,000 - 246,000
Tuition reimbursement
Wellness programs
Bonus potential
Senior Data Engineer Lead - AI-Driven Data Platforms
Senior Data Engineer Lead - AI-Driven Data Platforms

Capital One Group • Cambridge (MA)

On-site
USD 230,000 - 262,000
Data Engineer Lead
Data Engineer Lead

CGCG-US CG Companies Global-US • Los Angeles (CA)

On-site
USD 180,000 - 260,000
Time-away benefits
2-for-1 matching gifts
Professional development resources
Senior AI Engineering Lead: Automation & AI Delivery
Senior AI Engineering Lead: Automation & AI Delivery

504 CGCG-US CG Companies Global-US • United States

On-site
USD 187,000 - 318,000
Time off & health benefits
Charitable matching gifts
Professional development resources
+2
Data Engineer Lead
Data Engineer Lead

Capital Group • New York (NY)

On-site
USD 180,000 - 260,000
Generous time-off and health benefits
Company-funded retirement contribution
2-for-1 charitable gifts matching
Senior AI Engineering Lead – Production Gen AI
Senior AI Engineering Lead – Production Gen AI

Capital Group • Irvine (CA), Los Angeles (CA), Charlotte (NC)

Hybrid
USD 154,000 - 287,000
Senior Data Engineer Lead - Cloud Data Platforms & AI
Senior Data Engineer Lead - Cloud Data Platforms & AI

Capital One Group • McLean (VA)

On-site
USD 230,000 - 262,000