Lead Data Engineer: Databricks on AWS Platform

Capital Group Companies; Los Angeles (CA); On-site; USD 202,000 - 342,000; Full time

Benefits offered by this job

Generous time-away

Company-funded retirement contribution

Professional development resources

Annual performance bonus

Bonuses

Job summary

Capital Group Companies in Los Angeles is seeking a senior hands-on Data Engineering Lead to set the technical direction for the CSGT data platform and data products. You will own the data engineering strategy, design robust pipelines, and lead cross-team initiatives using Databricks on AWS, PySpark, and dbt.

The role emphasizes AI-first engineering, data governance, and cost-aware scalability, with responsibilities spanning from standards development to production support and incident response.

Qualifications

• 10+ years of experience in data or software engineering with leadership of complex production data platforms

Responsibilities

• Own data engineering strategy and roadmap for CSGT data platform and data products
• Shape standards across teams and Capital Group engineering practice
• Design and build ingestion, transformation, and serving pipelines using Databricks, PySpark, Delta Lake, dbt, and Airflow
• Lead cross-team data initiatives from requirements to production support, including estimates, sequencing, dependencies, and cost
• Advance AI-first engineering by translating business outcomes for agents and AI applications
• Develop reusable agent workflows for data engineering tasks and establish governance around agent actions

Skills

Python

SQL

Distributed data processing

Data modeling

Data governance

Airflow

Databricks

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

AWS

PySpark

Delta Lake

Unity Catalog

dbt

Airflow

Astronomer

Datadog

Terraform

Harness

Databricks Genie

Job description

Capital Group Companies in Los Angeles is seeking a senior hands-on Data Engineering Lead to set the technical direction for the CSGT data platform and data products. You will own the data engineering strategy, design robust pipelines, and lead cross-team initiatives using Databricks on AWS, PySpark, and dbt.

The role emphasizes AI-first engineering, data governance, and cost-aware scalability, with responsibilities spanning from standards development to production support and incident response.