Lead Data Engineer with Databricks & DBT Exp

Realign LLC; Irvine (CA); On-site; USD 108,000 - 132,000; Full time

Job summary

Realign LLC in Irvine, CA is seeking a Lead Data Engineer with Databricks and DBT experience. You will lead an enterprise-scale data engineering effort as a Tower/Pod Lead, coordinating onshore, nearshore, and offshore teams to deliver reliable data platforms with strong operational discipline and SLA adherence.

You’ll own the Data Engineering Tower, drive scalable pipelines, ensure production readiness, and partner with business and technology leadership to align governance with strategic

Qualifications

• Databricks, DBT, Apache Spark with performance tuning expertise.
• Expertise in Apache Airflow and Astronomer for workflow orchestration.
• Deep understanding of data engineering, ETL/ELT, and large-scale platforms.
• Experience with CI/CD, DevOps, and Infrastructure as Code (IaC).
• Strong platform management, monitoring, and incident management.

Responsibilities

• Lead and manage the Data Engineering Tower across multiple teams.
• Own end-to-end data platform delivery with SLA adherence.
• Drive scalable pipeline development prioritizing data quality.
• Manage cross-functional dependencies and stakeholder communications.
• Ensure production readiness with monitoring and incident response.
• Collaborate with business, portfolio and technology leadership.
• Define best practices for platform governance and ops readiness.

Skills

Databricks

DBT

Apache Spark

ETL/ELT

CI/CD

DevOps

Infrastructure as Code (IaC)

Performance tuning

Leadership

Stakeholder management

Monitoring & incident management

Tools

Astronomer

Apache Airflow

CI/CD tools

Infrastructure as Code tools (IaC)

Job description

Realign LLC is hiring a Lead Data Engineer with Databricks & DBT experience in Irvine, CA (onsite), with a salary of USD 120,000 per year. In this role, you will lead an enterprise-scale data engineering effort as a Data Engineering Tower/Pod Lead, coordinating onshore, nearshore, and offshore teams to deliver reliable data platforms with strong operational discipline and SLA adherence.

What you’ll own

You will lead and manage the Data Engineering Tower, overseeing multiple teams and delivery pods. This position is responsible for end-to-end data platform delivery, including operational excellence and consistent SLA performance. You will drive scalable pipeline development focused on data quality and platform reliability, while ensuring production support readiness through high availability, monitoring, and alerting practices.

Day to day, you will manage cross-functional dependencies, maintain clear stakeholder communication, and lead issue escalations when needed. You will also collaborate with business, portfolio management, and technology leadership teams to ensure platform governance and delivery align with organizational needs.

As part of operational leadership, you will define and implement best practices across platform governance, operational readiness, and performance optimization to improve stability and reduce delivery risk.

Key responsibilities

• Lead and manage the Data Engineering Tower, overseeing multiple teams and delivery pods
• Own end-to-end data platform delivery, operational excellence, and SLA adherence
• Drive scalable data pipeline development, data quality, and platform reliability
• Manage cross-functional dependencies, stakeholder communication, and issue escalations
• Ensure high availability, monitoring, alerting, and production support readiness
• Collaborate with business, portfolio management, and technology leadership teams
• Define and implement best practices for platform governance, operational readiness, and performance optimization

What you bring

• Strong experience with Databricks, DBT, Apache Spark, and performance tuning
• Expertise in Apache Airflow and Astronomer for workflow orchestration and DAG design
• Deep understanding of data engineering, ETL/ELT, and large-scale data platforms
• Experience with CI/CD, DevOps, Infrastructure as Code (IaC), and automation
• Strong platform management, monitoring, and incident management experienceExcellent leadership and stakeholder management skills

Technologies you’ll use

• Databricks, DBT, Apache Spark
• Performance tuning
• Apache Airflow, Astronomer
• ETL/ELT
• CI/CD, DevOps, Infrastructure as Code (IaC), automation
• Monitoring, incident management

Preferred domain experience

• Asset Management
• Investment Management
• Capital Markets
• Portfolio & Market Data Platforms