Senior Data Engineer, Azure Lakehouse & Databricks

Cbcal; Irvine (CA); Hybrid; USD 135,000 - 170,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k) with match

FSA & Dependent Care

EAP

Calm subscription

Teladoc mental health benefits

Life Insurance

Paid time off

Job summary

Commercial Bank of California is seeking a Senior Data Engineer to design, build, and operate scalable, secure data platforms across the Azure ecosystem, including Microsoft Fabric, Azure Databricks, and lakehouse architectures.

With 7–10+ years of hands-on experience, you will own end‑to‑end data pipelines, data models, and analytical data stores, while partnering with BI, analytics, AI, and business stakeholders to enable data‑driven decisions.

Qualifications

• 7-10+ years of professional experience in data engineering, data platform development, or analytics engineering.
• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
• Deep hands-on experience with: Microsoft Fabric (Lakehouse, Data Pipelines, OneLake, Semantic Models), Data modeling for analytics and BI, Power BI, and the data/analytics stack (Fabric, Azure Data Lake, Synapse, Power BI, Purview, Entra ID).
• Databricks expertise (Unity Catalog, Delta Live Tables / Lakeflow, Databricks Workflows, cluster and cost optimization).
• Advanced proficiency in SQL and strong experience with Python or Spark-based development.

Responsibilities

• Design, build, and maintain enterprise-grade data platforms using Microsoft Fabric, Azure Data Lake, Azure Synapse, and Azure Databricks.
• Architect and implement lakehouse and medallion architectures (Bronze/Silver/Gold) to support analytics and BI workloads.
• Define standards for data ingestion, transformation, storage, and access across structured and semi-structured data sources.
• Plan and execute Databricks-to-Fabric migrations, including workload assessment, Delta/OneLake data movement, notebook and pipeline conversion, semantic model re-pointing, validation, and cutover.
• Develop and optimize batch and streaming data pipelines using Databricks, Fabric Data Pipelines, and Azure-native services.
• Implement robust ETL/ELT processes, ensuring data quality, accuracy, and consistency across systems.
• Monitor, tune, and optimize data pipelines for performance, scalability, and cost efficiency.
• Integrate and model data from FIS core banking and H360 systems into the lakehouse for analytics and reporting.
• Build and support data pipelines for payments data (ACH, wire, card, real-time payments), including ingestion, reconciliation, and reporting.

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field

Tools

Microsoft Fabric

Azure Data Lake

Azure Synapse

Azure Databricks

Databricks Unity Catalog

Power BI

SQL

Python

Spark

Job description

Commercial Bank of California is seeking a Senior Data Engineer to design, build, and operate scalable, secure data platforms across the Azure ecosystem, including Microsoft Fabric, Azure Databricks, and lakehouse architectures.

With 7–10+ years of hands-on experience, you will own end‑to‑end data pipelines, data models, and analytical data stores, while partnering with BI, analytics, AI, and business stakeholders to enable data‑driven decisions.