Principal Data Engineer: Cloud Data Lake & Warehouse Leader

Blue Shield of CA; New York (NY); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Blue Shield of California is seeking a Principal Data Engineer to lead end-to-end data solutions and data product delivery for the enterprise. You will design cloud data lakes, data warehouses, and data marts while partnering with architects, analytics, and data teams to meet strategic data needs.

This role emphasizes leadership, mentoring, and driving data architecture decisions, with a strong focus on AI/ML concepts and scalable data platforms in a regulated healthcare environment.

Qualifications

• Requires a bachelor's degree or equivalent experience.
• Requires a minimum of 10 years of relevant data engineering experience.
• Experience supporting enterprise AI/ML, advanced analytics, and data product ecosystems.
• Expertise in Data Vault 2.0, dimensional modeling, Lakehouse architecture, or domain-driven data design.
• Demonstrated ability to influence enterprise architecture decisions and mentor senior engineering talent.
• Expert in understanding data management practices, data modelling (data vault 2.0), master data management, data integration, data architecture, data virtualization, data warehousing, data privacy and security.
• Demonstrated enthusiasm for AI and emerging technologies, with solid understanding of AI/ML concepts and hands‑on experience applying AI‑driven solutions in enterprise environments.
• Hands on experience with SQL, Python, DBT Cloud and DBT core. Expert in one or more of NoSQL and database appliances and platforms (Snowflake, Synapse, Databricks)
• Proven ability to design and scale large‑volume, high‑performance data platforms leveraging parallel and distributed architectures.
• Advanced knowledge of CI/CD, source control, and agile delivery tooling (e.g., Git, Bitbucket, Jira).
• Experience in healthcare, regulated environments, or large enterprises is strongly preferred.

Skills

Data Vault 2.0

Dimensional Modeling

Lakehouse Architecture

Domain-driven Data Design

SQL

Python

DBT Cloud

DBT Core

NoSQL

Snowflake

Synapse

Databricks

CI/CD

Git

Bitbucket

Jira

Data Integration

Data Warehousing

Data Privacy and Security

AI/ML concepts

Enterprise Architecture

Mentoring

Education

Bachelor's degree or equivalent experience

Tools

SQL

Job description

Blue Shield of California is seeking a Principal Data Engineer to lead end-to-end data solutions and data product delivery for the enterprise. You will design cloud data lakes, data warehouses, and data marts while partnering with architects, analytics, and data teams to meet strategic data needs.

This role emphasizes leadership, mentoring, and driving data architecture decisions, with a strong focus on AI/ML concepts and scalable data platforms in a regulated healthcare environment.