Senior Data Engineer, Cloud Data Solutions Lead

Blue Shield of CA; Oakland (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Blue Shield of California's Data Services team seeks a Data Engineer, Consultant to drive end-to-end delivery of complex data‑driven solutions and data products for the enterprise. You will translate designs and requirements into scalable, secure pipelines and lead technical work across cloud data platforms.

With 7+ years of data engineering experience, you will work with Snowflake, Databricks, Airflow/Tidal, Azure data services, and CI/CD/ IaC practices while ensuring data quality, governance,

Qualifications

• Bachelor's degree or equivalent required.
• 7+ years of data engineering experience.
• Advanced hands-on SQL with automation and pipeline optimization.
• Experience with Azure-based cloud services (ADLS, Synapse, Data Factory).
• Experience with Snowflake, Databricks, and orchestration tools (Airflow, Tidal).
• Strong data modeling, integration patterns, data architecture, data quality, and data warehousing.
• Proven experience implementing CI/CD pipelines, Infrastructure as Code, DataOps practices.
• Strong understanding of security, privacy, and compliance in regulated environments.
• Experience with largescale, distributed data platforms and parallel processing architecture.
• Excellent communication and stakeholder engagement skills.
• Proven ability to lead technically without formal people management.
• Preferred: Healthcare industry experience including Epic exposure.

Responsibilities

• Lead end-to-end delivery of complex data engineering solutions across cloud platforms.
• Translate solution designs and business requirements into scalable, secure data products.
• Collaborate with Solution Design Leads, Architects, Product Managers, and stakeholders.
• Drive data architecture, quality, and governance across large datasets and pipelines.

Skills

SQL

Cloud platforms

Snowflake

Databricks

Airflow

Tidal

Data modeling

CI/CD

Infrastructure as Code

DataOps

Security & Compliance

Communication

Technical leadership

Epic exposure

Education

Bachelor's degree or equivalent

Tools

Azure ADLS

Azure Synapse

Azure Data Factory

Azure Data Lake Storage

Snowflake

Databricks

Airflow

Tidal

CI/CD pipelines

Job description

Blue Shield of California's Data Services team seeks a Data Engineer, Consultant to drive end-to-end delivery of complex data‑driven solutions and data products for the enterprise. You will translate designs and requirements into scalable, secure pipelines and lead technical work across cloud data platforms.

With 7+ years of data engineering experience, you will work with Snowflake, Databricks, Airflow/Tidal, Azure data services, and CI/CD/ IaC practices while ensuring data quality, governance,