Data Engineer, Consultant

Blue Shield of CA; Oakland (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Blue Shield of California's Data Services team seeks a Data Engineer, Consultant to drive end-to-end delivery of complex data‑driven solutions and data products for the enterprise. You will translate designs and requirements into scalable, secure pipelines and lead technical work across cloud data platforms.

With 7+ years of data engineering experience, you will work with Snowflake, Databricks, Airflow/Tidal, Azure data services, and CI/CD/ IaC practices while ensuring data quality, governance,

Qualifications

• Bachelor's degree or equivalent required.
• 7+ years of data engineering experience.
• Advanced hands-on SQL with automation and pipeline optimization.
• Experience with Azure-based cloud services (ADLS, Synapse, Data Factory).
• Experience with Snowflake, Databricks, and orchestration tools (Airflow, Tidal).
• Strong data modeling, integration patterns, data architecture, data quality, and data warehousing.
• Proven experience implementing CI/CD pipelines, Infrastructure as Code, DataOps practices.
• Strong understanding of security, privacy, and compliance in regulated environments.
• Experience with largescale, distributed data platforms and parallel processing architecture.
• Excellent communication and stakeholder engagement skills.
• Proven ability to lead technically without formal people management.
• Preferred: Healthcare industry experience including Epic exposure.

Responsibilities

• Lead end-to-end delivery of complex data engineering solutions across cloud platforms.
• Translate solution designs and business requirements into scalable, secure data products.
• Collaborate with Solution Design Leads, Architects, Product Managers, and stakeholders.
• Drive data architecture, quality, and governance across large datasets and pipelines.

Skills

SQL

Cloud platforms

Snowflake

Databricks

Airflow

Tidal

Data modeling

CI/CD

Infrastructure as Code

DataOps

Security & Compliance

Communication

Technical leadership

Epic exposure

Education

Bachelor's degree or equivalent

Tools

Azure ADLS

Azure Synapse

Azure Data Factory

Azure Data Lake Storage

Snowflake

Databricks

Airflow

Tidal

CI/CD pipelines

Job description

Your Role

The Data Services team is responsible for technical design and end-to-end delivery of complex data‑driven solutions and data products for the enterprise. The Data Engineer, Consultant will report to the Sr Manager, Data Solutions / Manager. This role serves as a senior individual contributor and technical leader, responsible for driving end-to-end delivery of complex data engineering solutions across cloud data platforms. The DEC partners closely with Solution Design Leads, Architects, Product Managers, and business stakeholders to translate solution designs and business requirements into scalable, secure, and production‑ready data products.

Our leadership model is about developing great leaders at all levels and creating opportunities for our people to grow - personally, professionally, and financially. We are looking for leaders that are energized by creative and critical thinking, building and sustaining high-performing teams, getting results the right way, and fostering continuous learning.

Your Knowledge and Experience

• Requires a bachelor's degree or equivalent experience.
• Requires a minimum of 7 years of data engineering experience.
• Advanced handson expertise in SQL, including automation and pipeline optimization.
• Strong experience with cloud platforms (Azure preferred) and services such as ADLS, Synapse, and Data Factory.
• Extensive experience with modern data platforms including Snowflake, Databricks, and orchestration tools such as Airflow or Tidal.
• Deep understanding of data modeling, integration patterns, data architecture, data quality, and data warehousing.
• Proven experience implementing CI/CD pipelines, Infrastructure as Code, and DataOps practices.
• Strong understanding of security, privacy, and compliance requirements in regulated environments.
• Experience working with largescale, distributed data platforms and parallel processing architecture.
• Excellent communication and stakeholder engagement skills.
• Proven ability to lead technically without formal people management responsibility.
• Preferred: Healthcare industry experience, including exposure to Epic or similar ecosystems.