Senior Data Engineer — Cloud Pipelines & Data Solutions

Blue Shield of California; California (MO); Hybrid; USD 123,000 - 185,000; Full time

Job summary

Blue Shield of California is seeking a Senior Data Engineer to lead end-to-end data pipeline design and implementation across cloud platforms. You will translate business requirements into scalable architectures, build secure data solutions, and mentor junior engineers.

The role emphasizes data modeling, CI/CD, and DataOps within a DevSecOps, agile environment. Collaboration with stakeholders and partner teams is essential for delivering AI/ML-ready data products.

Qualifications

• Bachelor's degree or equivalent experience.
• 7+ years of data engineering experience.
• Advanced SQL with automation and pipeline optimization.
• Strong experience with cloud data platforms (Azure preferred) incl. ADLS, Synapse and Data Factory.
• Extensive experience with modern data platforms (Snowflake, Databricks) and orchestration tools (Airflow or Tidal).
• Deep understanding of data modeling, integration patterns, data architecture, data quality, and data warehousing.
• Proven experience implementing CI/CD, IaC, and DataOps.
• Strong understanding of security, privacy, and compliance in regulated environments.
• Experience with large-scale distributed data platforms and parallel processing.
• Excellent communication and stakeholder engagement skills.
• Proven ability to lead technically without formal people management responsibility.
• Healthcare industry experience including Epic exposure preferred.

Responsibilities

• Lead the design and implementation of complex data pipelines and data products from development through production.
• Translate designs and business requirements into detailed technical architecture and implementation plans.
• Architect and build scalable, secure data solutions across enterprise platforms.
• Apply advanced data modeling techniques (Data Vault 2.0, dimensional, and domain models).
• Embed data quality, testing, security, and observability by design across pipelines.
• Drive operational excellence: incident analysis, stabilization, performance tuning, deployment optimization.
• Identify optimization opportunities for performance, reliability, and cloud cost management.
• Influence and evolve data engineering standards, patterns, and frameworks.
• Provide technical leadership and mentorship to Data Engineers and Senior Data Engineers.
• Work within an Agile / DevSecOps pod model with solution leads and business partners.
• Support integration of AI/ML-ready datasets by ensuring data is well-modeled and governed.
• Communicate complex concepts clearly to technical and non-technical stakeholders.

Skills

SQL

Cloud platforms (Azure)

ADLS

Synapse

Data Factory

Snowflake

Databricks

Airflow

Tidal

CI/CD

Data modeling

Data governance

Security & compliance

Stakeholder communication

Technical leadership

Epic exposure

Education

Bachelor's degree or equivalent experience

Tools

Airflow

Tidal

Databricks

Snowflake

Azure Data Factory

Azure Synapse

Azure Data Lake Storage (ADLS)

Job description

Blue Shield of California is seeking a Senior Data Engineer to lead end-to-end data pipeline design and implementation across cloud platforms. You will translate business requirements into scalable architectures, build secure data solutions, and mentor junior engineers.

The role emphasizes data modeling, CI/CD, and DataOps within a DevSecOps, agile environment. Collaboration with stakeholders and partner teams is essential for delivering AI/ML-ready data products.