Senior Data Engineer — Cloud Data Platforms & DataOps

Blue Shield of CA; Chicago (IL); On-site; USD 150,000 - 190,000; Full time

Job summary

Blue Shield of CA in Chicago seeks a senior Data Engineer, Consultant to lead end-to-end data engineering initiatives across cloud platforms, delivering scalable, secure data products for the enterprise.

The role partners with Solution Design Leads, Architects, Product Managers, and stakeholders to translate designs into production-ready data assets; you will drive CI/CD, DataOps, and secure architectures while navigating regulatory requirements.

Qualifications

• Requires a bachelor's degree or equivalent experience.
• Requires a minimum of 7 years of data engineering experience.
• Advanced hands-on expertise in SQL, including automation and pipeline optimization.
• Strong experience with cloud platforms (Azure preferred) and services such as ADLS, Synapse, and Data Factory.
• Extensive experience with modern data platforms including Snowflake, Databricks, and orchestration tools such as Airflow or Tidal.
• Deep understanding of data modeling, integration patterns, data architecture, data quality, and data warehousing.
• Proven experience implementing CI/CD pipelines, Infrastructure as Code, and DataOps practices.
• Strong understanding of security, privacy, and compliance requirements in regulated environments.
• Experience working with largescale, distributed data platforms and parallel processing architecture.
• Excellent communication and stakeholder engagement skills.
• Proven ability to lead technically without formal people management responsibility.
• Preferred: Healthcare industry experience, including exposure to Epic or similar ecosystems.

Responsibilities

• Lead end-to-end delivery of complex data engineering solutions across cloud data platforms.
• Translate solution designs and business requirements into scalable, secure data products.
• Collaborate with Solution Design Leads, Architects, Product Managers, and stakeholders.
• Drive CI/CD, IaC, and DataOps practices across teams.
• Ensure data security, privacy, and regulatory compliance in enterprise environments.

Skills

SQL advanced

Cloud platforms

Azure

Data modeling

Data governance

CI/CD

DataOps

Security/compliance

Leadership

Communication

Epic/Healthcare systems

Education

Bachelor's degree or equivalent experience

Tools

Azure Synapse

Azure Data Lake Storage (ADLS)

Azure Data Factory

Snowflake

Databricks

Airflow

Tidal

Job description

Blue Shield of CA in Chicago seeks a senior Data Engineer, Consultant to lead end-to-end data engineering initiatives across cloud platforms, delivering scalable, secure data products for the enterprise.

The role partners with Solution Design Leads, Architects, Product Managers, and stakeholders to translate designs into production-ready data assets; you will drive CI/CD, DataOps, and secure architectures while navigating regulatory requirements.