Senior Data Engineer (Healthcare)

Confidential Careers; California (MO); Hybrid; USD 160,000 - 210,000; Full time

Job summary

Confidential Careers seeks a Senior Data Engineer to design and deliver scalable data pipelines for healthcare AI platforms in the Bay Area. You will work across cloud-based data solutions, data warehouses, and data lakes, partnering with cross-functional teams to enable analytics, data science, and ML initiatives.

The role emphasizes ownership, collaboration, and delivering production-ready data platforms in a multi-cloud, agile environment.

Qualifications

• Bachelor’s degree in engineering, computer science, or related field.
• 5+ years of software development experience.
• 3+ years of healthcare environment experience.
• Strong data engineering across ETL, data warehouses, data lakes, and analytics.
• Strong Python and SQL skills with SQL optimization in cloud environments.
• Experience with REST APIs and microservices.
• Experience with Linux environments and cloud computing.
• Ability to work across multi-cloud environments.
• Strong initiative and problem-solving skills.

Responsibilities

• Design, build, and optimize scalable data engineering solutions and production data pipelines.
• Develop modern cloud-based data solutions using Databricks, AWS Redshift, and Azure Synapse.
• Build data infrastructure supporting analytics, data science, and machine learning initiatives.
• Work with healthcare data across ETL, data warehouses, data lakes, and analytics environments.
• Partner with public- and private-sector clients on healthcare initiatives.
• Contribute to architecture, technical strategy, project planning, and product decisions.
• Apply Agile development and CI/CD practices to deliver production-ready solutions.
• Introduce new technologies, tools, and approaches to improve scalability, quality, and engineering effectiveness.

Skills

Python

SQL

ETL

Data Warehouses

Data Lakes

Analytics

REST APIs

Microservices

Linux

Multi-cloud

CI/CD

Databricks

AWS Redshift

Azure Synapse

Education

Bachelor’s degree in Engineering or Computer Science

Master’s degree (nice to have)

Tools

Databricks

AWS Redshift

Azure Synapse

dbt

Great Expectations

Deequ

Job description

Senior Data Engineer | Healthcare AI & Data Platforms

Bay Area, CA – Hybrid | Remote may be considered

Candidates must meet applicable U.S. government employment eligibility requirements, including U.S. citizenship and security-clearance criteria where required.

We’re partnering with an innovative healthcare technology organization to find an experienced Senior Data Engineer who wants to use data and technology to solve meaningful, real-world healthcare challenges.

This is an opportunity to join a highly collaborative team working at the intersection of healthcare, data engineering, cloud technology, and AI. You’ll work alongside engineers, data scientists, product leaders, clinical experts, and client teams to build scalable data solutions that help improve healthcare operations and outcomes.

What You’ll Do:

You’ll have significant ownership and visibility, helping shape data strategy while designing and delivering production-ready solutions.

In this role, you will:

• Design, build, and optimize scalable data engineering solutions and production data pipelines
• Develop modern cloud-based data solutions using technologies such as Databricks, AWS Redshift, and Azure Synapse
• Build data infrastructure supporting advanced analytics, data science, and machine learning initiatives
• Work with complex healthcare data across ETL, data warehouses, data lakes, and analytics environments
• Partner with both public-sector and private-sector clients on high-impact healthcare initiatives
• Contribute to architecture, technical strategy, project planning, and product decisions
• Apply Agile development and CI/CD practices to deliver reliable, production-ready solutions
• Introduce new technologies, tools, and approaches that improve scalability, quality, and engineering effectiveness

What We’re Looking For:

We’re looking for an experienced data engineer who combines strong technical depth with curiosity, ownership, and the ability to operate effectively in a fast-moving environment.

Required experience includes:

• Bachelor’s degree in engineering, computer science, or a related discipline; master’s degree is a plus
• 5+ years of software development experience
• 3+ years of experience working in a healthcare environment
• Strong data engineering experience across ETL, data warehouses, data lakes, and analytics
• Strong Python and SQL skills, including SQL optimization in cloud environments
• Experience with REST APIs and microservices
• Experience with Linux environments and cloud computing
• Ability to work effectively across multi-cloud environments
• Strong initiative, independent decision-making, and problem-solving skills

Nice to Have:

Experience with any of the following would be valuable:

• dbt, Great Expectations, Deequ, or similar data-quality technologies
• Big Data platforms in healthcare
• NoSQL and alternative data-storage technologies
• Serverless data processing and machine learning solutions
• Pega, PowerApps, or workflow-management platforms
• Java, C++, Scala, or other programming languages
• ML pipeline development and CI/CD

Why This Opportunity?

This role offers the chance to work on technically challenging problems where the results have a meaningful impact on healthcare. You’ll join a multidisciplinary team, have room to influence technical direction, and help build modern data platforms supporting sophisticated analytics and AI.

The environment is fast-paced and entrepreneurial, so it’s particularly well suited to someone who enjoys ownership, autonomy, collaboration, and solving complex problems without a rigid playbook.

Important:

This position supports U.S. government-related work. Candidates must meet applicable U.S. government employment eligibility requirements, including U.S. citizenship and security-clearance criteria where required.