Azure Data Engineer: Databricks, PySpark & Delta Lake (HIPAA)

Ethereum Technologies; Cupertino (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

Ethereum Technologies is seeking a data engineering professional to build and optimize healthcare-focused data pipelines using Azure Databricks, PySpark, and Delta Lake. You will contribute to a secure Lakehouse architecture while aligning with HIPAA-driven data standards and governance.

The role requires hands-on experience with Azure Data Factory, ADLS Gen2, and enterprise data integration patterns, delivering scalable, compliant data solutions in a fast-paced environment.

Qualifications

• Experience with Azure Databricks and PySpark in data engineering projects.
• Active Databricks Certification is preferred.
• Hands-on knowledge of Azure Data Factory (ADF) and ADLS Gen2.
• Familiarity with Delta Lake and Lakehouse architecture.
• Experience with healthcare data integration and processing.

Responsibilities

• Develop and maintain data pipelines for healthcare data using Databricks, PySpark, and Delta Lake.
• Collaborate with data architects and stakeholders to ensure data quality and security.
• Ensure compliance with HIPAA and healthcare data standards where applicable.

Skills

Azure Databricks

PySpark

Delta Lake

Lakehouse architecture

Healthcare data integration

HIPAA knowledge

Tools

Azure Data Factory (ADF)

ADLS Gen2

Job description

Ethereum Technologies is seeking a data engineering professional to build and optimize healthcare-focused data pipelines using Azure Databricks, PySpark, and Delta Lake. You will contribute to a secure Lakehouse architecture while aligning with HIPAA-driven data standards and governance.

The role requires hands-on experience with Azure Data Factory, ADLS Gen2, and enterprise data integration patterns, delivering scalable, compliant data solutions in a fast-paced environment.