Azure Data Engineer

Ethereum Technologies LLC; Cupertino (CA); In loco; USD 120.000 - 180.000; Tempo pieno

Descrizione del lavoro

Ethereum Technologies is seeking a data engineering professional to build and optimize healthcare-focused data pipelines using Azure Databricks, PySpark, and Delta Lake. You will contribute to a secure Lakehouse architecture while aligning with HIPAA-driven data standards and governance.

The role requires hands-on experience with Azure Data Factory, ADLS Gen2, and enterprise data integration patterns, delivering scalable, compliant data solutions in a fast-paced environment.

Competenze

• Experience with Azure Databricks and PySpark in data engineering projects.
• Active Databricks Certification is preferred.
• Hands-on knowledge of Azure Data Factory (ADF) and ADLS Gen2.
• Familiarity with Delta Lake and Lakehouse architecture.
• Experience with healthcare data integration and processing.

Mansioni

• Develop and maintain data pipelines for healthcare data using Databricks, PySpark, and Delta Lake.
• Collaborate with data architects and stakeholders to ensure data quality and security.
• Ensure compliance with HIPAA and healthcare data standards where applicable.

Conoscenze

Azure Databricks

PySpark

Delta Lake

Lakehouse architecture

Healthcare data integration

HIPAA knowledge

Strumenti

Azure Data Factory (ADF)

ADLS Gen2

Descrizione del lavoro

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

Required Skills:

• Hands-on experience with Azure Databricks and PySpark.
• Active Databricks Certification.
• Azure Data Factory (ADF) and ADLS Gen2.
• Delta Lake and Lakehouse architecture.
• Healthcare data integration and processing.
• Knowledge of HIPAA and healthcare data standards is preferred.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.