Azure Data Engineer: Databricks, PySpark & Lakehouse

Artifintech; Cupertino (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Artifintech is seeking a data engineer with hands-on experience in Azure Databricks and PySpark to join our healthcare data platform. The ideal candidate holds an active Databricks certification and is proficient with Azure Data Factory and ADLS Gen2.

You will work on Delta Lake and Lakehouse architecture to integrate and process healthcare data, with HIPAA knowledge preferred. This role offers growth in a dynamic, merit-based environment.

Qualifications

• Hands-on experience with Azure Databricks and PySpark.
• Active Databricks Certification.
• Experience with Azure Data Factory and ADLS Gen2.
• Experience with Delta Lake and Lakehouse architecture.
• Healthcare data integration and processing experience.
• Knowledge of HIPAA and healthcare data standards (preferred).

Skills

Azure Databricks

PySpark

Healthcare data integration

HIPAA knowledge

Education

Databricks Certification

Tools

Azure Data Factory (ADF)

ADLS Gen2

Delta Lake

Lakehouse architecture

Job description

Artifintech is seeking a data engineer with hands-on experience in Azure Databricks and PySpark to join our healthcare data platform. The ideal candidate holds an active Databricks certification and is proficient with Azure Data Factory and ADLS Gen2.

You will work on Delta Lake and Lakehouse architecture to integrate and process healthcare data, with HIPAA knowledge preferred. This role offers growth in a dynamic, merit-based environment.