Azure Data Engineer - Databricks, PySpark & Healthcare Data

Valiant Technologies LLC; Cupertino (CA); On-site; USD 120,000 - 170,000; Full time

Job summary

Valiant Technologies LLC seeks a data engineering professional with hands-on experience in Azure Databricks, PySpark, and Delta Lake to build scalable healthcare data pipelines. The role focuses on robust data integration and secure processing in cloud environments.

You will work with Azure Data Factory, ADLS Gen2, and Lakehouse architecture while ensuring HIPAA-compliant data handling and governance. Certification in Databricks is highly valued, and collaboration with analytics teams is

Qualifications

• Hands-on experience with Azure Databricks and PySpark.
• Active Databricks Certification is preferred.
• Experience with Azure Data Factory and ADLS Gen2.
• Delta Lake and Lakehouse architecture knowledge.
• Healthcare data integration experience and HIPAA familiarity preferred.

Skills

Azure Databricks

PySpark

Delta Lake

Lakehouse architecture

Healthcare data integration

HIPAA knowledge

Azure Data Factory

ADLS Gen2

Databricks Certification

Job description

Valiant Technologies LLC seeks a data engineering professional with hands-on experience in Azure Databricks, PySpark, and Delta Lake to build scalable healthcare data pipelines. The role focuses on robust data integration and secure processing in cloud environments.

You will work with Azure Data Factory, ADLS Gen2, and Lakehouse architecture while ensuring HIPAA-compliant data handling and governance. Certification in Databricks is highly valued, and collaboration with analytics teams is