Azure Data Engineer: Lakehouse Pipelines & Secure Governance

Elite WorkForce Inc; Indianapolis (IN); On-site; USD 110,000 - 150,000; Full time

Job summary

Elite WorkForce Inc. seeks a Data Engineer to design, build, and maintain secure, scalable data solutions using Azure Databricks and Azure Synapse Lakehouse.

You will develop batch and streaming pipelines, optimize data warehouse workloads, and implement governance and security controls for PHI/PII compliant data. The role requires collaboration with data architects, scientists, analysts, and PMs to translate business needs into robust technical designs, with emphasis on security, modeling, and

Qualifications

• Master's degree or Bachelor's with 4+ years in data engineering
• Experience with Azure Databricks PySpark and Delta Lake
• Strong knowledge of Azure Synapse (dedicated/serverless)
• Experience with data governance, HIPAA/PHI security
• Proficient in SQL, data modeling, and ETL/ELT pipelines

Responsibilities

• Design, build, and maintain batch and streaming data pipelines in Azure Databricks and Synapse
• Optimize data warehouse workloads for reporting and analytics
• Implement data governance, RBAC, data masking and security controls
• Collaborate with architects, scientists, analysts, and PMs to translate business needs into robust designs

Skills

Azure Databricks

PySpark

Delta Lake

Azure Synapse Analytics

Azure Data Factory

Security & Compliance

Education

Master's degree in data-related field

Bachelor's degree + 4+ years experience

Tools

Azure Databricks

Azure Synapse

GitHub

Azure DevOps

Unity Catalog

Job description

Elite WorkForce Inc. seeks a Data Engineer to design, build, and maintain secure, scalable data solutions using Azure Databricks and Azure Synapse Lakehouse.

You will develop batch and streaming pipelines, optimize data warehouse workloads, and implement governance and security controls for PHI/PII compliant data. The role requires collaboration with data architects, scientists, analysts, and PMs to translate business needs into robust technical designs, with emphasis on security, modeling, and