Azure Data Lakehouse Tech Lead

Envision

Indianapolis (IN)

On-site

USD 140,000 - 190,000

Full time

16 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Envision seeks an experienced Data Engineering Tech Lead to design, develop, and maintain scalable data lakehouse architectures on Azure, driving batch and near-real-time processing across enterprise sources. You will enforce governance, implement secure access controls, and mentor teams in data transformation within Healthcare.

You will lead architecture, optimize Spark workloads, and build modular workflows with ADF and Databricks. Strong Python and governance experience are essential.

Qualifications

  • 12+ years of data engineering/IT experience.
  • 5+ years on Azure cloud platform.
  • 4+ years with Azure Databricks and PySpark.
  • 3+ years with Azure Data Factory (ADF).
  • 3+ years with ADLS Gen2.
  • 3+ years with Azure SQL.
  • 2+ years with Databricks Workflows and Unity Catalog governance.
  • 2+ years modular Python programming, package builds, testing (PyTest/unittest).

Responsibilities

  • Design, build, and optimize scalable Lakehouse solutions.
  • Ingest data from ERP platforms, APIs, relational databases, NoSQL stores, and on-prem sources.
  • Optimize Spark jobs and large-scale data processing.
  • Implement data access controls, lineage, audit trails, and security with Unity Catalog.
  • Architect Bronze-Silver-Gold storage on ADLS Gen2 with RBAC/ACLs.
  • Build modular orchestration workflows using ADF and Databricks Workflows.
  • Author HLD/LLD, diagrams, and technical specs.
  • Establish coding standards and code reviews; integrate static analysis tools.
  • Build automated deployment pipelines with Azure DevOps, Git, and IaC.
  • Mentor engineers on design, optimization, and best practices.
  • Identity & CI/CD: Azure AD, GitHub Actions.
  • CDC & Migration: Debezium; Synapse to Databricks migration experience.
  • Multi-Cloud Storage: exposure to GCS.

Skills

Azure Databricks
PySpark
Azure Data Factory
ADLS Gen2
Azure SQL
Databricks Workflows
Unity Catalog governance
Python programming
Spark tuning
Data Governance

Tools

Delta Lake
Unity Catalog

Job description

Envision seeks an experienced Data Engineering Tech Lead to design, develop, and maintain scalable data lakehouse architectures on Azure, driving batch and near-real-time processing across enterprise sources. You will enforce governance, implement secure access controls, and mentor teams in data transformation within Healthcare.

You will lead architecture, optimize Spark workloads, and build modular workflows with ADF and Databricks. Strong Python and governance experience are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer
Azure Data Engineer

Envision • Indianapolis (IN)

On-site
USD 140,000 - 190,000
Azure Data Platform Lead (Databricks/Lakehouse)
Azure Data Platform Lead (Databricks/Lakehouse)

Aroha Technologies, Inc • Greenfield (IN)

On-site
USD 120,000 - 180,000
Azure Data Lake Lead Engineer - Scale Data & Governance
Azure Data Lake Lead Engineer - Scale Data & Governance

Amaze Systems • Houston (TX)

On-site
USD 152,000 - 248,000
Azure Data Platform Lead: Lakehouse & ML Enablement
Azure Data Platform Lead: Lakehouse & ML Enablement

Confidentiel • Pittsburgh

Hybrid
USD 140,000 - 190,000
Azure Data Engineer: Spark Pipelines & Lakehouse
Azure Data Engineer: Spark Pipelines & Lakehouse

Tech Mirrors • Cary (NC)

On-site
USD 96,000 - 152,000
Azure Data Engineer
Azure Data Engineer

Aroha Technologies, Inc • Greenfield (IN)

On-site
USD 120,000 - 180,000
Azure Databricks Data Architect - Lead Lakehouse Solutions
Azure Databricks Data Architect - Lead Lakehouse Solutions

Ascendum Solutions • Cincinnati (OH)

On-site
USD 140,000 - 170,000
Azure Databricks Data Engineer — Lakehouse & Spark Expert
Azure Databricks Data Engineer — Lakehouse & Spark Expert

Quantum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 180,000
Remote Azure Cloud Data Engineer & Architect (Lakehouse)
Remote Azure Cloud Data Engineer & Architect (Lakehouse)

Techtrend • Reston (VA)

Remote
USD 120,000 - 180,000
Life Insurance
Short Term Disability Insurance
Long Term Disability Insurance
+2
Senior Azure Databricks Lakehouse Architect
Senior Azure Databricks Lakehouse Architect

Programmers • Minneapolis (MN)

On-site
USD 120,000 - 170,000