Lead Data Engineer: Azure Lakehouse & Pipelines

United Network For Organ Sharing; Richmond (VA); On-site; USD 140,000 - 190,000; Full time

Job summary

United Network For Organ Sharing is seeking a Senior Data Engineer to lead end-to-end Azure-based data solutions for analytics, reporting, and operations. You will design scalable pipelines, build a Data Lakehouse, and mentor junior engineers while collaborating with data scientists and business stakeholders.

Key duties include implementing secure data pipelines with Azure Data Factory, Databricks, and ADLS Gen2, ensuring data quality, and driving modernization across teams in a fast-paced cloud

Qualifications

• 8+ years in data engineering with enterprise-scale data solutions.
• 2+ years building Azure cloud-native data platforms.
• Strong SQL, Python, and Spark experience in a data lakehouse context.
• Experience with ETL/ELT, data quality, and monitoring frameworks.
• Ability to communicate with data scientists, analysts, and business stakeholders.

Responsibilities

• Architect and implement secure, scalable data pipelines in Azure.
• Lead ETL/ELT design using Azure Data Factory and Databricks.
• Build and maintain Data Lakehouse architectures and Delta Lake structures.
• Ensure data quality, validation, and monitoring across pipelines.
• Mentor junior engineers and lead code reviews for best practices.
• Collaborate with stakeholders to translate requirements into data solutions.
• Support CI/CD for data pipelines using Azure DevOps and Git.

Skills

MS SQL Server

Python (pandas, PySpark)

Azure Data Factory

Azure Functions

Azure Data Lake Storage

Azure Databricks

Spark/Delta Lake

Data Lakehouse

REST APIs

Git / CI/CD

Azure Synapse Analytics

Data governance

Big Data technologies

Education

4-year degree in CS/Engineering or related IT field

Tools

Azure DevOps

Git

Databricks Repos

Azure Synapse

Job description

United Network For Organ Sharing is seeking a Senior Data Engineer to lead end-to-end Azure-based data solutions for analytics, reporting, and operations. You will design scalable pipelines, build a Data Lakehouse, and mentor junior engineers while collaborating with data scientists and business stakeholders.

Key duties include implementing secure data pipelines with Azure Data Factory, Databricks, and ADLS Gen2, ensuring data quality, and driving modernization across teams in a fast-paced cloud