Azure Data Engineer: Delta Lake, Databricks & Pipelines

Powersecure-Inc.; Durham (NC); Hybrid; USD 110,000 - 140,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Life Insurance

401(k) Matching

Vacation & PTO

Flexible Spending Account

Wellness Program

Employee Referral

Job summary

PowerSecure is seeking a Data Engineer to design, build, and operate reliable data pipelines on Azure for trusted analytics and self-service BI. You will partner with BI Developers, the Data Architect, and stakeholders to ingest, model, and deliver high‑quality data using Azure Data Factory, Databricks, and Delta Lake, including DLT and ADLS Gen2.

The role emphasizes batch/stream ingestion, ELT, orchestration, data quality, and operational support in a hybrid on-site setting with

Qualifications

• 2+ years hands-on data engineering or equivalent software work
• 2+ years building pipelines on Azure and Databricks
• Strong SQL, PySpark, and data modeling fundamentals
• Bachelor’s degree in MIS, CS, Eng or equivalent
• Proficiency with SQL and Python (PySpark) and large datasets
• Experience with Azure Databricks, Delta Lake, and DLT
• Governance, lineage and security awareness
• Familiar with data ingestion patterns and schema evolution
• Understanding dimensional modeling for analytics-ready datasets
• Exposure to orchestration, monitoring, and cost optimization
• Source control and CI/CD for data assets
• Awareness of privacy, security, RBAC in cloud data platforms
• Excellent written and verbal communication, cross-functional collaboration
• Applicants must be authorized to work in the United States without visa sponsorship

Responsibilities

• Implement data quality checks with alerting and remediation runbooks
• Build analytics-ready Delta tables using dimensional modeling for BI consumption
• Implement CDC and deletion-flag patterns; manage schema drift and partitioning
• Operationalize jobs with monitoring, logging, and alerting; participate in on-call rotation
• Collaborate with Data Architect to align designs with governance, security, and cost standards
• Document pipelines, data contracts, and SLAs; continuously improve performance and reliability

Skills

Azure Data Factory

Databricks

Delta Lake

PySpark

SQL

Python

Data Modeling

CI/CD

Azure DevOps

Data Governance

Batch/Stream Processing

Power BI

Communication

Education

Bachelor’s degree in MIS, CS, Engineering

Tools

Azure Data Factory

Databricks (PySpark/Spark SQL)

Delta Lake

Delta Live Tables

ADLS Gen2

Azure DevOps/Git

Purview/Unity Catalog

Job description

PowerSecure is seeking a Data Engineer to design, build, and operate reliable data pipelines on Azure for trusted analytics and self-service BI. You will partner with BI Developers, the Data Architect, and stakeholders to ingest, model, and deliver high‑quality data using Azure Data Factory, Databricks, and Delta Lake, including DLT and ADLS Gen2.

The role emphasizes batch/stream ingestion, ELT, orchestration, data quality, and operational support in a hybrid on-site setting with