Azure Data Solutions Engineer — ELT & Delta Lake

Southern Company; Durham (NC); Hybrid; USD 110,000 - 140,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Life insurance

401(k) match

Paid time off

HSA/FSAs

Wellness programs

Employee referrals

Tuition reimbursement

Job summary

PowerSecure, a Southern Company subsidiary, seeks a Data Solutions Engineer to design, build, and operate reliable data pipelines on Azure. You will ingest, model, and deliver analytics-ready data for Power BI using Azure Data Factory, Databricks, and Delta Lake.

You will implement ELT, data quality checks, and governance, collaborate with the Data Architect and BI Developers, and participate in on-call rotation in a hybrid in-office role.

Qualifications

• 2+ years building data pipelines on Azure and Databricks.
• Strong SQL, PySpark, and data modeling fundamentals.
• Experience with CI/CD for data assets and source control.
• Experience with governance tools like Unity Catalog or Purview.
• Authorized to work in the United States without sponsorship.

Responsibilities

• Design, implement, and support end-to-end ELT pipelines (ingest → transform → publish) in Databricks/ADF
• Implement data quality checks (DLT expectations, unit tests) with alerting and remediation runbooks
• Build curated, analytics-ready Delta tables using dimensional modeling for BI consumption
• Implement CDC and deletion-flag patterns; manage schema drift and partitioning/Z‑Ordering strategies
• Operationalize jobs with monitoring, logging, alerting; participate in an on‑call rotation as needed
• Partner with the Data Architect to align designs with governance, security, and cost efficiency
• Document pipelines, data contracts, and SLAs; continuously improve performance and reliability

Skills

SQL

PySpark

Data Modeling

Data Ingestion

ETL/ELT

CI/CD

Python

Cloud: Azure

Communication

Analytical mindset

Education

Bachelor’s degree in MIS, Computer Science, Engineering, or equivalent experience

Tools

Azure Databricks

Delta Lake

Delta Live Tables

Azure Data Factory

ADLS Gen2

Unity Catalog

Purview

Azure DevOps

Git

Job description

PowerSecure, a Southern Company subsidiary, seeks a Data Solutions Engineer to design, build, and operate reliable data pipelines on Azure. You will ingest, model, and deliver analytics-ready data for Power BI using Azure Data Factory, Databricks, and Delta Lake.

You will implement ELT, data quality checks, and governance, collaborate with the Data Architect and BI Developers, and participate in on-call rotation in a hybrid in-office role.