On-site Azure Data Solutions Engineer — Pipelines & Analytics

Powersecure; Durham, Northern (NC, KY); Hybrid; USD 100,000 - 140,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Vacation

Flexible spending accounts

Wellness program

Employee referral program

Tuition reimbursement

Job summary

PowerSecure, a Southern Company subsidiary, is seeking a Data Solutions Engineer to design, build, and operate reliable data pipelines on the Azure data platform. The role collaborates with BI developers, the Data Architect, and business stakeholders to ingest, model, and deliver analytics-ready data using Azure Data Factory, Databricks, and Delta Lake.

The ideal candidate has 2+ years of hands-on data engineering with Azure and Databricks, strong SQL, Python (PySpark), and experience with

Qualifications

• 2+ years of hands‑on data engineering (or comparable software engineering with significant data work)
• 2+ years building pipelines on Azure and Databricks (or equivalent cloud + Spark)
• Strong SQL (analytical queries, window functions), PySpark/Spark SQL, and data modeling fundamentals
• Bachelor’s degree in MIS, Computer Science, Engineering, or equivalent experience
• Proficiency with SQL and Python (PySpark), including performance tuning on large datasets
• Experience with Azure Databricks, Delta Lake, Delta Live Tables (DLT), Azure Data Factory (or Fabric Data Pipelines), ADLS Gen2, and Azure DevOps/Git for CI/CD
• Working knowledge of Unity Catalog and/or Microsoft Purview for governance, lineage, and security
• Familiarity with data ingestion patterns (files, APIs, JDBC), schema evolution, CDC, and deletion detection patterns
• Understanding of dimensional modeling to produce analytics‑ready datasets for Power BI
• Exposure to orchestration/monitoring, cost optimization, alerting, and runbook‑driven operations

Responsibilities

• Implement data quality checks (DLT expectations, unit tests) with alerting and remediation runbooks
• Build curated, analytics‑ready Delta tables using dimensional modeling for consumption by BI Developers
• Implement CDC and deletion‑flag patterns; manage schema drift and partitioning/Z‑Ordering strategies
• Operationalize jobs with monitoring, logging, alerting; participate in an on‑call rotation as needed
• Partner with the Data Architect to align designs with standards for governance, security, and cost efficiency
• Document pipelines, data contracts, and SLAs; continuously improve performance and reliability

Skills

SQL

PySpark

Data modeling

Python

Communication

Education

Bachelor's degree in MIS/CS/Engineering

Tools

Azure Data Factory

Databricks

Delta Lake

Delta Live Tables

ADLS Gen2

Azure DevOps/Git

Unity Catalog/Purview

Job description

PowerSecure, a Southern Company subsidiary, is seeking a Data Solutions Engineer to design, build, and operate reliable data pipelines on the Azure data platform. The role collaborates with BI developers, the Data Architect, and business stakeholders to ingest, model, and deliver analytics-ready data using Azure Data Factory, Databricks, and Delta Lake.

The ideal candidate has 2+ years of hands-on data engineering with Azure and Databricks, strong SQL, Python (PySpark), and experience with