Azure Data Solutions Engineer — Databricks & Delta Lake

Powersecure-Inc.; Durham (NC); Hybrid; USD 90,000 - 130,000; Full time

Benefits offered by this job

Medical insurance

401(k) matching

PTO and holidays

Tuition reimbursement

Job summary

PowerSecure is seeking a Data Solutions Engineer to design, build, and operate reliable data pipelines on our Azure data platform. You will collaborate with BI Developers, the Data Architect, and stakeholders to ingest, model, and deliver analytics-ready data using Azure Data Factory, Databricks, and Delta Lake.

The role requires hybrid work in Durham, NC with on-site presence several days per week. The ideal candidate has 2+ years in data engineering, strong SQL and PySpark skills, and

Qualifications

• 2+ years hands-on data engineering or similar software work.
• 2+ years building pipelines on Azure and Databricks.
• Strong SQL, PySpark, and data modeling fundamentals.
• Bachelor's degree in MIS, CS, Engineering or equivalent.
• Proficiency with SQL and Python (PySpark) and performance tuning on large datasets.
• Experience with Azure Databricks, Delta Lake, Delta Live Tables, Azure Data Factory (Fabric Data Pipelines), ADLS Gen2, and CI/CD.
• Knowledge of Unity Catalog or Purview for governance.
• Familiarity with data ingestion patterns (files, APIs, JDBC) and schema evolution.
• Understanding of dimensional modeling for analytics-ready datasets for Power BI.
• Experience with orchestration/monitoring, cost optimization, alerting, runbooks.
• Data pipeline design for batch and streaming; DLT data quality and error handling.
• Source control/CI-CD for data assets.

Responsibilities

• Implement data quality checks (DLT expectations) with alerting and runbooks.
• Build analytics-ready Delta tables using dimensional modeling for BI consumption.
• Implement CDC and deletion-patterns; manage schema drift and partitioning.
• Operate jobs with monitoring, logging, alerting; participate in on-call rotation.
• Collaborate with Data Architect to align with governance, security, and cost standards.
• Document pipelines, data contracts, and SLAs; continuously improve performance and reliability.

Skills

SQL

PySpark

Data Modeling

Python

Databricks

Delta Lake

DLT

Azure Data Factory

CI/CD (Git)

Governance (Purview)

RBAC

Dimensional Modeling

ETL/ELT

Education

Bachelor's degree in MIS/CS/Engineering

Tools

Azure Data Factory

Databricks

Delta Lake

Delta Live Tables

ADLS Gen2

Azure DevOps/Git

Job description

PowerSecure is seeking a Data Solutions Engineer to design, build, and operate reliable data pipelines on our Azure data platform. You will collaborate with BI Developers, the Data Architect, and stakeholders to ingest, model, and deliver analytics-ready data using Azure Data Factory, Databricks, and Delta Lake.

The role requires hybrid work in Durham, NC with on-site presence several days per week. The ideal candidate has 2+ years in data engineering, strong SQL and PySpark skills, and