Azure Data Solutions Engineer - Databricks & Delta Lake

Powersecure-Inc.; Durham (NC); Hybrid; USD 110,000 - 150,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Life insurance

401(k) matching

Vacation & PTO

Flexible spending accounts

Wellness programs

Employee referrals

Tuition reimbursement

Job summary

PowerSecure data solutions team is seeking a Data Solutions Engineer to design, build, and operate reliable data pipelines on our Azure platform in a hybrid Durham, NC environment. You will work with BI Developers, the Data Architect, and business stakeholders to ingest, model, and deliver analytics-ready data using Azure Data Factory, Databricks, and Delta Lake.

The role emphasizes batch and streaming ingestion, ELT transformations, data quality, governance, and cost‑aware operations, with

Qualifications

• 2+ years of hands-on data engineering or related software work.
• Experience building pipelines on Azure and Databricks with Spark.
• Strong SQL, PySpark, and data modeling fundamentals.
• Bachelor's degree in MIS, CS, Engineering, or equivalent.
• Proficiency in SQL and Python, including large dataset tuning.
• Experience with governance, RBAC, and cloud data security basics.

Responsibilities

• Implement data quality checks (DLT) with alerting and runbooks.
• Build analytics-ready Delta tables using dimensional modeling.
• Implement CDC and schema drift handling; manage partitioning.
• Operate jobs with monitoring, logging, and on-call participation.
• Collaborate with Data Architect to align governance and cost goals.
• Document pipelines, data contracts, and SLAs; drive reliability.

Skills

SQL

PySpark

Data Modeling

Python

ETL

CI/CD for data

Communication

Azure data platforms

Education

Bachelor's degree (MIS/CS/Engineering)

Tools

Azure Databricks

Delta Lake

Azure Data Factory

Delta Live Tables

ADLS Gen2

Git

Job description

PowerSecure data solutions team is seeking a Data Solutions Engineer to design, build, and operate reliable data pipelines on our Azure platform in a hybrid Durham, NC environment. You will work with BI Developers, the Data Architect, and business stakeholders to ingest, model, and deliver analytics-ready data using Azure Data Factory, Databricks, and Delta Lake.

The role emphasizes batch and streaming ingestion, ELT transformations, data quality, governance, and cost‑aware operations, with