Data Engineer - HYBRID/NC RESIDENTS ONLY

Powersecure-Inc.; Durham (NC); Hybrid; USD 110,000 - 140,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Life Insurance

401(k) Matching

Vacation & PTO

Flexible Spending Account

Wellness Program

Employee Referral

Job summary

PowerSecure is seeking a Data Engineer to design, build, and operate reliable data pipelines on Azure for trusted analytics and self-service BI. You will partner with BI Developers, the Data Architect, and stakeholders to ingest, model, and deliver high‑quality data using Azure Data Factory, Databricks, and Delta Lake, including DLT and ADLS Gen2.

The role emphasizes batch/stream ingestion, ELT, orchestration, data quality, and operational support in a hybrid on-site setting with

Qualifications

• 2+ years hands-on data engineering or equivalent software work
• 2+ years building pipelines on Azure and Databricks
• Strong SQL, PySpark, and data modeling fundamentals
• Bachelor’s degree in MIS, CS, Eng or equivalent
• Proficiency with SQL and Python (PySpark) and large datasets
• Experience with Azure Databricks, Delta Lake, and DLT
• Governance, lineage and security awareness
• Familiar with data ingestion patterns and schema evolution
• Understanding dimensional modeling for analytics-ready datasets
• Exposure to orchestration, monitoring, and cost optimization
• Source control and CI/CD for data assets
• Awareness of privacy, security, RBAC in cloud data platforms
• Excellent written and verbal communication, cross-functional collaboration
• Applicants must be authorized to work in the United States without visa sponsorship

Responsibilities

• Implement data quality checks with alerting and remediation runbooks
• Build analytics-ready Delta tables using dimensional modeling for BI consumption
• Implement CDC and deletion-flag patterns; manage schema drift and partitioning
• Operationalize jobs with monitoring, logging, and alerting; participate in on-call rotation
• Collaborate with Data Architect to align designs with governance, security, and cost standards
• Document pipelines, data contracts, and SLAs; continuously improve performance and reliability

Skills

Azure Data Factory

Databricks

Delta Lake

PySpark

SQL

Python

Data Modeling

CI/CD

Azure DevOps

Data Governance

Batch/Stream Processing

Power BI

Communication

Education

Bachelor’s degree in MIS, CS, Engineering

Tools

Azure Data Factory

Databricks (PySpark/Spark SQL)

Delta Lake

Delta Live Tables

ADLS Gen2

Azure DevOps/Git

Purview/Unity Catalog

Job description

The Data Engineer designs, builds, and operates reliable, scalable data pipelines on PowerSecure’s Azure data platform to enable trusted analytics and self‑service BI. This role partners with BI Developers, the Data Architect, and business stakeholders to ingest, model, and deliver high‑quality data using Azure Data Factory, Databricks (PySpark/Spark SQL), and Delta Lake (including Delta Live Tables). Responsibilities include batch/stream ingestion, data transformation (ELT), orchestration, data quality enforcement, and operational support.

Minimum Qualifications: (Education, Experience, Knowledge, and Skills):

• 2+ years of hands‑on data engineering (or comparable software engineering with significant
  data work)
• 2+ years building pipelines on Azure and Databricks (or equivalent cloud + Spark)
• Strong SQL (analytical queries, window functions), PySpark/Spark SQL, and data modeling fundamentals
• Bachelor’s degree in MIS, Computer Science, Engineering, or equivalent experience
• Proficiency with SQL and Python (PySpark), including performance tuning on large datasets
• Experience with Azure Databricks, Delta Lake, Delta Live Tables (DLT), Azure Data Factory (or Fabric Data Pipelines), ADLS Gen2, and Azure DevOps/Git for CI/CD
• Working knowledge of Unity Catalog and/or Microsoft Purview for governance, lineage, and security
• Familiarity with data ingestion patterns (files, APIs, JDBC), schema evolution, CDC, and deletion detection patterns
• Understanding of dimensional modeling to produce analytics‑ready datasets for Power BI
• Exposure to orchestration/monitoring, cost optimization, alerting, and runbook‑driven operations
• Data pipeline design (batch & streaming), DLT expectations for data quality, and robust error handling
• Source control, branching strategies, and CI/CD for data assets (notebooks, jobs, workflows)
• Practical understanding of privacy, security, and RBAC in cloud data platforms
• Excellent communication, documentation, and cross‑functional collaboration skills
• Analytical mindset; bias toward automation and measurable reliability
• Applicants must be legally authorized to work in the United States and should not require now, or in the future, sponsorship for employment visa sponsorship.

Job Duties and Responsibilities:

• Implement data quality checks (DLT expectations, unit tests) with alerting and remediation runbooks
• Build curated, analytics‑ready Delta tables using dimensional modeling for consumption by BI Developers
• Implement CDC and deletion‑flag patterns; manage schema drift and partitioning/Z‑Ordering strategies
• Operationalize jobs with monitoring, logging, alerting; participate in an on‑call rotation as needed
• Partner with the Data Architect to align designs with standards for governance, security, and cost efficiency
• Document pipelines, data contracts, and SLAs; continuously improve performance and reliability

Working Conditions:

• This position is hybrid. You will be required to be in office some during the week.
• Occasional,travel may be required for training or meetings.
• Must be able to work flexible hours to accommodate different time zones (Central/Eastern/Mountain/Pacific), if necessary.
• Be flexible for after-hours tasks, as needed.

About Us

PowerSecure, a Southern Company subsidiary, is a leading provider of innovative energy solutions to electric utilities and their industrial, institutional, and commercial customers.

Join Our Power Team!

We invest in high-value and cost-effective benefits for our employees. Our benefits
package includes:

• Medical, dental, vision and life insurance coverage
• Competitive pay and a matching 401 (k) plan
• Vacation, Company Holidays, Paid Time Off (PTO- personal and sick days)
• Flexible spending accounts/Health savings account
• Wellness Incentive Programs
• Employee Referral Program
• Tuition Reimbursement

The above statements are intended to describe the general nature and level of work being performed
by individuals assigned to this position. They are not intended to be an exhaustive list of all
responsibilities, duties, and skills required. Management reserves the right to assign or reassign
duties and responsibilities at any time, based on business needs.

PowerSecure is an equal opportunity employer where an applicant's qualifications are considered
without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic
information, sexual orientation, gender identity or expression, or any other basis prohibited by law

Qualifications

Skills

Behaviors

:

Motivations

:

Education

Experience

Licenses & Certifications

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
This employer is required to notify all applicants of their rights pursuant to federal employment laws.For further information, please review the Know Your Rights notice from the Department of Labor.