Hybrid Data Solutions Engineer - Azure & Databricks

PowerSecure, Inc.; Raleigh (NC); Hybrid; USD 90,000 - 130,000; Full time

Benefits offered by this job

Medical, dental, vision and life보험

Competitive pay

401(k) match

Vacation and PTO

Tuition reimbursement

Wellness programs

Employee referral program

Job summary

PowerSecure, Inc. is seeking a Data Solutions Engineer to design, build, and operate scalable data pipelines on Azure, enabling trusted analytics and self-service BI.

You will work with BI Developers, the Data Architect, and business stakeholders to ingest, model, and deliver high-quality data using Azure Data Factory, Databricks (PySpark), and Delta Lake. Responsibilities include batch/stream ingestion, data transformation, orchestration, data quality enforcement, and operational support.

Qualifications

• 2+ years of hands-on data engineering or equivalent.
• 2+ years building pipelines on Azure and Databricks.
• Strong SQL, PySpark, and data modeling fundamentals.
• Bachelor’s degree in MIS, CS, Engineering, or equivalent.
• Proficiency with SQL and Python (PySpark).
• Experience with Azure Databricks, Delta Lake, Delta Live Tables, and Git for CI/CD.
• Knowledge of Unity Catalog and Purview for governance, lineage, and security.
• Familiarity with ingestion patterns, schema evolution, CDC, and deletion detection.
• Understanding of dimensional modeling for analytics-ready datasets.
• Experience with orchestration/monitoring, cost optimization, and runbook-driven ops.
• Source control and CI/CD for data assets.

Responsibilities

• Design, implement, and support end-to-end ELT pipelines in Databricks/ADF.
• Implement data quality checks with alerting and remediation runbooks.
• Build analytics-ready Delta tables using dimensional modeling for BI consumption.
• Implement CDC and deletion-flag patterns; manage schema drift and partitioning.
• Operate jobs with monitoring, logging, and on-call rotation as needed.
• Collaborate with Data Architect to align designs with governance, security, and cost standards.
• Document pipelines, data contracts, and SLAs; continuously improve performance.

Skills

SQL

Python (PySpark)

Delta Lake

Databricks

Azure Data Factory

Data pipelines

Dimensional modeling

CI/CD for data assets

Governance

RBAC security

Communication

Education

Bachelor's degree

Tools

Azure Databricks

Delta Lake

Delta Live Tables

Azure Data Factory

ADLS Gen2

Git for CI/CD

Job description

PowerSecure, Inc. is seeking a Data Solutions Engineer to design, build, and operate scalable data pipelines on Azure, enabling trusted analytics and self-service BI.

You will work with BI Developers, the Data Architect, and business stakeholders to ingest, model, and deliver high-quality data using Azure Data Factory, Databricks (PySpark), and Delta Lake. Responsibilities include batch/stream ingestion, data transformation, orchestration, data quality enforcement, and operational support.