Data Engineer — Delta Lake, Databricks & Azure

sunbeltrentals; Fort Mill (SC); On-site; USD 113,000 - 156,000; Full time

Benefits offered by this job

Health, Dental and Vision plans

401(k) Match

Volunteer time off

Short-term and long-term disability

Job summary

Sunbelt Rentals is seeking a data engineer to support day-to-day data ingestion, transformation, and pipeline maintenance across Databricks using Python and SQL. You will design and maintain Bronze/Silver/Gold data layers sourced from SQL Server, Oracle ICM, and other enterprise systems.

This role collaborates with Finance, HR, and Compensation teams to translate business rules into auditable pipelines, monitor data quality, and ensure accuracy of compensation data.

Qualifications

• 3+ years of data engineering experience with SQL Server (T-SQL, stored procedures, performance tuning).
• Hands-on Databricks experience with Delta Lake and medallion architecture patterns.
• Proficient in Python and SQL for pipeline development.
• Experience with Azure cloud services (Azure Data Factory, Blob Storage, Key Vault).
• Able to translate complex, rules-based business logic into technical data models.
• Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field.

Responsibilities

• Support day-to-day data ingestion, transformation, and pipeline maintenance across Databricks using Python and SQL.
• Lead redesign of compensation calculation model within Oracle ICM, incl. data modeling and migration to medallion architecture.
• Build and maintain Bronze/Silver/Gold pipelines sourcing from SQL Server, Oracle ICM, and other systems.
• Design and manage Delta Lake tables ensuring data quality and performance across compensation datasets.
• Collaborate with Finance, HR, and Compensation to translate rules into auditable pipelines.
• Integrate data from Workday and payroll systems where relevant to reporting and reconciliation.
• Monitor pipeline health and troubleshoot discrepancies with attention to sensitive data.
• Document data lineage and transformation logic for compliance and audits.

Skills

SQL

Python

Databricks

SQL Server

Azure

Education

Bachelor's Degree in CS/IT/Data Engineering

Tools

Azure Data Factory

Blob Storage

Key Vault

Varicent

Workday

dbt

Job description

Sunbelt Rentals is seeking a data engineer to support day-to-day data ingestion, transformation, and pipeline maintenance across Databricks using Python and SQL. You will design and maintain Bronze/Silver/Gold data layers sourced from SQL Server, Oracle ICM, and other enterprise systems.

This role collaborates with Finance, HR, and Compensation teams to translate business rules into auditable pipelines, monitor data quality, and ensure accuracy of compensation data.