Data Engineer - IoT Streaming & Databricks

Sunbelt Rentals; Fort Mill (SC); On-site; USD 113,000 - 156,000; Full time

Benefits offered by this job

Health, Dental and Vision plans

401(k) Match

Volunteer time off

Short-term and long-term disability

Tuition Reimbursement Options

Employee Assistance Program (EAP)

Length of Service Awards

Job summary

Sunbelt Rentals is seeking a data engineer to develop and maintain data ingestion and transformation pipelines on the Databricks platform. You will work with Python and SQL to process IoT telemetry data from fleet devices, build Delta Lake tables across Bronze to Gold layers, and ensure data quality and reliability through code reviews and collaboration with analytics teams.

The role emphasizes independence on well-scoped tasks within a collaborative, high-growth environment, with extensive

Qualifications

• 2+ years of data engineering experience.
• Proficiency in Python and SQL.
• Hands-on experience with Spark, preferably Databricks.
• Familiarity with streaming data concepts (Kafka, Structured Streaming).
• Understanding of cloud data lake concepts and Delta Lake or similar formats.
• Ability to work independently on well-scoped tasks and collaborate in a team.

Responsibilities

• Develop and maintain data ingestion and transformation pipelines on Databricks using Python and SQL.
• Build and support streaming and batch workflows that process high-frequency IoT telemetry data from fleet devices.
• Create and manage Delta Lake tables across Bronze, Silver, and Gold layers of the medallion architecture.
• Write reliable, tested, and well-structured pipeline code following team standards.
• Monitor pipeline performance and data quality, investigate failures, and implement fixes.
• Collaborate with senior engineers, analysts, and data scientists to understand requirements and deliver data products.
• Participate in code reviews and contribute to team documentation and knowledge sharing.

Skills

Python

SQL

Apache Spark

Databricks

Streaming data

Cloud data lake

Independent work

Team collaboration

Education

Bachelor's degree in CS/IT/Data Eng

Tools

Databricks Platform

Delta Lake

dbt

Azure

Kafka

Azure Key Vault

Azure Event Hubs

Blob Storage

Delta Live Tables

Job description

Sunbelt Rentals is seeking a data engineer to develop and maintain data ingestion and transformation pipelines on the Databricks platform. You will work with Python and SQL to process IoT telemetry data from fleet devices, build Delta Lake tables across Bronze to Gold layers, and ensure data quality and reliability through code reviews and collaboration with analytics teams.

The role emphasizes independence on well-scoped tasks within a collaborative, high-growth environment, with extensive