IoT Data Engineer: Databricks & Streaming Expert

Sunbelt Rentals, Inc.; Fort Mill (SC); On-site; USD 130,000 - 179,000; Full time

Benefits offered by this job

Health plan

Dental plan

Vision plan

401(k) match

Volunteer time off

Disability insurance

Life insurance

Travel insurance

Flexible spending

Tuition reimbursement

EAP

Length of service awards

Job summary

Sunbelt Rentals, Inc. is seeking a Senior Data Engineer to design, build, and maintain end-to-end IoT data pipelines into Databricks, focusing on streaming ingestion, data quality, and Delta Lake operations.

The role requires strong Python/SQL, Spark, and Kafka experience, with a focus on production stability and collaboration with data scientists and analysts. Onsite in Fort Mill, SC, with a competitive USD salary.

Qualifications

• 5+ years of data engineering experience, including Databricks exposure.
• Strong Python and SQL skills with production-grade Spark code.
• Hands-on with Kafka-based streaming pipelines and Delta Lake.
• Experience in IoT data patterns and cloud infrastructure.

Responsibilities

• Design, build, and maintain end-to-end IoT data pipelines into Databricks.
• Lead streaming ingestion pipelines using Apache Kafka and Databricks Structured Streaming.
• Enforce data engineering best practices, schema governance, and data quality.
• Architect and manage Delta Lake tables, partitioning, and vacuuming.
• Collaborate with infrastructure and cloud teams on Databricks clusters and Unity Catalog.
• Mentor junior engineers and partner with data scientists and analysts.
• Troubleshoot production pipeline failures and drive RCAs.
• Evaluate new tools to improve the data platform.

Skills

Databricks

Python

SQL

Kafka

Spark

IoT data patterns

Cloud infrastructure

Communication skills

Education

Bachelor's degree in Computer Science or related field

Tools

Delta Lake

Delta Live Tables

Unity Catalog

MLflow

Azure

Infrastructure-as-code

Databricks

Job description

Sunbelt Rentals, Inc. is seeking a Senior Data Engineer to design, build, and maintain end-to-end IoT data pipelines into Databricks, focusing on streaming ingestion, data quality, and Delta Lake operations.

The role requires strong Python/SQL, Spark, and Kafka experience, with a focus on production stability and collaboration with data scientists and analysts. Onsite in Fort Mill, SC, with a competitive USD salary.