Senior IoT Data Platform Engineer

Sunbelt Rentals; Fort Mill (SC); On-site; USD 130,000 - 179,000; Full time

Benefits offered by this job

Health, Dental and Vision plans

401(k) Match

Volunteer time off

Disability insurance

Life and Travel insurance

Tuition Reimbursement Options

EAP and Length of Service Awards

Job summary

Sunbelt Rentals is seeking a senior Data Engineer to design and maintain end-to-end IoT data pipelines, leveraging Databricks and Delta Lake. You will lead streaming ingestion with Kafka, architect data platforms, and mentor junior engineers.

The role requires deep Databricks experience, Python/SQL proficiency, and strong collaboration with cloud teams to ensure data supports analytics and ML workloads.

Qualifications

• Minimum 5+ years in data engineering with strong Databricks experience.
• Proficient in Python and SQL with production-grade Spark
• Experience building Kafka-based streaming pipelines and IoT data patterns.

Responsibilities

• Design, build, and maintain end-to-end IoT data pipelines from edge devices into Databricks.
• Lead streaming ingestion pipeline development with Kafka and Databricks Structured Streaming.
• Define data engineering best practices, data quality, and schema governance.
• Architect Delta Lake tables with partitioning, Z-ordering, and vacuuming for performance.
• Collaborate with infrastructure and cloud teams on Databricks clusters, Unity Catalog, and Delta Live Tables.
• Mentor junior engineers through code reviews and pair programming.
• Partner with data scientists/analysts to meet downstream ML and analytics needs.
• Troubleshoot production pipelines and drive root-cause analysis and improvements.
• Evaluate new tools to continuously improve the data platform.

Skills

Python

SQL

Spark

Streaming

IoT data

Time-series

Cloud infra

IaC

Leadership

Education

Bachelor's degree in CS/related

Tools

Databricks

Kafka

Delta Lake

Unity Catalog

Delta Live Tables

Azure

dbt

Job description

Sunbelt Rentals is seeking a senior Data Engineer to design and maintain end-to-end IoT data pipelines, leveraging Databricks and Delta Lake. You will lead streaming ingestion with Kafka, architect data platforms, and mentor junior engineers.

The role requires deep Databricks experience, Python/SQL proficiency, and strong collaboration with cloud teams to ensure data supports analytics and ML workloads.