Sr. Data Engineer

Sunbelt Rentals; Fort Mill (SC); On-site; USD 130,000 - 179,000; Full time

Benefits offered by this job

Health, Dental and Vision plans

401(k) Match

Volunteer time off

Disability insurance

Life and Travel insurance

Tuition Reimbursement Options

EAP and Length of Service Awards

Job summary

Sunbelt Rentals is seeking a senior Data Engineer to design and maintain end-to-end IoT data pipelines, leveraging Databricks and Delta Lake. You will lead streaming ingestion with Kafka, architect data platforms, and mentor junior engineers.

The role requires deep Databricks experience, Python/SQL proficiency, and strong collaboration with cloud teams to ensure data supports analytics and ML workloads.

Qualifications

• Minimum 5+ years in data engineering with strong Databricks experience.
• Proficient in Python and SQL with production-grade Spark
• Experience building Kafka-based streaming pipelines and IoT data patterns.

Responsibilities

• Design, build, and maintain end-to-end IoT data pipelines from edge devices into Databricks.
• Lead streaming ingestion pipeline development with Kafka and Databricks Structured Streaming.
• Define data engineering best practices, data quality, and schema governance.
• Architect Delta Lake tables with partitioning, Z-ordering, and vacuuming for performance.
• Collaborate with infrastructure and cloud teams on Databricks clusters, Unity Catalog, and Delta Live Tables.
• Mentor junior engineers through code reviews and pair programming.
• Partner with data scientists/analysts to meet downstream ML and analytics needs.
• Troubleshoot production pipelines and drive root-cause analysis and improvements.
• Evaluate new tools to continuously improve the data platform.

Skills

Python

SQL

Spark

Streaming

IoT data

Time-series

Cloud infra

IaC

Leadership

Education

Bachelor's degree in CS/related

Tools

Databricks

Kafka

Delta Lake

Unity Catalog

Delta Live Tables

Azure

dbt

Job description

Join Our Team!Sunbelt Rentals strives to be the customer's first choice in the equipment rental industry. From pumps to scaffolding to general construction tools, we aim to be the only call needed to outfit a job site with the proper equipment. Not only do we offer a vast fleet that ranks among the best in the industry, we pair it all with a friendly and knowledgeable staff. Our employees are our greatest asset, and although we present a comprehensive equipment offering, our expertise and service are what truly distinguish us from the competition.We pride ourselves on investing in our workforce and offer competitive benefits, as well as extensive on-the-job training for all eligible employees.As a highly successful national company, we are constantly looking for talented individuals to support our growth. If you are interested in pursuing a rewarding career, we invite you to review our opportunities!Job Description SummaryKey ResponsibilitiesDesign, build, and maintain end-to-end IoT data pipelines from edge devices into Databricks using the medallion architecture (Bronze/Silver/Gold)Lead the development and optimization of streaming ingestion pipelines using Apache Kafka and Databricks Structured StreamingDefine and enforce data engineering best practices, including pipeline design patterns, data quality frameworks, and schema governanceArchitect and manage Delta Lake tables, including partitioning strategies, Z-ordering, and vacuuming for performance and cost efficiencyCollaborate with infrastructure and cloud teams to configure and manage Databricks clusters, Unity Catalog, and Delta Live TablesMentor junior and mid-level data engineers through code reviews, pair programming, and technical guidancePartner with data scientists and analysts to ensure processed data meets downstream analytical and ML requirementsTroubleshoot production pipeline failures and drive root cause analysis and resolutionEvaluate and introduce new tools and technologies to continuously improve the data platformRequired Qualifications5+ years of data engineering experience, with at least 2 years working extensively with DatabricksStrong proficiency in Python and SQL, with experience writing production-grade Spark codeHands-on experience building and managing Kafka-based streaming pipelinesDeep familiarity with Delta Lake, Delta Live Tables, and the Databricks ecosystem (Unity Catalog, Workflows, MLflow)Experience with IoT data patterns — high-frequency telemetry ingestion, device state management, time-series dataSolid understanding of cloud infrastructure (Azure preferred) and infrastructure-as-code conceptsStrong communication skills with the ability to lead technical discussions and translate requirements into architecturePreferred QualificationsExperience with Geotab or similar fleet telematics platformsDatabricks Certified Data Engineer Associate or Professional certificationFamiliarity with Azure Key Vault, Event Hubs, or Azure Data FactoryExperience with dbt for data transformationBachelor’s degree in computer science, Information Technology, Data Engineering, or equivalent experience.Physical Demands:Must be able to bend, squat, crouch and/or reach and lift up to 25 pounds or more, as required by the job. Some Sunbelt jobs may require driving for long periods of time, loading and unloading heavy equipment, performing work in extreme weather conditions including rain, wind, or excessive temperatures and/or night and weekend work. All duties must be performed according to Sunbelt’s safety policies and guidelines. Reasonable accommodations may be made to comply with ADA/ADAAA.The above description covers the principal duties and responsibilities of the job. The description shall not, however, be construed as a complete listing of all miscellaneous, incidental or similar duties which may be required from day to day.Sunbelt Rentals is an Equal Opportunity Employer — Minority/Female/Disabled/Veteran and any other protected groundBase Pay Range: $130,315.00 - 179,183.40Starting rate of pay may vary based on factors including, but not limited to, position offered, location, education, training, and/or experience. Please visit https://www.sunbeltrentals.com/careers/ for more information on our benefits and to join our Talent Network.Sunbelt also provides a comprehensive benefits package to its full-time employees. This package includes:Health, Dental and Vision plans401(k) MatchVolunteer time offShort-term and long-term disabilityAccident, Life and Travel insurance, as well as flexible spendingTuition Reimbursement OptionsEmployee Assistance Program (EAP)Length of Service AwardsYou will become eligible for benefits on the first of the month following 30 days from your start date. Sunbelt offers team members the following paid time off from work, subject to Sunbelt’s policies (unless specified in a collective bargaining agreement):12-25 vacation days depending on years of service5 sick days6 holidays2 half day holidays2 floating holidays1 inclusion day1 volunteer dayGear up for an exciting career!Sunbelt Rentals supports service members. Veterans encouraged to apply.