Senior Data Engineer: Databricks, Delta Lake & Cloud Platform

MS Companies

Indianapolis (IN)

Hybrid

USD 130,000 - 155,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical, dental, and vision

401(k) with company match

PTO + company holidays

Hybrid work flexibility

Job summary

MS Companies in Indianapolis, IN is seeking a Senior Data Engineer to build and scale a modern enterprise cloud data platform. This hands-on role focuses on production systems, designing data pipelines, strengthening the Databricks environment, implementing Delta Lake with governance, and improving reliability, performance, and cost efficiency.

You will collaborate with Data Strategy, Finance, Operations and Analytics teams, design scalable ETL/ELT pipelines, and partner with stakeholders to

Qualifications

5+ years of Data Engineering or Cloud Data Engineering experience.
Strong production experience with Databricks.
Hands-on experience with Snowflake.
Advanced Python / PySpark and SQL.
Experience building and supporting scalable ETL/ELT pipelines.
Solid understanding of cloud data architecture (Azure preferred).
Bachelor’s degree in a technical field.
Must be authorized to work in the U.S. without sponsorship.

Responsibilities

Design, build, and maintain scalable data pipelines in Databricks.
Optimize Databricks clusters for performance, reliability, and cost.
Implement and maintain Delta Lake architecture.
Integrate Databricks with Azure services (ADF, ADLS, Synapse, DevOps).
Build CI/CD pipelines and workflow orchestration.
Support data governance through Unity Catalog.
Partner with business stakeholders to turn requirements into scalable solutions.
Help establish engineering standards and best practices.