Senior Data Engineer Databricks

Inceed, L.L.C.; Greenwood Village (CO); Remote; USD 119,000 - 145,000; Full time

Job summary

Inceed, L.L.C. is partnering with a client to hire a Senior Data Engineer focused on the Databricks lakehouse.

You will own the platform design, build scalable pipelines with PySpark and Spark SQL, and collaborate with data, BI, and enterprise architecture teams to deliver trusted data for reporting and AI use cases. You will migrate legacy workloads to modern cloud architecture, implement Unity Catalog governance, and drive CI/CD, testing, and environment promotion.

Qualifications

• 8+ years of experience in data engineering, warehousing, or BI.
• 5+ years building production platforms on Databricks or Spark.
• Strong hands‑on experience with PySpark and Spark SQL.
• Experience owning the design of an enterprise data platform.
• Advanced knowledge of Delta Lake and Databricks workflows.
• Experience with dimensional modeling and star schema design.
• Strong SQL skills, including complex stored procedure analysis.
• Experience migrating legacy data platforms to modern cloud architecture.
• Hands‑on experience with Unity Catalog and data governance.
• Ability to remain technical and hands‑on in day‑to‑day development.

Responsibilities

• Own the technical design of the Databricks lakehouse platform.
• Build and optimize pipelines using PySpark, Spark SQL, and Delta Live Tables.
• Design enterprise data models and gold-layer reporting structures.
• Support migration from legacy SQL Server, SSIS, Synapse, and ADF workloads.
• Implement Unity Catalog governance and data access controls.
• Tune performance, reliability, and cloud costs across the platform.
• Establish CI/CD, testing, and environment promotion standards.
• Partner with business users and BI teams on self‑service analytics.
• Review offshore partner work and maintain engineering quality.
• Document architecture decisions and operational runbooks.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Dimensional modeling

SQL

Data architecture

Tools

SQL Server

SSIS

Synapse

ADF

Job description

Compensation:$119-$145k, depending on experience

Location:Remote

Inceed has partnered with a great company to help find a skilledSenior Data Engineer Databricksto join their team!

This is an exciting opportunity to take ownership of a growing Databricks lakehouse platform and help shape its long-term architecture. You’ll work closely with data, BI, and enterprise architecture teams to build scalable pipelines, modernize legacy workloads, and deliver trusted data for reporting and AI use cases. If you enjoy hands‑on engineering with real ownership, this role offers a chance to make a meaningful impact.

Key Responsibilities & Duties:

• Own the technical design of the Databricks lakehouse platform.
• Build and optimize pipelines using PySpark, Spark SQL, and Delta Live Tables.
• Design enterprise data models and gold-layer reporting structures.
• Support migration from legacy SQL Server, SSIS, Synapse, and ADF workloads.
• Implement Unity Catalog governance and data access controls.
• Tune performance, reliability, and cloud costs across the platform.
• Establish CI/CD, testing, and environment promotion standards.
• Partner with business users and BI teams on self‑service analytics.
• Review offshore partner work and maintain engineering quality.
• Document architecture decisions and operational runbooks.

Required Qualifications & Experience:

• 8+ years of experience in data engineering, warehousing, or BI.
• 5+ years building production platforms on Databricks or Spark.
• Strong hands‑on experience with PySpark and Spark SQL.
• Experience owning the design of an enterprise data platform.
• Advanced knowledge of Delta Lake and Databricks workflows.
• Experience with dimensional modeling and star schema design.
• Strong SQL skills, including complex stored procedure analysis.
• Experience migrating legacy data platforms to modern cloud architecture.
• Hands‑on experience with Unity Catalog and data governance.
• Ability to remain technical and hands‑on in day‑time development.
• This opportunity includes a comprehensive and competitive benefits package—details will be shared during later stages of the hiring process.

Other Information:

• This position can be fully remote
• This position requires a background check and drug test

Our client unable to provide sponsorship at this time.

We are Inceed, a staffing direct placement firm who believes in the possibility of something better. Our mission is simple: We’re here to help every person, whether client, candidate, or employee, find and secure what’s better for them.

Inceed is an equal opportunity employer. Inceed prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity, or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.