Databricks Senior Data Engineer — Remote, Own the Platform

Inceed, L.L.C.; Greenwood Village (CO); Remote; USD 119,000 - 145,000; Full time

Job summary

Inceed, L.L.C. is partnering with a client to hire a Senior Data Engineer focused on the Databricks lakehouse.

You will own the platform design, build scalable pipelines with PySpark and Spark SQL, and collaborate with data, BI, and enterprise architecture teams to deliver trusted data for reporting and AI use cases. You will migrate legacy workloads to modern cloud architecture, implement Unity Catalog governance, and drive CI/CD, testing, and environment promotion.

Qualifications

• 8+ years of experience in data engineering, warehousing, or BI.
• 5+ years building production platforms on Databricks or Spark.
• Strong hands‑on experience with PySpark and Spark SQL.
• Experience owning the design of an enterprise data platform.
• Advanced knowledge of Delta Lake and Databricks workflows.
• Experience with dimensional modeling and star schema design.
• Strong SQL skills, including complex stored procedure analysis.
• Experience migrating legacy data platforms to modern cloud architecture.
• Hands‑on experience with Unity Catalog and data governance.
• Ability to remain technical and hands‑on in day‑to‑day development.

Responsibilities

• Own the technical design of the Databricks lakehouse platform.
• Build and optimize pipelines using PySpark, Spark SQL, and Delta Live Tables.
• Design enterprise data models and gold-layer reporting structures.
• Support migration from legacy SQL Server, SSIS, Synapse, and ADF workloads.
• Implement Unity Catalog governance and data access controls.
• Tune performance, reliability, and cloud costs across the platform.
• Establish CI/CD, testing, and environment promotion standards.
• Partner with business users and BI teams on self‑service analytics.
• Review offshore partner work and maintain engineering quality.
• Document architecture decisions and operational runbooks.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Dimensional modeling

SQL

Data architecture

Tools

SQL Server

SSIS

Synapse

ADF

Job description

Inceed, L.L.C. is partnering with a client to hire a Senior Data Engineer focused on the Databricks lakehouse.

You will own the platform design, build scalable pipelines with PySpark and Spark SQL, and collaborate with data, BI, and enterprise architecture teams to deliver trusted data for reporting and AI use cases. You will migrate legacy workloads to modern cloud architecture, implement Unity Catalog governance, and drive CI/CD, testing, and environment promotion.