Senior Databricks Engineer: Data Pipelines & Modernization

Compunnel Inc.

United States

Remote

USD 140,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Compunnel Inc. is seeking a Senior Databricks Developer with 8+ years of IT experience to design, develop, and optimize enterprise-scale data engineering solutions on Databricks.

You will implement Medallion Architecture, build scalable pipelines with PySpark, Python, and SQL, and modernize legacy ETL workloads within a cloud data platform. You will mentor junior developers, collaborate with architects and stakeholders, and ensure governance via Unity Catalog.

Qualifications

  • 8+ years of IT experience in data engineering or related field.
  • Hands-on Databricks development experience.
  • Experience modernizing data warehouses and migrating ETL workloads to Databricks.

Responsibilities

  • Design, develop, and optimize scalable data pipelines using Databricks, PySpark, Python, and SQL.
  • Implement Medallion Architecture (Bronze, Silver, Gold).
  • Develop reusable data ingestion, transformation, validation, and processing frameworks.
  • Design and optimize Delta Lake tables and large Spark workloads.
  • Build and manage data workflows using Databricks Workflows.
  • Implement data governance with Unity Catalog, including RBAC and data masking.
  • Develop dimensional, reference, master, and curated data models.
  • Migrate legacy ETL processes and SQL Server/Oracle/Teradata workloads to Databricks.

Skills

Databricks
PySpark
Python
Advanced SQL
Delta Lake
Unity Catalog
Medallion Architecture
ETL/ELT Development
Data Modelling
Spark Performance Tuning
Databricks Workflows

Job description

Compunnel Inc. is seeking a Senior Databricks Developer with 8+ years of IT experience to design, develop, and optimize enterprise-scale data engineering solutions on Databricks.

You will implement Medallion Architecture, build scalable pipelines with PySpark, Python, and SQL, and modernize legacy ETL workloads within a cloud data platform. You will mentor junior developers, collaborate with architects and stakeholders, and ensure governance via Unity Catalog.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Cloud Data Pipelines & ETL Expert
Senior Data Engineer - Cloud Data Pipelines & ETL Expert

Compunnel Inc. • Westlake (OH)

On-site
USD 90,000 - 150,000
Senior Databricks Data Engineer: Modernize Pipelines & Governance
Senior Databricks Data Engineer: Modernize Pipelines & Governance

Alephys • Houston (TX)

On-site
USD 120,000 - 180,000
Senior Data Engineer: Pipelines, Governance & QA
Senior Data Engineer: Pipelines, Governance & QA

Compunnel Inc. • Eden Prairie (MN)

On-site
USD 130,000 - 180,000
Databricks Data Engineer: Pipelines, Lakehouse & Medallion
Databricks Data Engineer: Pipelines, Lakehouse & Medallion

Compunnel Inc. • Spring (TX)

On-site
USD 110,000 - 140,000
Senior Databricks Data Engineer — Build Scalable Pipelines
Senior Databricks Data Engineer — Build Scalable Pipelines

Remote • San Francisco (CA)

On-site
USD 140,000 - 190,000
Health and dental insurance
Meal and food allowance
Childcare assistance
+2
Senior Databricks Data Engineer - Cloud Pipelines
Senior Databricks Data Engineer - Cloud Pipelines

Alephys LLC • United States

On-site
USD 120,000 - 190,000
Senior Databricks Engineer - Modern Data Pipelines PySpark
Senior Databricks Engineer - Modern Data Pipelines PySpark

Ethereum Technologies LLC • Austin (TX)

On-site
USD 85,000 - 116,000
Senior Databricks Architect: Data Lakehouse & Pipelines
Senior Databricks Architect: Data Lakehouse & Pipelines

Remote • San Francisco (CA)

On-site
USD 150,000 - 190,000
Senior Data Engineer: Databricks & Data Pipelines Lead
Senior Data Engineer: Databricks & Data Pipelines Lead

Veriipro • Atlanta (GA)

On-site
USD 140,000 - 180,000
Senior Databricks Data Engineer for AI-Powered Pipelines
Senior Databricks Data Engineer for AI-Powered Pipelines

CI&T • United States

Remote
USD 120,000 - 160,000
Premium Healthcare
Meal voucher
Maternity and Parental leaves
+5