Senior Databricks Data Engineer - Cloud Pipelines

Alephys LLC

United States

On-site

USD 120,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Alephys is seeking a Databricks Data Engineer to design, build, and optimize our cloud-native data platform. You will modernize ETL workloads, deploy declarative pipelines, and ensure secure, discoverable data products for the business.

You will leverage PySpark, Spark SQL, Unity Catalog, and DABs to automate pipelines, enforce governance, and accelerate insights. Strong Python and data migrations experience are required.

Qualifications

  • 5+ years of experience in Data Engineering with Databricks focus.
  • Deep Python (PySpark) and Spark SQL expertise.
  • Hands-on Databricks features: Delta Live Tables and Unity Catalog.
  • Experience building CI/CD for data with DABs and Git-based tooling.
  • Experience migrating legacy ETL to cloud-native Spark environments.

Responsibilities

  • Pipeline Engineering: design and maintain scalable ETL/ELT pipelines with PySpark and Spark SQL.
  • Declarative Frameworks: manage Spark Declarative Pipelines and automate data quality checks.
  • Legacy Modernization: migrate workloads from legacy ETL systems to PySpark architectures.
  • Data Governance & Security: implement centralized governance, access controls, and data lineage.
  • CI/CD & Automation: automate deployment of pipelines/notebooks/infrastructure using DABs and CI/CD.
  • Performance Optimization: profile and tune PySpark jobs for cost-efficiency.

Skills

Python (PySpark)
Spark SQL
Databricks platform
CI/CD pipelines
Git workflows
Jenkins / GitLab CI
Data architecture
Data governance

Tools

Unity Catalog
Delta Live Tables
DABs (Declarative Asset Bundles)
Spark/Databricks tooling

Job description

Alephys is seeking a Databricks Data Engineer to design, build, and optimize our cloud-native data platform. You will modernize ETL workloads, deploy declarative pipelines, and ensure secure, discoverable data products for the business.

You will leverage PySpark, Spark SQL, Unity Catalog, and DABs to automate pipelines, enforce governance, and accelerate insights. Strong Python and data migrations experience are required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Data Engineer: Modernize Pipelines & Governance
Senior Databricks Data Engineer: Modernize Pipelines & Governance

Alephys • Houston (TX)

On-site
USD 120,000 - 180,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Alephys • Houston (TX)

On-site
USD 120,000 - 180,000
Senior Databricks Engineer: Data Pipelines & Modernization
Senior Databricks Engineer: Data Pipelines & Modernization

Compunnel Inc. • United States

Remote
USD 140,000 - 190,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Alephys LLC • United States

On-site
USD 120,000 - 190,000
Senior AWS Data Engineer - Databricks & DMS Pipelines
Senior AWS Data Engineer - Databricks & DMS Pipelines

CloudBigD • Wilmington (DE)

On-site
USD 120,000 - 180,000
Big Data Engineer: Databricks, ETL & Cloud Pipelines
Big Data Engineer: Databricks, ETL & Cloud Pipelines

Agilisium • Westlake Village (CA)

On-site
USD 150,000 - 190,000
Databricks Data Engineer - Azure, CDC Pipelines, PySpark
Databricks Data Engineer - Azure, CDC Pipelines, PySpark

CloudBigD • Phoenix (AZ)

On-site
USD 81,000 - 115,000
Senior Data Engineer: Databricks & Data Pipelines Lead
Senior Data Engineer: Databricks & Data Pipelines Lead

Veriipro • Atlanta (GA)

On-site
USD 140,000 - 180,000
Senior Data Engineer - Remote Cloud Pipelines Leader
Senior Data Engineer - Remote Cloud Pipelines Leader

Care Access • Boston (MA)

Remote
USD 120,000 - 160,000
PTO & holidays
Medical/dental/vision
HSA & FSA
+3
Senior Databricks Engineer - Data Modernization & PySpark
Senior Databricks Engineer - Data Modernization & PySpark

CloudBigD • Austin (TX)

On-site
USD 83,000 - 118,000