Senior Databricks Data Engineer: Modernize Pipelines & Governance

Alephys

Houston (TX)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Alephys seeks a Databricks Data Engineer to design, build, and optimize a scalable data architecture. You will modernize ETL workloads, migrate from legacy systems, and ensure data assets are secure, discoverable, and performant.

You will leverage PySpark, Spark SQL, and Delta Live Tables, implement Unity Catalog governance, and build reliable CI/CD pipelines with DABs and Git-based tooling to deliver high-quality data products.

Qualifications

  • 5+ years of Data Engineering experience with Databricks.
  • Expert Python (PySpark) and Spark SQL.
  • Deep knowledge of Databricks features: Delta Live Tables and Unity Catalog.
  • CI/CD pipelines for data assets using Git and automation tools.
  • Experience migrating legacy ETL (e.g., DataStage, Informatica) to cloud-native Spark.
  • Strong analytical and problem-solving skills.

Responsibilities

  • Design, build, and maintain scalable ETL/ELT pipelines using PySpark.
  • Implement declarative pipelines (Delta Live Tables) and data quality checks.
  • Migrate legacy workloads to modern Databricks architectures.
  • Enforce centralized data governance and security using Unity Catalog.
  • Automate deployment of pipelines with DABs and CI/CD tools.
  • Profile and optimize PySpark jobs and Spark SQL queries.

Skills

PySpark
Spark SQL
Databricks
CI/CD pipelines
Data governance
ETL modernization
Problem solving
Distributed computing

Tools

Git
GitHub Actions
Jenkins
Terraform
Databricks Asset Bundles

Job description

Alephys seeks a Databricks Data Engineer to design, build, and optimize a scalable data architecture. You will modernize ETL workloads, migrate from legacy systems, and ensure data assets are secure, discoverable, and performant.

You will leverage PySpark, Spark SQL, and Delta Live Tables, implement Unity Catalog governance, and build reliable CI/CD pipelines with DABs and Git-based tooling to deliver high-quality data products.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Data Engineer - Cloud Pipelines
Senior Databricks Data Engineer - Cloud Pipelines

Alephys LLC • United States

On-site
USD 120,000 - 190,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Alephys • Houston (TX)

On-site
USD 120,000 - 180,000
Senior Databricks Engineer: Data Pipelines & Modernization
Senior Databricks Engineer: Data Pipelines & Modernization

Compunnel Inc. • United States

Remote
USD 140,000 - 190,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Alephys LLC • United States

On-site
USD 120,000 - 190,000
Senior Databricks Engineer - Modern Data Pipelines PySpark
Senior Databricks Engineer - Modern Data Pipelines PySpark

Ethereum Technologies LLC • Austin (TX)

On-site
USD 85,000 - 116,000
Senior Databricks & Azure Data Platform Engineer
Senior Databricks & Azure Data Platform Engineer

Kestra Financial, Inc. • Tempe (AZ)

On-site
USD 120,000 - 160,000
Competitive pay and benefits
401(k)
Health insurance
+1
Senior Databricks & Azure Data Platform Engineer
Senior Databricks & Azure Data Platform Engineer

Kestra Holdings • Tempe (AZ)

On-site
USD 120,000 - 150,000
Competitive pay and benefits
401(k) and health insurance
Opportunities for training and development
Senior Databricks Engineer – Remote Data Pipelines
Senior Databricks Engineer – Remote Data Pipelines

Princeton IT Services, Inc • United States

Remote
USD 130,000 - 180,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 90,000 - 110,000
Azure Databricks Engineer - Data Pipelines & Governance
Azure Databricks Engineer - Data Pipelines & Governance

Ethereum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000