Mid-Senior Databricks Engineer

Arting Digital

United States

Remote

USD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Arting Digital is seeking a Mid-Senior Databricks Engineer to join our remote data team. The role focuses on building scalable data pipelines with Databricks, PySpark, and Delta Lake, ensuring data governance and quality across pipelines.

You will optimize Spark jobs, implement DLT ETLs, and collaborate with cross-functional teams to deliver high-performance data engineering solutions in a cloud-first environment.

Qualifications

  • 3–6 years of data engineering experience.
  • Strong knowledge of SQL, Python, and PySpark.
  • Hands-on Databricks and Apache Spark experience.
  • Understanding of Spark optimization, partitioning, and shuffling.
  • Experience with Delta Lake, Z-Ordering, and VACUUM.
  • Experience building ETL pipelines using Delta Live Tables (DLT).
  • Knowledge of Airflow or Azure Data Factory.
  • Understanding of data governance and data quality.

Responsibilities

  • Develop and maintain scalable data pipelines using Databricks, Python, and PySpark.
  • Build and automate ETL workflows using Delta Live Tables (DLT).
  • Optimize Spark jobs through partitioning, shuffling, and performance tuning.
  • Implement Delta Lake optimization techniques, including Z-Ordering and VACUUM.
  • Manage data orchestration using Airflow or Azure Data Factory.
  • Ensure data quality, governance, and pipeline performance.
  • Collaborate with cross-functional teams to deliver efficient data engineering solutions.

Skills

SQL
Python
PySpark
Databricks
Apache Spark
Delta Live Tables (DLT)
Delta Lake
Spark optimization
Data governance
Data quality

Tools

Airflow
Azure Data Factory
Delta Live Tables (DLT)

Job description

Position: Mid-Senior Databricks Engineer

Location: Remote

Experience: 3–6 Years

Employment Type: Full-Time

Required Skills & Qualifications
  • 3–6 years of experience in Data Engineering.
  • Strong knowledge of SQL, Python, and PySpark.
  • Hands-on experience with Databricks and Apache Spark.
  • Understanding of Spark optimization, partitioning, and shuffling.
  • Experience with Delta Lake, Z-Ordering, and VACUUM.
  • Experience building ETL pipelines using Delta Live Tables (DLT).
  • Knowledge of Apache Airflow or Azure Data Factory.
  • Understanding of data governance and data quality.
Key Responsibilities
  • Develop and maintain scalable data pipelines using Databricks, Python, and PySpark.
  • Build and automate ETL workflows using Delta Live Tables (DLT).
  • Optimize Spark jobs through partitioning, shuffling, and performance tuning.
  • Implement Delta Lake optimization techniques, including Z-Ordering and VACUUM.
  • Manage data orchestration using Airflow or Azure Data Factory.
  • Ensure data quality, governance, and pipeline performance.
  • Collaborate with cross-functional teams to deliver efficient data engineering solutions.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Mid-Senior Databricks Engineer
Mid-Senior Databricks Engineer

Arting Digital Private Limited • United States

Remote
USD 120,000 - 170,000
Mid-Senior Databricks Engineer
Mid-Senior Databricks Engineer

Artingdigital • United States

Remote
USD 120,000 - 180,000
Remote Databricks Engineer: Spark, Delta Lake & ETL
Remote Databricks Engineer: Spark, Delta Lake & ETL

Artingdigital • United States

Remote
USD 120,000 - 180,000
Remote Databricks Engineer — Spark & Delta Lake Expert
Remote Databricks Engineer — Spark & Delta Lake Expert

Arting Digital Private Limited • United States

Remote
USD 120,000 - 170,000
Remote Databricks Engineer — Delta Lake & ETL Expert
Remote Databricks Engineer — Delta Lake & ETL Expert

Arting Digital • United States

Remote
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Veriipro • Atlanta (GA)

On-site
USD 140,000 - 180,000
Databricks Engineer.
Databricks Engineer.

Healthcare Triangle, Inc. • Dallas (TX)

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Accion Labs • United States

Remote
USD 120,000 - 170,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Virtue America • New York (NY)

On-site
USD 140,000 - 190,000
Databricks Engineer
Databricks Engineer

Dataflix • United States

Remote
USD 130,000 - 170,000