Remote Databricks Engineer: Spark, Delta Lake & ETL

Arting Digital Private Limited

Nederland

Hybrid

EUR 85,000 - 110,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Arting Digital Private Limited is seeking a Mid-Senior Databricks Engineer to join as a full-time remote role. You will design and maintain scalable data pipelines, optimize Spark jobs, and implement Delta Lake-based strategies.

Expertise in Databricks, Delta Live Tables, Airflow, and Azure Data Factory is valued. Collaborate with data teams to ensure data quality, governance, and timely delivery of analytics-ready datasets.

Qualifications

3–6 years of experience in data engineering.
Strong knowledge of SQL, Python and PySpark.
Hands-on Databricks and Apache Spark experience.
Understanding of Spark optimization, partitioning, and shuffling.
Experience with Delta Lake, Z-Ordering, and VACUUM.
Knowledge of Apache Airflow or Azure Data Factory.
Understanding of data governance and data quality.

Responsibilities

Develop and maintain scalable data pipelines using Databricks, Python, and PySpark.
Build and automate ETL workflows using Delta Live Tables (DLT).
Optimize Spark jobs through partitioning, shuffling, and performance tuning.
Implement Delta Lake optimization techniques, including Z-Ordering and VACUUM.
Manage data orchestration using Airflow or Azure Data Factory.
Ensure data quality, governance, and pipeline performance.
Collaborate with cross-functional teams to deliver efficient data engineering solutions.

Skills

SQL

Python

PySpark

Databricks

Apache Spark

Delta Live Tables

Airflow

Azure Data Factory

Delta Lake

Tools