Senior Databricks Engineer - Azure Lakehouse, Remote

DataArt

United States

Hybrid

USD 120,000 - 180,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Vacation days up to 26 per year
Health and life insurance
MyBenefit platform with Multisport
English language classes from day one
Learning platforms access (O'Reilly, L
Flexible hybrid/work-from-home option
Mentoring & public speaking programs
Certification reimbursement (AWS, GCP,
Internal psychological support

Job summary

DataArt is seeking a Strong Middle / Senior Databricks Developer with Azure to build scalable data platforms and data pipelines within the Microsoft Azure ecosystem. You will work with Databricks, Spark, and Azure services to deliver reliable data engineering solutions.

The role focuses on developing high-performance PySpark solutions, designing Lakehouse architectures with Delta Lake, and collaborating across data teams to ensure governance and quality at scale.

Qualifications

  • 4+ years of experience in Data Engineering.
  • 3+ years of hands-on experience with Azure Databricks.
  • Experience with Apache Spark and PySpark.
  • Knowledge of Python and SQL.
  • Experience with Azure Data Factory.
  • Experience with Azure Data Lake Storage Gen2.
  • Experience with Delta Lake and Lakehouse architecture.
  • Experience implementing end-to-end data pipelines in Azure.
  • Understanding of data modeling principles and best practices.
  • Experience working with large-scale datasets in cloud environments.
  • Experience with Git-based version control systems.
  • Upper Intermediate or higher English level.

Responsibilities

  • Design data solutions using Databricks.
  • Develop data pipelines for structured and unstructured data.
  • Build ETL and ELT workflows in Azure.
  • Develop high-performance solutions using PySpark and Spark SQL.
  • Design Lakehouse architectures using Delta Lake.
  • Integrate data from databases, APIs, cloud services and streaming platforms.
  • Optimize Spark workloads for performance, scalability and cost efficiency.
  • Ensure data quality, governance, security and monitoring standards.
  • Collaborate with Data Engineers, Data Architects, Analytics teams and business stakeholders.
  • Participate in architectural discussions and technical decision making.
  • Support CI and CD processes and infrastructure automation practices.

Skills

Data engineering
Azure Databricks
PySpark
Spark SQL
Python
SQL
Git
English proficiency

Tools

Azure Data Factory
Azure Data Lake Storage Gen2
Delta Lake
Lakehouse architecture
Spark

Job description

DataArt is seeking a Strong Middle / Senior Databricks Developer with Azure to build scalable data platforms and data pipelines within the Microsoft Azure ecosystem. You will work with Databricks, Spark, and Azure services to deliver reliable data engineering solutions.

The role focuses on developing high-performance PySpark solutions, designing Lakehouse architectures with Delta Lake, and collaborating across data teams to ensure governance and quality at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Databricks Engineer - Remote, Lakehouse Expert
Senior Azure Databricks Engineer - Remote, Lakehouse Expert

Dataflix • United States

Remote
USD 130,000 - 170,000
Senior Azure Databricks Lakehouse Architect
Senior Azure Databricks Lakehouse Architect

Programmers • Minneapolis (MN)

On-site
USD 120,000 - 170,000
Senior Databricks Data Engineer: Lakehouse on Azure (Hybrid)
Senior Databricks Data Engineer: Lakehouse on Azure (Hybrid)

Sapient Corporation • Houston (TX)

Hybrid
USD 104,000 - 120,000
Inclusive workplace and collaboration
Learning and development opportunities
Competitive compensation and benefits
+4
Senior Databricks Data Engineer - Azure & Delta Lake
Senior Databricks Data Engineer - Azure & Delta Lake

GAP • United States

Remote
USD 140,000 - 200,000
Senior Data Engineer - Databricks Lakehouse Architect
Senior Data Engineer - Databricks Lakehouse Architect

UNAVAILABLE • McLean (VA)

On-site
USD 120,000 - 160,000
Lead Databricks Engineer
Lead Databricks Engineer

Programmers • Minneapolis (MN)

On-site
USD 120,000 - 170,000
Senior Databricks Data Engineer and Lakehouse Architect
Senior Databricks Data Engineer and Lakehouse Architect

Celebal Technologies • Grand Rapids (MI)

Hybrid
USD 140,000 - 190,000
Senior Databricks Lakehouse Architect (PySpark/ETL)
Senior Databricks Lakehouse Architect (PySpark/ETL)

VService IT Solutions • United States

Remote
USD 140,000 - 190,000
Senior Databricks Lakehouse Engineer
Senior Databricks Lakehouse Engineer

Robotics Technologies • Louisville (KY)

On-site
USD 90,000 - 130,000
Azure Databricks Data Engineer — Lakehouse & Spark Expert
Azure Databricks Data Engineer — Lakehouse & Spark Expert

Quantum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 180,000