Senior Databricks Engineer on Azure — Remote

Devsu

United States

Remote

USD 140,000 - 190,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Stable long-term contract
Private health insurance
Remote-friendly culture
Continuous training & mentorship
Free AI training resources
Flexible PTO & holidays

Job summary

Devsu is seeking a Senior Data Engineer with advanced Databricks on Azure experience to design, build, modernise, and operate scalable data pipelines for Tax technology platforms.

You will migrate Spark and Python workloads to cloud-native platforms, build ingestion pipelines, and enforce data quality, observability, and security. Collaborate with architects, SMEs, and platform teams to improve maintainability and performance.

Qualifications

  • 5+ years of experience in data engineering or equivalent.
  • Strong Python development experience with Spark-based workloads.
  • Advanced, hands-on Databricks on Azure experience in production.
  • Strong SQL and data modelling skills.
  • Experience building, testing, deploying, and troubleshooting ETL/ELT pipelines.
  • Experience with Git-based source control and CI/CD pipelines (e.g., Azure DevOps).
  • Experience consuming REST APIs for data ingestion with error handling.

Responsibilities

  • Design, build, and support scalable data pipelines using Python, Spark, PySpark, and Databricks on Azure.
  • Modernise and migrate legacy data processing workloads to secure, cloud-native platforms.
  • Build and maintain batch data ingestion pipelines from structured and unstructured sources.
  • Integrate data from REST APIs, SharePoint, document repositories, and cloud platforms.
  • Implement data quality, monitoring, observability, and operational controls.
  • Optimise data workloads for performance, scalability, reliability, and cost efficiency.
  • Develop document extraction, classification, and automation pipelines.
  • Apply software engineering practices including Git, CI/CD, automated testing, and code reviews.
  • Build, deploy, troubleshoot, and maintain production ETL/ELT pipelines.
  • Collaborate with architects, developers, tax SMEs, and platform teams.
  • Analyse codebases to identify gaps and practical improvements.

Skills

Python development
Apache Spark / PySpark
Databricks on Azure
SQL / data modeling
ETL/ELT pipelines
REST APIs data ingestion
Automated tests for data pipelines
CI/CD (Git, Azure DevOps)
Data quality & observability
Problem solving & collaboration
AI-assisted development tools

Tools

Azure DevOps
Git
Delta Lake
Unity Catalog
ADLS Gen2
Azure Data Factory
CI/CD tooling

Job description

Devsu is seeking a Senior Data Engineer with advanced Databricks on Azure experience to design, build, modernise, and operate scalable data pipelines for Tax technology platforms.

You will migrate Spark and Python workloads to cloud-native platforms, build ingestion pipelines, and enforce data quality, observability, and security. Collaborate with architects, SMEs, and platform teams to improve maintainability and performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer – Azure ADF/Databricks | Remote
Senior Data Engineer – Azure ADF/Databricks | Remote

Danta Technologies • United States

Remote
USD 68,000 - 97,000
Healthcare insurance
Paid holidays
Paid sick leave
Remote Senior Data Engineer – Azure & BI Pipelines Leader
Remote Senior Data Engineer – Azure & BI Pipelines Leader

wppmedia • United States

Remote
USD 120,000 - 180,000
Senior Data Engineer - Remote US | Databricks + Azure
Senior Data Engineer - Remote US | Databricks + Azure

Careaccess • United States

Remote
USD 120,000 - 160,000
Paid time off
Employer-paid medical, dental, and 
d
HSA and FSA plans
+2
Senior Databricks Engineer — Remote Data Pipelines & dbt
Senior Databricks Engineer — Remote Data Pipelines & dbt

PwC • United States

Remote
USD 13,000 - 18,000
English and Polish language courses
Remote Azure Data Engineer — Pipelines & Spark
Remote Azure Data Engineer — Pipelines & Spark

ConsultNet Technology Services and Solutions • United States

Remote
MXN 725,000 - 949,000
Senior Data Platform Engineer - Azure Databricks & DevOps
Senior Data Platform Engineer - Azure Databricks & DevOps

CVS Health • Illinois

Hybrid
USD 102,000 - 204,000
Remote Data Engineering Consultant — Azure, Spark & Pipelines
Remote Data Engineering Consultant — Azure, Spark & Pipelines

Advancing Analytics • United States

Remote
USD 120,000 - 180,000
Remote work (UK-based)
Occasional travel
Senior Data Engineer (Databricks on Azure)
Senior Data Engineer (Databricks on Azure)

Devsu • United States

Remote
USD 140,000 - 190,000
Stable long-term contract
Private health insurance
Remote-friendly culture
+3
Senior Azure Data Engineer – Remote with Databricks
Senior Azure Data Engineer – Remote with Databricks

DCV Technologies • United States

Remote
USD 96,000 - 152,000
Stable long-term cooperation with 100%
Modern technologies in an Intl. team
Professional growth
+1
Senior Databricks Data Engineer - Real-Time Azure Platform
Senior Databricks Data Engineer - Real-Time Azure Platform

CTI Consulting • Quincy (MA)

On-site
USD 140,000 - 190,000