Senior Databricks Data Engineer on Azure | Remote

Devsu; Argentina; Remote; ARS 1,800,000 - 3,000,000; Full time

Benefits offered by this job

Stable, long-term contract

Remote-friendly culture

Continuous training

AI training resources

Flexible PTO

Paid holidays

Job summary

Devsu is seeking a Senior Data Engineer with advanced, hands-on Databricks on Azure experience to design, build, modernise and operate scalable data pipelines supporting Tax technology platforms.

You will migrate and enhance Spark and Python workloads on Azure Databricks, build ingestion and document-processing capabilities, and collaborate with architects, tax SMEs, and platform teams to improve maintainability, security, and reliability.

Qualifications

• 5+ years of experience in data engineering.
• Strong Apache Spark and PySpark experience.
• Advanced, hands-on Databricks on Azure experience in production (Delta Lake, Unity Catalogue, Workflows/Jobs, ADLS Gen2, Azure Data Factory).
• Strong SQL and data modelling skills.
• Experience building, testing, deploying, and troubleshooting production ETL/ELT pipelines.
• Experience with Git-based source control and CI/CD pipelines (e.g., Azure DevOps).
• Experience consuming REST APIs for data ingestion, including authentication, pagination, and failure handling.
• Experience writing automated tests for data pipelines.
• Strong understanding of data quality, reliability, and data engineering best practices.
• Strong problem-solving, communication, and collaboration skills, with sound judgement to analyse unfamiliar codebases, identify gaps and trade-offs, challenge requirements and propose practical improvements.

Responsibilities

• Design, build, and support scalable data pipelines using Python, Apache Spark, PySpark, and Databricks on Azure.
• Modernise and migrate legacy data processing workloads to secure, cloud-native platforms.
• Build and maintain batch data ingestion pipelines from structured and unstructured sources.
• Integrate data from REST APIs, SharePoint, document repositories, enterprise applications, and cloud platforms.
• Implement data quality, monitoring, observability, and operational controls.
• Optimise data workloads for performance, scalability, reliability, and cost efficiency.
• Develop document extraction, classification, metadata enrichment, and automation pipelines.
• Apply software engineering practices, including Git, CI/CD, automated testing, and code reviews.
• Build, deploy, troubleshoot, and maintain production ETL/ELT pipelines.
• Collaborate with architects, developers, tax subject matter experts, and platform teams.
• Analyse existing codebases and identify opportunities to improve maintainability, security, and reliability.
• Use AI-assisted development tools to build, review, test, and maintain data pipeline code.

Skills

Data engineering

Spark/PySpark

Databricks on Azure

SQL & data modelling

ETL/ELT pipelines

Git CI/CD

REST API ingestion

Automated testing

Data quality

Problem solving

Tools

Delta Lake

Unity Catalog

ADLS Gen2

Azure Data Factory

Azure DevOps

Job description

Devsu is seeking a Senior Data Engineer with advanced, hands-on Databricks on Azure experience to design, build, modernise and operate scalable data pipelines supporting Tax technology platforms.

You will migrate and enhance Spark and Python workloads on Azure Databricks, build ingestion and document-processing capabilities, and collaborate with architects, tax SMEs, and platform teams to improve maintainability, security, and reliability.