Azure Databricks Data Engineer: Pipelines & Governance

Virtusa Corporation; Stockholms kommun; On-site; SEK 800,000 - 1,100,000; Full time

Job summary

Virtusa Corporation seeks a senior data engineer to architect and deliver cloud-native data solutions on Azure. You will leverage Azure Databricks, Unity Catalog, and Python for ETL/ELT, while ensuring governance, lineage, and scalable analytics across environments.

The role requires strong SQL skills, experience with Synapse Analytics and data lake storage, and hands-on CI/CD with modern tooling. Collaboration with cross-functional teams is essential for success.

Qualifications

• 5+ years of hands-on experience delivering end-to-end data solutions on Azure.
• Expertise with Azure Databricks and Unity Catalog for governance and large-scale processing.
• Advanced Python and SQL skills for ETL/ELT and data analysis.
• Solid CI/CD experience using Azure DevOps or GitHub Actions.
• Experience building cloud-native data pipelines and data integration workflows.

Responsibilities

• Design and implement end-to-end data pipelines on Azure.
• Set up and maintain CI/CD pipelines for data projects.
• Govern data access and lineage with Unity Catalog.
• Optimize SQL queries and data lake architectures on Azure.
• Collaborate with data science and analytics teams to deliver scalable solutions.

Skills

Azure Databricks

Unity Catalog

Python

PySpark

Pandas

NumPy

SQL

Azure SQL

Synapse Analytics

Tools

Git

Azure DevOps

GitHub Actions

Azure Data Lake

Blob Storage

Job description

Virtusa Corporation seeks a senior data engineer to architect and deliver cloud-native data solutions on Azure. You will leverage Azure Databricks, Unity Catalog, and Python for ETL/ELT, while ensuring governance, lineage, and scalable analytics across environments.

The role requires strong SQL skills, experience with Synapse Analytics and data lake storage, and hands-on CI/CD with modern tooling. Collaboration with cross-functional teams is essential for success.