Cloud Data Engineer: Azure Databricks Lakehouse (Hybrid)

Solvex Solutions; Malmö kommun; Hybrid; SEK 520,000 - 800,000; Full time

Job summary

Solvex Solutions is seeking an experienced Data Engineer to design, develop, and optimise scalable, cloud-based data platforms using Azure Databricks, Apache Spark and Delta Lake. You will own end-to-end data engineering solutions from architecture and pipeline development to deployment and production support.

The role requires hands-on expertise with Databricks notebooks, CI/CD, and IaC, plus strong data modelling and collaboration skills.

Qualifications

• Strong hands-on experience with Azure Databricks, Apache Spark and Delta Lake.
• Proven experience developing end-to-end batch and streaming data pipelines.
• Strong understanding of lakehouse architecture and data modelling.
• Experience with Microsoft Azure and Azure Data Lake Storage.
• Hands-on experience with Databricks notebooks, job orchestration and performance tuning.
• Strong Git, CI/CD, automated testing and Infrastructure as Code experience.
• Experience with data validation, monitoring and production troubleshooting.
• Ability to contribute to solution architecture and technical design.
• Strong communication and stakeholder collaboration skills.

Responsibilities

• Design and develop scalable batch and streaming data pipelines.
• Build and optimise data solutions using Azure Databricks, Apache Spark and Delta Lake.
• Develop and maintain data ingestion, transformation and serving layers.
• Implement lakehouse architectures and data models.
• Manage Databricks notebooks, job orchestration and performance optimisation.
• Work with Azure Data Lake Storage (ADLS) and cloud-native data services.
• Implement CI/CD pipelines, automated testing and Infrastructure as Code.
• Ensure data quality, reliability, monitoring and cost efficiency.
• Support production troubleshooting and continuous platform improvements.

Skills

Azure Databricks

Apache Spark

Delta Lake

Batch & streaming pipelines

CI/CD

Infrastructure as Code

Data modelling

ADLS

Tools

Databricks notebooks

Job orchestration

Azure Data Lake Storage

CI/CD tooling

Job description

Solvex Solutions is seeking an experienced Data Engineer to design, develop, and optimise scalable, cloud-based data platforms using Azure Databricks, Apache Spark and Delta Lake. You will own end-to-end data engineering solutions from architecture and pipeline development to deployment and production support.

The role requires hands-on expertise with Databricks notebooks, CI/CD, and IaC, plus strong data modelling and collaboration skills.