Senior Data Engineer — Databricks & Azure Orchestration

Acuity Analytics; Lisboa; On-site; EUR 48,000 - 75,000; Full time

Job summary

Acuity Analytics is seeking a Data Engineer in Lisbon to design, build and manage scalable data solutions in a cloud-native environment, focusing on automation, performance and collaboration.

You will build Databricks workflows, deploy PyFunc models, secure secrets with Azure Key Vault, design ETL/ELT pipelines, govern data with Unity Catalog and enable event-driven workflows with Azure Service Bus.

Qualifications

• Strong Python programming for data engineering, automation and integration.
• Experience writing modular, production-ready code.
• CI/CD pipelines for Databricks and Azure.

Responsibilities

• Build and manage Databricks Workflows for large-scale data orchestration.
• Develop and deploy PyFunc models and integrate them into production pipelines.
• Implement secure secrets and configuration management using Azure Key Vault.
• Design and optimize ETL / ELT pipelines following best practices.
• Gover and manage data assets with Unity Catalog and Data Lakehouse patterns.
• Implement messaging and event-driven workflows with Azure Service Bus.
• Collaborate with architects, analysts and data scientists to deliver end-to-end solutions.

Skills

Python for data engineering

Production-grade code

CI/CD for Databricks & Azure

Tools

Databricks

Azure

Unity Catalog

Azure Service Bus

Job description

Acuity Analytics is seeking a Data Engineer in Lisbon to design, build and manage scalable data solutions in a cloud-native environment, focusing on automation, performance and collaboration.

You will build Databricks workflows, deploy PyFunc models, secure secrets with Azure Key Vault, design ETL/ELT pipelines, govern data with Unity Catalog and enable event-driven workflows with Azure Service Bus.