Databricks Engineer: Lakehouse & PySpark Expert

Adecco Recruitment; Lisboa; Presencial; EUR 70 000 - 110 000; Tempo integral

Resumo da oferta

Adecco Recruitment is helping a world-renowned technology consulting client recruit a Databricks Engineer in Lisbon, with flexible hybrid work. The role focuses on modern data platforms for banking/finance and data products across global markets.

You will join an international team delivering end-to-end Databricks pipelines, applying best practices in lakehouse architectures, CI/CD, and governance. Strong PySpark, ADF, Airflow, and Azure DevOps experience are essential.

Qualificações

• Strong, demonstrable experience with Databricks as the primary engineering platform.
• Solid understanding of Medallion Architecture and modern lakehouse principles.
• Proficiency in PySpark and distributed processing frameworks.

Responsabilidades

• Build, optimize and maintain end-to-end Databricks pipelines, ensuring performance, reliability and scalability.
• Apply Medallion Architecture principles to design structured, maintainable and production-ready data layers.
• Develop distributed processing solutions with PySpark, aligned with best engineering practices.
• Design and orchestrate workflows using ADF and Airflow, improving automation and observability.
• Contribute to the evolution of Databricks Lakehouse standards, performance tuning and cluster optimization.
• Integrate CI/CD practices using Azure DevOps, with automated testing and version control.
• Collaborate closely with data scientists, architects and business stakeholders to operationalize data products and ensure alignment with financial-sector requirements.
• Support governance, security and documentation across the Databricks ecosystem.

Conhecimentos

Databricks

Medallion Architecture

PySpark

Azure Data Factory

Airflow

Azure DevOps

Git workflows

Agile

Ferramentas

Azure Data Factory

Airflow

Azure DevOps

Git

Descrição da oferta de emprego

Adecco Recruitment is helping a world-renowned technology consulting client recruit a Databricks Engineer in Lisbon, with flexible hybrid work. The role focuses on modern data platforms for banking/finance and data products across global markets.

You will join an international team delivering end-to-end Databricks pipelines, applying best practices in lakehouse architectures, CI/CD, and governance. Strong PySpark, ADF, Airflow, and Azure DevOps experience are essential.