Senior Big Data Engineer - Databricks & Azure

Aubay Portugal; Lisboa; Híbrido; EUR 42 000 - 65 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Dental coverage

Mental health platform

Team events

Language platform

Hybrid work model

Resumo da oferta

At Aubay Portugal, we collaborate with leading organisations across banking, insurance, telecoms and energy to design, build and optimise data and BI solutions that scale for millions of users.

We look for hands-on data professionals with 3+ years in consulting or development, strong Databricks, Python, Spark skills, and solid Azure experience to help create robust data pipelines, ETL, CI/CD, and reliable data platforms.

Qualificações

• 3+ years of experience in consulting or development, preferably with Microsoft Data technologies.
• Strong hands-on experience with Big Data environments, especially Databricks, utilizing Python and Apache Spark.
• Solid software engineering mindset, with proven ability to design, build, test, and maintain data and BI components.
• Experience with the Azure ecosystem, including Azure Data Factory, Data Lake Gen2, and Azure DevOps tools.
• Proficiency in SQL Server (on-premises) and T-SQL, with knowledge of performance optimization for data processing.
• Fluency in English (B2 or higher) is mandatory for effective communication within the team.

Responsabilidades

• Design, build, test, and maintain robust data and BI components.
• Develop and implement fault-tolerant data pipelines for large-scale data processing.
• Ensure system reliability with logging, monitoring, and error-handling mechanisms.
• Create data integration solutions using ETL processes and REST APIs to improve data access.
• Apply CI/CD practices for continuous delivery and deployment of data solutions.
• Perform database administration and data maintenance tasks, including data cleansing, to ensure data quality.

Conhecimentos

Databricks

Python

Apache Spark

SQL Server

Azure

English (B2+)

Ferramentas

Azure Data Factory

Data Lake Gen2

Azure DevOps

Descrição da oferta de emprego

At Aubay Portugal, we collaborate with leading organisations across banking, insurance, telecoms and energy to design, build and optimise data and BI solutions that scale for millions of users.

We look for hands-on data professionals with 3+ years in consulting or development, strong Databricks, Python, Spark skills, and solid Azure experience to help create robust data pipelines, ETL, CI/CD, and reliable data platforms.