Senior Data Engineer: Build Scalable Azure Data Pipelines

InnoTech; Porto; Presencial; EUR 60.000 - 90.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Mental health support

25 vacation days

Birthday & holidays

Petsitting partnerships

Team-building events

InnoSports initiatives

Sustainability events

Descripción de la vacante

InnoTech in Porto seeks a Senior Data Engineer to design and scale data pipelines using Azure Databricks and Synapse. You will build bronze, silver, and gold layers, integrating diverse data sources with a focus on quality and cost efficiency.

You bring 5+ years of experience in Python, PySpark, and SQL, plus hands-on Azure data services and data modeling. The role emphasizes collaboration, governance, and continual improvement within a supportive team.

Formación

• Minimum 5 years as a Data Engineer or similar.
• Strong proficiency in Python, PySpark, and SQL.
• Hands-on experience with Azure Databricks (mandatory), Synapse and data services.
• Familiarity with modern data architectures and data modeling.
• Experience with CI/CD, Git, and IaC tools.

Responsabilidades

• Design, build, and maintain scalable data pipelines and transformations.
• Create bronze, silver, and gold data layers from multiple sources.
• Ensure data quality, governance, and cost optimization.
• Collaborate with Data Architects, BAs, and stakeholders to translate requirements into solutions.
• Automate data workflows, testing, and deployments via CI/CD pipelines.

Conocimientos

Python

PySpark

SQL

CI/CD

Git

Azure DevOps

Terraform

Educación

BSc or MSc in CS/Engineering/IT

Herramientas

Azure Databricks

Azure Synapse

Azure Data Lake Storage

Azure Data Factory

Terraform

Descripción del empleo

InnoTech in Porto seeks a Senior Data Engineer to design and scale data pipelines using Azure Databricks and Synapse. You will build bronze, silver, and gold layers, integrating diverse data sources with a focus on quality and cost efficiency.

You bring 5+ years of experience in Python, PySpark, and SQL, plus hands-on Azure data services and data modeling. The role emphasizes collaboration, governance, and continual improvement within a supportive team.