Lead Data Engineer: Azure Databricks & Medallion Architecture

InnoWave; Lisboa; Presencial; EUR 90 000 - 120 000; Tempo integral

Resumo da oferta

InnoWave in Portugal is seeking a Senior Data Engineer to design and implement ETL/ELT data pipelines using Medallion Architecture, working with structured and unstructured data, and translating business needs into data solutions.

You will mentor engineering teams, develop dashboards and reports, collaborate with cross-functional teams, and communicate complex technical concepts to English-speaking stakeholders.

Qualificações

• Bachelor's degree in Computer Science or equivalent.
• 6+ years of professional experience in Data/Software Engineering or related field.
• 3+ years in a Technical Lead / Lead Engineer role with mentoring experience.
• Strong hands-on with Azure Databricks, Databricks Jobs/Workflows, Notebooks, SQL Warehouses, Delta Lake, Unity Catalog.
• Strong SQL, Python, and PySpark skills with data transformation and optimization.
• Experience with Azure DevOps, Git workflows, CI/CD pipelines and deployment automation.
• Experience deploying Databricks across Development, QA, Production environments.
• Excellent communication with stakeholders and ability to lead technical discussions.

Responsabilidades

• Design and implement ETL/ELT data pipelines and Medallion Architecture (Bronze, Silver, Gold).
• Work with structured and unstructured data and generate insights to support decisions.
• Analyze data and translate business needs into data solutions.
• Act as liaison between technical teams and business stakeholders.
• Develop dashboards and reports for decision making.
• Collaborate with cross-functional teams and provide technical direction.
• Mentor engineering teams and guide technical decisions.

Conhecimentos

Azure Databricks

SQL

Python

PySpark

Data pipelines

Mentoring

Formação académica

Degree in Computer Science

Ferramentas

Azure DevOps

Git

Descrição da oferta de emprego

InnoWave in Portugal is seeking a Senior Data Engineer to design and implement ETL/ELT data pipelines using Medallion Architecture, working with structured and unstructured data, and translating business needs into data solutions.

You will mentor engineering teams, develop dashboards and reports, collaborate with cross-functional teams, and communicate complex technical concepts to English-speaking stakeholders.