Senior Data Engineer

Tp; Lisboa; Presencial; EUR 65 000 - 90 000; Tempo integral

Resumo da oferta

Tp is seeking a senior Data Engineer to join its growing data team in Lisbon. You will design and optimize modern data solutions using Azure and Databricks, collaborating with data scientists, analysts, and business stakeholders.

The role emphasizes scalable pipelines, data governance, and security best practices, with mentorship of junior engineers and a strong focus on reliability and performance.

Qualificações

• 5+ years of experience in Data Engineering or related field.
• Strong expertise in Azure Cloud Services.
• Hands-on experience with Databricks, Spark (PySpark or Scala), and Delta Lake.
• Proficiency in SQL and Python.
• Experience with CI/CD and Infrastructure as Code tools such as Terraform, GitHub Actions, or Azure DevOps.
• Excellent communication and stakeholder management skills.
• Ability to work independently in a global environment.
• Nice to have: Kafka, Azure certifications, MLOps, data governance tools (Purview, Unity Catalog), and knowledge of GDPR or data security practices.

Responsabilidades

• Design and develop scalable data pipelines using Azure Data Factory, Databricks, and Apache Spark;
• Build and manage data lakes and Delta Lake solutions;
• Optimize data workflows for performance, scalability, and reliability;
• Implement data quality, governance, and security best practices;
• Collaborate with business and analytics teams to deliver data-driven solutions;
• Mentor junior engineers and contribute to technical best practices.

Conhecimentos

Azure

Databricks

Spark

Python

SQL

CI/CD

Terraform

GitHub Actions

Azure DevOps

Communication

Independent work

Ferramentas

Azure Data Factory

Delta Lake

Kafka

Purview

Unity Catalog

Descrição da oferta de emprego

Descrição do cargo

Join a growing data team where you'll play a key role in designing and optimizing modern data solutions using Azure and Databricks. You'll work alongside data scientists, analysts, and business stakeholders to build scalable, reliable, and impactful data products.

What you'll do

• Design and develop scalable data pipelines using Azure Data Factory, Databricks, and Apache Spark;
• Build and manage data lakes and Delta Lake solutions;
• Optimize data workflowsfor performance, scalability, and reliability;
• Implement data quality,governance, and security best practices;
• Collaborate with business and analytics teams to deliver data-driven solutions;
• Mentor junior engineersand contribute to technical best practices.

What you'll need

• 5+ years of experience in Data Engineering or a related field;
• Strong expertise in Azure Cloud Services;
• Hands‑on experience with Databricks, Spark (PySpark or Scala), and Delta Lake;
• Proficiency in SQL and Python;
• Experience with CI/CD and Infrastructure as Code tools such as Terraform, GitHub Actions, or Azure DevOps;
• Excellent communicationand stakeholder management skills;
• Ability to work independently in a global environment;
• Nice to have: Experience with Kafka or Azure Event Hubs, Azure certifications, MLOps, data governance tools (Purview, Unity Catalog), and knowledge of GDPR or data security practices.