Senior Data Engineer

TP; Lisboa; Presencial; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

TP in Lisbon is seeking a senior Data Engineer to design and optimize modern data solutions using Azure and Databricks. You will collaborate with data scientists, analysts, and stakeholders to build scalable, reliable data products for the business.

You will own pipelines, data lakes, governance, and security, mentor junior engineers, and help establish best practices. The role requires strong Azure, Databricks, SQL, Python, and CI/CD skills in a global, collaborative environment.

Qualificações

• 5+ years of data engineering experience.
• Strong expertise in Azure Cloud Services.
• Hands-on with Databricks, Spark, and Delta Lake.
• Proficient in SQL and Python.
• Experience with CI/CD and Infrastructure as Code tools such as Terraform, GitHub Actions, or Azure DevOps.
• Excellent communication and stakeholder management skills.

Responsabilidades

• Design scalable data pipelines with Azure Data Factory, Databricks, and Spark.
• Build and manage data lakes and Delta Lake solutions.
• Optimize data workflows for performance and reliability.
• Implement data quality, governance, and security best practices.
• Collaborate with business and analytics teams to deliver data-driven solutions.
• Mentor junior engineers and contribute to technical best practices.

Conhecimentos

SQL

Python

Stakeholder management

Communication

Independent work

Ferramentas

Azure Data Factory

Databricks

Apache Spark

Delta Lake

Terraform

GitHub Actions

Azure DevOps

Descrição da oferta de emprego

Join a growing data team where you'll play a key role in designing and optimizing modern data solutions using Azure and Databricks. You'll work alongside data scientists, analysts, and business stakeholders to build scalable, reliable, and impactful data products.

What you'll do

• Design and develop scalable data pipelines using Azure Data Factory, Databricks, and Apache Spark;
• Build and manage data lakes and Delta Lake solutions;
• Optimize data workflows for performance, scalability, and reliability;
• Implement data quality, governance, and security best practices;
• Collaborate with business and analytics teams to deliver data-driven solutions;
• Mentor junior engineers and contribute to technical best practices.

What you'll need

• 5+ years of experience in Data Engineering or a related field;
• Strong expertise in Azure Cloud Services;
• Hands-on experience with Databricks, Spark (PySpark or Scala), and Delta Lake;
• Proficiency in SQL and Python;
• Experience with CI/CD and Infrastructure as Code tools such as Terraform, GitHub Actions, or Azure DevOps;
• Excellent communication and stakeholder management skills;
• Ability to work independently in a global environment;
• Nice to have: Experience with Kafka or Azure Event Hubs, Azure certifications, MLOps, data governance tools (Purview, Unity Catalog), and knowledge of GDPR or data security practices.