Senior Data Engineer

TMC; Lisboa; Presencial; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

TMC is seeking a Senior Data Engineer to design and implement cloud-native data pipelines in a Microsoft-centric environment. You will shape data architecture, modeling, and scalable analytics across the organization.

The role emphasizes hands-on work with data warehousing and data lake solutions while leveraging Python, SQL, Spark, and modern cloud services. Strong English skills are required, and collaboration across teams is essential.

Qualificações

• Minimum 5 years of experience in data engineering with cloud-native solutions and data architecture.
• English proficiency at least B2 level.

Responsabilidades

• End-to-end data architecture and design: ingestion, modeling, storage, and orchestration.
• Cloud-native engineering focused on Microsoft technologies (Fabric, ADF, Synapse) with open to AWS/GCP equivalents.
• Hands-on data warehousing and data lake experience (BigQuery, Azure Data Lake, Delta Lake, Redshift).
• Proficiency in Python (Pandas, Boto3), SQL, or Spark.
• Experience with RDBMS (Oracle, MS SQL Server) or NoSQL (MongoDB, ElasticSearch, GBQ).
• DevOps/DataOps practices including CI/CD pipelines.
• Implement data validation, lineage, documentation, and monitoring at scale.
• Optimize pipelines and storage for performance, cost, and reliability.

Conhecimentos

Data architecture

Cloud-native engineering

Microsoft technologies

Python

SQL

Spark

RDBMS

NoSQL databases

CI/CD

Data lineage

Monitoring

Ferramentas

BigQuery

Azure Data Lake

Delta Lake

Azure Synapse

Redshift

Descrição da oferta de emprego

We are seeking a skilled Senior Data Engineer with expertise in cloud-native data pipeline development within Microsoft environments. The ideal candidate will have a strong background in data architecture, data modelling, and the ability to implement high-performance data solutions that support our business objectives. You will play a key role in driving data-driven decision-making and enabling scalable analytics solutions across the organization.

About the Role

Required Qualifications to be successful for the senior role:

Responsibilities

• Strong experience in end-to-end data architecture and design, including ingestion, modeling, storage, and orchestration (ex. Medallion).
• Proficiency in cloud-native engineering, with a focus on Microsoft technologies (Fabric, Azure Data Factory, Synapse) but open to other cloud platforms (AWS, Google Cloud) with comparable tools.
• Hands‑on experience with data warehousing and data lake solutions (e.g., BigQuery, Azure Data Lake, Delta Lake, Amazon Redshift).
• Proficiency in programming languages such as Python (with data-related libraries: e.g. Pandas, Boto3), SQL, or Spark.
• Strong knowledge of RDBMS (e.g., Oracle, MS SQL Server) or NoSQL databases (e.g., MongoDB, ElasticSearch, GBQ).
• Experience with DevOps/DataOps practices, including CI/CD pipelines.
• Ability to implement data validation, lineage, documentation, and monitoring at scale.
• Proven ability to optimize pipelines and storage solutions for performance, cost, and reliability.

Qualifications

• Minimum 5 years of experience in data engineering, with a focus on cloud-native solutions and data architecture.
• English proficiency should be at least B2 level.

Required Skills

• Ability to evaluate trade-offs and make clear, defensible technical choices.
• Translate complex engineering decisions into clear, accurate explanations for non-technical stakeholders.
• Uplift and mentor mid/junior engineers, enforce standards, and foster a collaborative technical culture.
• Break down ambiguous, complex problems into clear, actionable steps and drive them to resolution.
• Take responsibility for outcomes, anticipate issues, and drive long-term platform evolution.