Data Engineer

IT People Innovation; Lisboa; Presencial; EUR 70 000 - 95 000; Tempo integral

Resumo da oferta

IT People Innovation is seeking a Senior/Lead Data Engineer to design and build cloud-native data pipelines within Microsoft environments. The role focuses on data architecture, modelling, and scalable analytics to support business decisions.

The candidate will work on ingestion, storage, and orchestration of data assets, leveraging tools like Azure Data Factory, Synapse, and related data lake/warehouse technologies, with strong emphasis on performance and cost efficiency.

Qualificações

• Minimum 5 years of experience in data engineering with cloud-native solutions.
• Experience in end-to-end data architecture and design (ingestion, modeling, storage, orchestration).
• Proficiency with Microsoft technologies (Fabric, Azure Data Factory, Synapse).
• Experience with data warehousing and data lake solutions (BigQuery, Azure Data Lake, Delta Lake, Redshift).
• Proficiency in Python, SQL, or Spark with related libraries (Pandas, Boto3).
• Strong knowledge of RDBMS or NoSQL databases (Oracle, MS SQL Server, MongoDB, ElasticSearch, GBQ).
• Experience with DevOps/DataOps, CI/CD pipelines.
• Ability to implement data validation, lineage, documentation, and monitoring at scale.
• Proven ability to optimize pipelines and storage for performance, cost, reliability.
• English should be at least B2.

Conhecimentos

End-to-end data architecture

Ingestion

Data modelling

Data storage

Data orchestration

Cloud-native engineering

Microsoft technologies

Azure Data Factory

Azure Synapse

BigQuery

Azure Data Lake

Delta Lake

Amazon Redshift

Python

SQL

Spark

RDBMS

NoSQL databases

DevOps/DataOps

CI/CD pipelines

Data validation

Data lineage

Documentation

Monitoring

Pandas

Boto3

SQL tooling

Ferramentas

Pandas

Boto3

SQL tooling

Spark

Descrição da oferta de emprego

We are seeking a skilled Senior / Lead Data Engineer with expertise in cloud-native data pipeline development within Microsoft environments. The ideal candidate will have a strong background in data architecture, data modelling, and the ability to implement high-performance data solutions that support our business objectives. You will play a key role in driving data-driven decision-making and enabling scalable analytics solutions across the organization.

Required Qualifications

to be successful for both roles (Senior/Lead profiles):

Technical Skills

• Strong experience in end-to-end data architecture and design, including ingestion, modeling, storage, and orchestration (ex. Medallion).
• Proficiency in cloud-native engineering, with a focus on Microsoft technologies (Fabric, Azure Data Factory, Synapse) but open to other cloud platforms (AWS, Google Cloud) with comparable tools.
• Hands-on experience with data warehousing and data lake solutions (e.g., BigQuery, Azure Data Lake, Delta Lake, Amazon Redshift).
• Proficiency in programming languages such as Python (with data-related libraries: e.g. Pandas, Boto3), SQL, or Spark.
• Strong knowledge of RDBMS (e.g., Oracle, MS SQL Server) or NoSQL databases (e.g., MongoDB, ElasticSearch, GBQ).
• Experience with DevOps/DataOps practices, including CI/CD pipelines.
• Ability to implement data validation, lineage, documentation, and monitoring at scale.
• Proven ability to optimize pipelines and storage solutions for performance, cost, and reliability.
• Experience:

Minimum 5 years of experience in data engineering, with a focus on cloud-native solutions and data architecture.

English proficiency

should be at least B2 level.