Lead Data Engineer - Cloud-Native Analytics & Pipelines

IT People Innovation; Lisboa; Presencial; EUR 70 000 - 95 000; Tempo integral

Resumo da oferta

IT People Innovation is seeking a Senior/Lead Data Engineer to design and build cloud-native data pipelines within Microsoft environments. The role focuses on data architecture, modelling, and scalable analytics to support business decisions.

The candidate will work on ingestion, storage, and orchestration of data assets, leveraging tools like Azure Data Factory, Synapse, and related data lake/warehouse technologies, with strong emphasis on performance and cost efficiency.

Qualificações

• Minimum 5 years of experience in data engineering with cloud-native solutions.
• Experience in end-to-end data architecture and design (ingestion, modeling, storage, orchestration).
• Proficiency with Microsoft technologies (Fabric, Azure Data Factory, Synapse).
• Experience with data warehousing and data lake solutions (BigQuery, Azure Data Lake, Delta Lake, Redshift).
• Proficiency in Python, SQL, or Spark with related libraries (Pandas, Boto3).
• Strong knowledge of RDBMS or NoSQL databases (Oracle, MS SQL Server, MongoDB, ElasticSearch, GBQ).
• Experience with DevOps/DataOps, CI/CD pipelines.
• Ability to implement data validation, lineage, documentation, and monitoring at scale.
• Proven ability to optimize pipelines and storage for performance, cost, reliability.
• English should be at least B2.

Conhecimentos

End-to-end data architecture

Ingestion

Data modelling

Data storage

Data orchestration

Cloud-native engineering

Microsoft technologies

Azure Data Factory

Azure Synapse

BigQuery

Azure Data Lake

Delta Lake

Amazon Redshift

Python

SQL

Spark

RDBMS

NoSQL databases

DevOps/DataOps

CI/CD pipelines

Data validation

Data lineage

Documentation

Monitoring

Pandas

Boto3

SQL tooling

Ferramentas

Pandas

Boto3

SQL tooling

Spark

Descrição da oferta de emprego

IT People Innovation is seeking a Senior/Lead Data Engineer to design and build cloud-native data pipelines within Microsoft environments. The role focuses on data architecture, modelling, and scalable analytics to support business decisions.

The candidate will work on ingestion, storage, and orchestration of data assets, leveraging tools like Azure Data Factory, Synapse, and related data lake/warehouse technologies, with strong emphasis on performance and cost efficiency.