Senior Data Engineer

Komodo Consulting; Lisboa; Híbrido; EUR 90 000 - 130 000; Tempo integral

Resumo da oferta

Komodo Consulting is seeking a Senior Data Engineer to design, build, and maintain end-to-end data solutions for a Tech Company. You will work across cloud platforms (AWS, GCP, Azure) and leverage Snowflake, Databricks, Spark, and Airflow to deliver reliable data pipelines.

You will collaborate with leadership and clients to ensure scalable data architectures, applying Kimball/OLAP modeling and modern CI/CD practices in a hybrid Lisbon setup.

Qualificações

• Minimum of 5 years of experience delivering end-to-end data solutions.
• Strong experience with cloud platforms (AWS, GCP, Azure).
• Proficiency with Snowflake, Databricks and Spark.
• Deep expertise in Apache Airflow and streaming with Kafka.
• Strong Python programming and advanced SQL skills.
• Solid data modeling knowledge including Kimball/OLAP concepts.
• Experience with CI/CD, Git and Terraform for IaC.
• Professional fluency in English and collaboration skills.

Responsabilidades

• Design, build, and maintain end-to-end data pipelines (real-time and batch).
• Ensure reliable data flow across architectures from ingestion to modeling-ready layers.
• Develop data systems across AWS, GCP, and Azure.
• Orchestrate and monitor workflows with Apache Airflow.
• Automate data processes using Python and APIs.
• Apply data modeling techniques for scalable architectures.
• Collaborate with leadership and clients to deliver robust solutions.

Conhecimentos

Python

SQL

Data modeling

Airflow

Kafka

CI/CD

Git

Communication

Ferramentas

Snowflake

Databricks

Spark

AWS

GCP

Azure

Terraform

Descrição da oferta de emprego

About Us

Komodo Consulting is a technology and strategy firm specializing in Digital Transformation. Operating in Portugal and Poland, we provide IT Consulting & Nearshore services. We support both public and private sector organizations through two main areas:

• Consulting — with a focus on strategy, investment analysis, and digital process improvement;
• IT Team Augmentation — helping clients scale and strengthen their tech teams.

Komodo Consulting is a technology and strategy firm specializing in Digital Transformation. Operating in Portugal and Poland, we provide IT Consulting & Nearshore services. We support both public and private sector organizations through two main areas:

• Consulting — with a focus on strategy, investment analysis, and digital process improvement;
• IT Team Augmentation — helping clients scale and strengthen their tech teams.

The Project

We are seeking a Senior Data Engineer to work on a project for a Tech Company.

You will have the following responsibilities:

• Design, build, and maintain end-to-end data solutions, including real-time and batch data pipelines;
• Ensure reliable data flow across architectures, from raw ingestion to modeling-ready layers;
• Develop and manage data ecosystems across cloud platforms such as AWS, GCP, and Azure;
• Orchestrate and monitor workflows using Apache Airflow;
• Build and automate data processes and services using Python;
• Apply advanced data modeling techniques (Kimball, Inmon, Data Vault) to design scalable data architectures;
• Collaborate with leadership and clients to deliver robust and scalable data solutions.

You need to have the following skills/experience:

• Minimum of 5 years of experience as a Data Engineer delivering end-to-end solutions;
• Strong experience working with cloud platforms such as AWS, GCP, or Azure;
• Proficiency in modern data platforms including Snowflake, Databricks, and Spark;
• Deep expertise in Apache Airflow and familiarity with streaming technologies such as Kafka;
• Strong programming skills in Python and advanced SQL capabilities;
• Solid understanding of data modeling methodologies, particularly Kimball, and OLAP systems;
• Experience with CI/CD practices, version control systems such as Git, and Infrastructure as Code tools like Terraform;
• Professional fluency in English and strong collaboration and communication skills.

Location

Lisbon, Hybrid (2 times a week at the office).