Data Engineer (overall)

Komodo Consulting; Lisboa; Hybrid; EUR 55,000 - 75,000; Full time

Job summary

Komodo Consulting is seeking a Data Engineer to design, build, and maintain scalable data pipelines for a Technology Company. You will develop ETL/ELT processes, optimise data models for warehouses or lakehouses, and ensure data quality and governance across systems.

Requirements include 3+ years in data engineering, strong SQL and Python, experience with Spark and at least one cloud platform (AWS/Azure/GCP). Hybrid work with 2 days in the office in Portugal.

Qualifications

• 3+ years of data engineering experience.
• Strong SQL and Python (Scala/Java a plus).
• Experience with distributed data processing (e.g., Spark).
• Experience with at least one cloud platform (AWS/Azure/GCP).
• Knowledge of data warehouse/lakehouse tech (Snowflake, Databricks, BigQuery, Synapse).
• Experience with orchestration tools (Airflow, ADF, dbt).
• Understanding of dimensional modelling and star schemas.
• Familiarity with Kafka or similar streaming tech.
• Git, CI/CD, and Docker experience is valued.
• English proficiency at B2+.

Responsibilities

• Design, build, and maintain scalable data pipelines (batch and streaming).
• Develop ETL/ELT processes to ingest, transform, integrate data.
• Design/optimise data models for warehouses or lakehouses.
• Ensure data quality, validation, monitoring, and reliability.
• Optimise performance and cost of data processing/storage.
• Implement data governance, security, access controls.
• Automate data workflows and deployments (CI/CD).
• Collaborate with analysts and data scientists to deliver solutions.
• Troubleshoot data issues and document technical details.

Skills

SQL

Python

Apache Spark

Cloud data platforms

Data warehousing

ETL/ELT

Airflow

dbt

Kafka

Git & CI/CD

Docker

Schema modelling

English (B2+)

Tools

Snowflake

Databricks

BigQuery

Synapse

Job description

About Us

Komodo Consulting is a technology and strategy firm specializing in Digital Transformation. Operating in Portugal and Poland, we provide IT Consulting & Nearshore services. We support both public and private sector organizations through two main areas:

- Consulting - with a focus on strategy, investment analysis, and digital process improvement;

- IT Team Augmentation - helping clients scale and strengthen their tech teams.

The Project

We are seeking a Data Engineer to work on a project for a Technology Company.

You will have the following responsibilities:

• Design, build, and maintain scalable data pipelines, both batch and streaming;
• Develop ETL/ELT processes to ingest, transform, and integrate data from multiple sources;
• Design and optimise data models for data warehouses, data lakes, or lakehouses;
• Ensure data quality, consistency, and reliability through validation and monitoring;
• Optimise the performance and cost of data processing and storage;
• Implement data governance, security, and access control practices;
• Automate data workflows and deployments using orchestration and CI/CD tools;
• Collaborate with data analysts, data scientists, and business teams to deliver effective data solutions;
• Troubleshoot data issues, identify root causes, and propose effective solutions;
• Produce and maintain up-to-date technical documentation.

You need to have the following skills/experience:

• 3+ years of solid experience in data engineering;
• Strong proficiency in SQL and Python (Scala or Java is a plus);
• Experience with distributed data processing frameworks such as Apache Spark or equivalents;
• Experience with at least one cloud data platform (AWS, Azure, or GCP) and related services;
• Knowledge of data warehouse and lakehouse technologies such as Snowflake, Databricks, BigQuery, Synapse, or equivalents;
• Experience with orchestration tools such as Airflow, Azure Data Factory, dbt, or equivalents;
• Solid understanding of data modelling concepts such as dimensional modelling and star schema;
• Familiarity with streaming technologies such as Kafka or equivalents;
• Experience with Git, CI/CD, and containerisation tools such as Docker is valued;
• English proficiency at B2 level or higher.

Location

Lisbon, Porto, Coimbra, or Braga (Hybrid - 2 days per week at the office).