Hybrid Data Engineer — Scalable Pipelines & Cloud Data

Komodo Consulting; Lisboa; Hybrid; EUR 55,000 - 75,000; Full time

Job summary

Komodo Consulting is seeking a Data Engineer to design, build, and maintain scalable data pipelines for a Technology Company. You will develop ETL/ELT processes, optimise data models for warehouses or lakehouses, and ensure data quality and governance across systems.

Requirements include 3+ years in data engineering, strong SQL and Python, experience with Spark and at least one cloud platform (AWS/Azure/GCP). Hybrid work with 2 days in the office in Portugal.

Qualifications

• 3+ years of data engineering experience.
• Strong SQL and Python (Scala/Java a plus).
• Experience with distributed data processing (e.g., Spark).
• Experience with at least one cloud platform (AWS/Azure/GCP).
• Knowledge of data warehouse/lakehouse tech (Snowflake, Databricks, BigQuery, Synapse).
• Experience with orchestration tools (Airflow, ADF, dbt).
• Understanding of dimensional modelling and star schemas.
• Familiarity with Kafka or similar streaming tech.
• Git, CI/CD, and Docker experience is valued.
• English proficiency at B2+.

Responsibilities

• Design, build, and maintain scalable data pipelines (batch and streaming).
• Develop ETL/ELT processes to ingest, transform, integrate data.
• Design/optimise data models for warehouses or lakehouses.
• Ensure data quality, validation, monitoring, and reliability.
• Optimise performance and cost of data processing/storage.
• Implement data governance, security, access controls.
• Automate data workflows and deployments (CI/CD).
• Collaborate with analysts and data scientists to deliver solutions.
• Troubleshoot data issues and document technical details.

Skills

SQL

Python

Apache Spark

Cloud data platforms

Data warehousing

ETL/ELT

Airflow

dbt

Kafka

Git & CI/CD

Docker

Schema modelling

English (B2+)

Tools

Snowflake

Databricks

BigQuery

Synapse

Job description

Komodo Consulting is seeking a Data Engineer to design, build, and maintain scalable data pipelines for a Technology Company. You will develop ETL/ELT processes, optimise data models for warehouses or lakehouses, and ensure data quality and governance across systems.

Requirements include 3+ years in data engineering, strong SQL and Python, experience with Spark and at least one cloud platform (AWS/Azure/GCP). Hybrid work with 2 days in the office in Portugal.