Data Engineer

Komodo Consulting; Lisboa; Híbrido; EUR 45 000 - 70 000; Tempo integral

Resumo da oferta

Komodo Consulting is seeking a Data Engineer to design and build data models for Data Science, BI, and downstream consumption. You will develop APIs and data products to improve integration across internal systems.

Responsibilities include monitoring pipelines, gathering requirements with partners, and coordinating with cross-functional teams to deliver reliable data solutions for business and studio teams.

Qualificações

• Proven experience as a Data Engineer in fast-paced environments.
• Strong expertise in SQL and SQL-like query languages.
• Advanced proficiency in Python and experience organizing Python-based projects.
• Extensive experience with Azure Data Factory and Databricks.
• Experience designing and implementing ETL/ELT pipelines.
• Experience with cloud platforms such as Azure or AWS and their data services.
• Solid understanding of data modeling methodologies such as Kimball, Inmon, or Data Vault.
• Experience with data governance practices and observability or monitoring tools.
• Familiarity with CI/CD automation and version control workflows (e.g., GitLab).

Responsabilidades

• Design and build data models to support Data Science, BI, and downstream data consumption.
• Develop APIs and data products to improve data integration across internal systems.
• Monitor and maintain data pipelines, communicating issues to leadership.
• Gather, document, and validate technical and functional requirements with partners.
• Collaborate with cross-functional teams to coordinate data initiatives across systems.
• Support the delivery of data solutions enabling business access to reliable data.

Conhecimentos

SQL

Python

Azure Data Factory

Databricks

ETL/ELT pipelines

Cloud data services (Azure/AWS)

Data modeling (Kimball/Inmon/DataVault

Data governance

CI/CD with GitLab

Ferramentas

GitLab

Databricks

Descrição da oferta de emprego

About us

Komodo Consulting is a technology and strategy firm specializing in Digital Transformation. Operating in Portugal and Poland, we provide IT Consulting & Nearshore services. We support both public and private sector organizations through two main areas:

• Consulting — with a focus on strategy, investment analysis, and digital process improvement;
• IT Team Augmentation — helping clients scale and strengthen their tech teams.

About us

Komodo Consulting is a technology and strategy firm specializing in Digital Transformation. Operating in Portugal and Poland, we provide IT Consulting & Nearshore services. We support both public and private sector organizations through two main areas:

• Consulting — with a focus on strategy, investment analysis, and digital process improvement;
• IT Team Augmentation — helping clients scale and strengthen their tech teams.

The Project

We are seeking a Data Engineer to work on a project for a Tech Company.

You will have the following responsibilities:

• Design and build data models to support Data Science, Business Intelligence, and downstream data consumption;
• Develop APIs and data products to improve data integration across internal systems and processes;
• Monitor and maintain data pipelines, identifying issues and communicating them to leadership and stakeholders;
• Work closely with business partners and developers to gather, document, and validate technical and functional requirements;
• Collaborate with cross-functional teams to coordinate data initiatives across different systems and departments;
• Support the delivery of data solutions that enable business and studio teams to access reliable and actionable data.

You need to have the following skills/experience:

• Proven experience working as a Data Engineer in fast-paced environments;
• Strong expertise in SQL and SQL-like query languages;
• Advanced proficiency in Python and experience organizing Python-based projects;
• Extensive experience with Azure Data Factory and Databricks;
• Strong experience designing and implementing ETL and ELT pipelines;
• Experience working with cloud platforms such as Azure or AWS and their data services;
• Solid understanding of data modeling methodologies such as Kimball, Inmon, or Data Vault;
• Experience working with data governance practices and observability or monitoring tools;
• Familiarity with CI/CD automation and version control workflows (e.g., GitLab).

Location

Lisbon or Porto (Hybrid - 2x times a week at the office).