Data Engineer: Cloud, Big Data & Pipelines

Decskill; Porto; Híbrido; EUR 45 000 - 75 000; Tempo integral

Resumo da oferta

Decskill, an IT consulting company with more than 10 years of consolidated experience, is growing and looking for a Data Engineer for a project with a hybrid working model in Porto.

You will build and maintain robust data pipelines, design and optimize data models, and implement data quality, testing and validation processes across cloud environments using AWS, Terraform and Spark. This role emphasizes data-driven architectures and real-time data delivery.

Qualificações

• 3+ years of experience in Data Engineering.
• Hands-on with AWS cloud platforms.
• Experience with Infrastructure as Code (IaC) and Terraform.
• Experience designing data-driven architectures in cloud environments.
• Strong SQL skills and data querying expertise.
• Solid experience with Big Data and data modelling.
• Familiarity with Big Data ecosystem: Hadoop, Cassandra, Hive, Spark.
• Experience with Apache Airflow is a plus.

Responsabilidades

• Build and maintain robust data pipelines.
• Design and optimize data models for efficient retrieval.
• Implement data quality, testing, and validation processes.
• Troubleshoot and optimize data processing systems for performance.
• Work on large-scale Big Data projects using Spark.
• Develop real-time data streaming solutions for fast delivery.

Conhecimentos

Data Engineering

AWS

Terraform

SQL

Big Data

Data Modelling

SQL/NoSQL

Hadoop

Cassandra

Hive

Spark

Airflow

Ferramentas

Apache Airflow

Hadoop

Cassandra

Apache Hive

Apache Spark

Descrição da oferta de emprego

Decskill, an IT consulting company with more than 10 years of consolidated experience, is growing and looking for a Data Engineer for a project with a hybrid working model in Porto.

You will build and maintain robust data pipelines, design and optimize data models, and implement data quality, testing and validation processes across cloud environments using AWS, Terraform and Spark. This role emphasizes data-driven architectures and real-time data delivery.