Hybrid Data Engineer — AWS, Spark & Terraform

Decskill; Porto; Hybrid; EUR 40,000 - 60,000; Full time

Job summary

Decskill is seeking a Data Engineer to join our IT consulting team in Porto with a hybrid work model (3 days per week in Porto). You will design and maintain data pipelines, model data for analytics, and ensure data quality across cloud-based platforms.

The role requires 3+ years in data engineering, strong SQL and Big Data skills, and fluency in English. Familiarity with Terraform, AWS, and Airflow is highly valued.

Qualifications

• 3+ years of experience in data engineering.
• Experience with AWS and public cloud platforms.
• Experience with IaC tools such as Terraform.
• Experience building data-driven architectures in cloud environments.
• Proficient in SQL for data querying.
• Strong background in Big Data and data modelling.
• Knowledge of multiple SQL/noSQL environments and appropriate use cases.
• Familiarity with Big Data ecosystem tools like Hadoop, Cassandra, Hive, Spark.
• Airflow experience is a plus.
• Fluency in English (C1 level) mandatory.

Responsibilities

• Design and maintain robust data pipelines across sources and storage/analytic platforms.
• Model data for performance and scalability.
• Ensure data quality through rigorous testing and validation.
• Troubleshoot data processing issues; optimize systems for reliability.
• Work on large-scale data projects using Spark for efficient processing.
• Handle real-time data streaming and delivery of insights.

Skills

Data pipelines

SQL

Big Data

Data modelling

Data quality

Real-time processing

English proficiency

Tools

Terraform

AWS

Airflow

Hadoop

Cassandra

Apache Hive

Apache Spark

Job description

Decskill is seeking a Data Engineer to join our IT consulting team in Porto with a hybrid work model (3 days per week in Porto). You will design and maintain data pipelines, model data for analytics, and ensure data quality across cloud-based platforms.

The role requires 3+ years in data engineering, strong SQL and Big Data skills, and fluency in English. Familiarity with Terraform, AWS, and Airflow is highly valued.