Data Engineer

Decskill; Porto; Hybrid; EUR 40,000 - 60,000; Full time

Job summary

Decskill is seeking a Data Engineer to join our IT consulting team in Porto with a hybrid work model (3 days per week in Porto). You will design and maintain data pipelines, model data for analytics, and ensure data quality across cloud-based platforms.

The role requires 3+ years in data engineering, strong SQL and Big Data skills, and fluency in English. Familiarity with Terraform, AWS, and Airflow is highly valued.

Qualifications

• 3+ years of experience in data engineering.
• Experience with AWS and public cloud platforms.
• Experience with IaC tools such as Terraform.
• Experience building data-driven architectures in cloud environments.
• Proficient in SQL for data querying.
• Strong background in Big Data and data modelling.
• Knowledge of multiple SQL/noSQL environments and appropriate use cases.
• Familiarity with Big Data ecosystem tools like Hadoop, Cassandra, Hive, Spark.
• Airflow experience is a plus.
• Fluency in English (C1 level) mandatory.

Responsibilities

• Design and maintain robust data pipelines across sources and storage/analytic platforms.
• Model data for performance and scalability.
• Ensure data quality through rigorous testing and validation.
• Troubleshoot data processing issues; optimize systems for reliability.
• Work on large-scale data projects using Spark for efficient processing.
• Handle real-time data streaming and delivery of insights.

Skills

Data pipelines

SQL

Big Data

Data modelling

Data quality

Real-time processing

English proficiency

Tools

Terraform

AWS

Airflow

Hadoop

Cassandra

Apache Hive

Apache Spark

Job description

We are growing. And we are looking for talented people.

At Decskill, we believe that technological excellence is driven by human talent.

We are an IT consulting company with more than 10 years of consolidated experience in the market, focused on building long-term relationships with both our clients and our people. Today, we are a community of over 800 professionals, working from Lisbon, Porto, and Madrid, contributing to impactful technology initiatives.

As part of the Astek Group, we combine a strong local culture with a global presence, being active in around 23 countries across 4 continents. This allows us to offer an international context, diverse challenges, and long-term career opportunities, while staying close to our teams.

We would like to meet a Data Engineer for a project with a hybrid working model based in Porto (3x/week).

Requirements:

• At least 3 years of experience in data engineering.
• Experience working with public cloud platforms, especially AWS.
• Experience with IaC tools, such as Terraform.
• Experience working with and creating data-driven architectures, preferably in public cloud platforms.
• Experience using a querying language such as SQL.
• Experience with Big Data and data modelling.
• Advanced knowledge of multiple SQL/noSQL data environments and a strong. understanding of why and when to use a particular solution.
• Familiarity with tools in the Big Data ecosystem (like Hadoop, Cassandra, Apache Hive, Apache Spark, and others alike).
• Experience with orchestration tools like Airflow is a big plus.
• Fluency in English - C1 level (mandatory).

Responsibilities:

• Data Pipeline Development: Design and maintain robust data pipelines, ensuring seamless data flow from various sources to storage and analytical platforms.
• Data Modeling: Craft and optimize data models for efficient data retrieval and analysis, balancing performance and scalability.
• Data Quality Assurance: Implement rigorous testing and validation protocols to guarantee the accuracy and integrity of data.
• Troubleshooting and System Optimization: Proactively identify and solve data processing issues, enhancing the performance and reliability of data systems.
• Big Data Processing: Engage in large-scale data projects, utilizing frameworks like Apache Spark for efficient data handling and processing.
• Real-Time Data Streaming: Work on cutting-edge projects that process and analyze data in real-time, ensuring swift data delivery and insights.

Are you looking for an environment that values curiosity and commitment? Here, your contribution has real impact and individual growth is taken seriously.

Find with us the right opportunity to grow!

What you can expect from us

• Long-term projects with national and international context.
• Opportunities to grow technically and professionally.
• A people-first culture, focused on transparency and trust.
• Teams that value ownership, collaboration and stability.

Your next challenge might start here.

At Decskill, we are committed to equal opportunities and non-discrimination. We promote a culture of diversity and inclusion, where recruitment and career progression are based solely on talent, regardless of age, gender, ethnicity, race, nationality, or any other form of discrimination incompatible with human dignity.