Data Engineer

Decskill; Porto; Híbrido; EUR 45 000 - 75 000; Tempo integral

Resumo da oferta

Decskill, an IT consulting company with more than 10 years of consolidated experience, is growing and looking for a Data Engineer for a project with a hybrid working model in Porto.

You will build and maintain robust data pipelines, design and optimize data models, and implement data quality, testing and validation processes across cloud environments using AWS, Terraform and Spark. This role emphasizes data-driven architectures and real-time data delivery.

Qualificações

• 3+ years of experience in Data Engineering.
• Hands-on with AWS cloud platforms.
• Experience with Infrastructure as Code (IaC) and Terraform.
• Experience designing data-driven architectures in cloud environments.
• Strong SQL skills and data querying expertise.
• Solid experience with Big Data and data modelling.
• Familiarity with Big Data ecosystem: Hadoop, Cassandra, Hive, Spark.
• Experience with Apache Airflow is a plus.

Responsabilidades

• Build and maintain robust data pipelines.
• Design and optimize data models for efficient retrieval.
• Implement data quality, testing, and validation processes.
• Troubleshoot and optimize data processing systems for performance.
• Work on large-scale Big Data projects using Spark.
• Develop real-time data streaming solutions for fast delivery.

Conhecimentos

Data Engineering

AWS

Terraform

SQL

Big Data

Data Modelling

SQL/NoSQL

Hadoop

Cassandra

Hive

Spark

Airflow

Ferramentas

Apache Airflow

Hadoop

Cassandra

Apache Hive

Apache Spark

Descrição da oferta de emprego

We are growing. And we are looking for talented people.

At Decskill, we believe that technological excellence is driven by human talent.

We are an IT consulting company with more than 10 years of consolidated experience in the market, focused on building long-term relationships with both our clients and our people. Today, we are a community of over 800 professionals, working from Lisbon, Porto, and Madrid, contributing to impactful technology initiatives.

As part of the Astek Group, we combine a strong local culture with a global presence, being active in around 23 countries across 4 continents. This allows us to offer an international context, diverse challenges, and long-term career opportunities, while staying close to our teams.

We would like to meet a Data Engineer for a project with a hybrid working model:

What we’re looking for:

• 3+ years of experience in Data Engineering.
• Hands-on experience with public cloud platforms, especially AWS.
• Experience with Infrastructure as Code (IaC) tools such as Terraform.
• Experience designing and building data-driven architectures, preferably in public cloud environments.
• Strong knowledge of SQL and querying languages.
• Solid experience with Big Data and Data Modelling.
• Advanced knowledge of multiple SQL/NoSQL data environments, with a strong understanding of when and why to use each solution.
• Familiarity with the Big Data ecosystem, including Hadoop, Cassandra, Apache Hive, Apache Spark, and similar technologies.
• Experience with orchestration tools such as Apache Airflow is a strong plus.

As a Data Engineer, you will:

• Build and maintain robust data pipelines, ensuring seamless data flow from multiple sources to storage and analytics platforms.
• Design and optimize data models for efficient data retrieval, balancing performance and scalability.
• Implement data quality, testing, and validation processes to ensure accuracy and integrity.
• Troubleshoot and optimize data processing systems to improve performance, reliability, and scalability.
• Work on large-scale Big Data projects, leveraging technologies such as Apache Spark.
• Develop and contribute to real-time data streaming solutions, enabling fast and reliable data delivery and insights.

Are you looking for an environment that values curiosity and commitment? Here, your contribution has real impact and individual growth is taken seriously.

Find with us the right opportunity to grow!

What you can expect from us:

• Long-term projects with national and international context
• Opportunities to grow technically and professionally
• A people-first culture, focused on transparency and trust
• Teams that value ownership, collaboration and stability

Your next challenge might start here.

At Decskill, we are committed to equal opportunities and non-discrimination. We promote a culture of diversity and inclusion, where recruitment and career progression are based solely on talent, regardless of age, gender, ethnicity, race, nationality, or any other form of discrimination incompatible with human dignity.