Data Engineer

Phiture; Porto; Presencial; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

KWAN is seeking a Senior Data Engineer to build and operate scalable data platforms across Lisbon, Porto and Braga, Portugal. This hybrid role requires 6 years in data engineering, strong cloud and data architecture skills, and fluency in English.

You will develop data pipelines, implement IaC with Terraform, work with AWS, SQL/noSQL databases, and Big Data tools like Hadoop and Spark, and use Airflow for orchestration while enabling enterprise-scale analytics and data-driven applications.

Qualificações

• 6 years of experience in Data Engineering.
• Experience with public cloud platforms, especially AWS.
• Experience with IaC tools, such as Terraform.
• Ability to code in at least one programming language (Python, Java, JavaScript, Scala).
• Experience with data-driven architectures, preferably in public cloud platforms.
• Experience using a querying language such as SQL.
• Experience with Big Data and data modelling.
• Advanced knowledge of multiple SQL/noSQL data environments and when to use each.
• Familiarity with Big Data ecosystems (Hadoop, Cassandra, Apache Hive, Apache Spark).
• Experience with orchestration tools like Airflow is a big plus.
• Open to relocating to Portugal.
• Fluency in English.

Responsabilidades

• Build and operate data-driven systems on public cloud with emphasis on scalability and reliability.
• Design architectures to process, store, and analyze large data volumes efficiently.
• Develop and maintain data pipelines and processing workflows for analytics and platform features.
• Work with modern data infrastructure in the cloud, combining storage, compute, and orchestration tools.
• Contribute to infrastructure automation using Infrastructure as Code.
• Integrate multiple data systems into cohesive data platforms for enterprise-scale use cases.
• Use orchestration and workflow tools to manage data processing pipelines and automate recurring tasks.

Conhecimentos

Data engineering

English

Relocation to Portugal

Ferramentas

AWS

Terraform

Python

Java

JavaScript

Scala

SQL

NoSQL

Hadoop

Cassandra

Apache Hive

Apache Spark

Airflow

Descrição da oferta de emprego

Lisbon, Portugal; Porto, Portugal; Braga, Portugal

Senior (4-6 Years)

Hybrid

English Required

What Is This Challenge About

• Build and operate data-driven systems that run on public cloud infrastructure, with a strong focus on scalability and reliability;
• Design and implement architectures that process, store, and analyze large volumes of data efficiently;
• Develop and maintain data pipelines and processing workflows that support analytics, platform features, and operational use cases;
• Work with modern data infrastructure in the cloud, combining storage, compute, and orchestration tools to support complex workloads;
• Contribute to infrastructure automation using Infrastructure as Code, enabling consistent and reproducible environments;
• Integrate multiple data systems and services into cohesive data platforms that support enterprise-scale use cases;
• Use orchestration and workflow tools to manage data processing pipelines and automate recurring data tasks.

What We Are Looking For

• 6 years of experience in Data Engineering;
• Experience working with public cloud platforms, especially AWS;
• Experience with IaC tools, such as Terraform; Ability to code in at least one programming language (Python, Java, JavaScript, Scala) is a must;
• Experience working with and creating data-driven architectures, preferably in public cloud platforms;
• Experience using a querying language such as SQL;
• Experience with Big Data and data modelling;
• Advanced knowledge of multiple SQL/noSQL data environments and a strong. understanding of why and when to use a particular solution;
• Familiarity with tools in the Big Data ecosystem (like Hadoop, Cassandra, Apache Hive, Apache Spark, and others alike);
• Experience with orchestration tools like Airflow is a big plus;
• Open to relocating to Portugal.
• Fluency in English.

We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.

What We Offer

• A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
• A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.
• An empowering and respectful work culture enriched with social and learning events.
• A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.

At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.

Luis Caldeira, DevOps @ KWAN

At KWAN, I’m given the space to be myself and do what I love. I have control over the projects I work on, as well as the direction of my career.

Pedro Fonseca, Front End Developer @ KWAN

I see my People Experience Partner as someone who is always available to provide me with motivation and constant feedback, which helps me be sure that I am in the right place.

Josimar dos Reis, Software Developer @ KWAN

I know that I’ve contributed to the growth of a company that truly values a “people first culture”, because my ideas, experiences, and individuality were always appreciated.

João Nascimento, Software Developer (KWAN Alumni)

My two years at KWAN were an incredible experience! From the start, I was welcomed into a warm and collaborative environment where I felt truly supported.

Laís Ortiz, Software Developer @ (KWAN Alumni)