Senior Data Engineer – Real-Time Spark & Data Platform

Feedzai; Portugal; Híbrido; EUR 45 000 - 70 000; Tempo integral

Resumo da oferta

Feedzai is seeking a Senior Data Engineer with expertise in Apache Spark to enhance the stability and performance of its Data Science Framework (DSF). Your role will be critical in managing distributed data systems and ensuring efficient workloads in a highly dynamic tech environment. A strong background in big data engineering and programming, particularly in Java, is a must. This role promotes a DevOps culture where you take full ownership of your projects, enhancing both team collaboration and operational excellence.

Qualificações

• 5+ years of experience building and operating distributed big data systems.
• Strong experience with Apache Spark - tuning, debugging, orchestration.
• Comfort with continuous delivery, monitoring, and on-call responsibilities.

Responsabilidades

• Re-architect and scale existing big data processing components powering DSF.
• Ensure stability of Spark jobs running on EMR or Kubernetes clusters.
• Collaborate with product engineers, data scientists, and platform teams.

Conhecimentos

Distributed big data systems

Apache Spark

Java

Hadoop ecosystem

Linux-based systems

Ferramentas

Kubernetes

AWS S3

AWS Glue

Kafka

Airflow

Descrição da oferta de emprego

Feedzai is seeking a Senior Data Engineer with expertise in Apache Spark to enhance the stability and performance of its Data Science Framework (DSF). Your role will be critical in managing distributed data systems and ensuring efficient workloads in a highly dynamic tech environment. A strong background in big data engineering and programming, particularly in Java, is a must. This role promotes a DevOps culture where you take full ownership of your projects, enhancing both team collaboration and operational excellence.