Senior Real-Time Data Engineer — AWS, Kafka & Flink

QUANTEAM (RAINBOW PARTNERS Group); Porto; On-site; EUR 45,000 - 60,000; Full time

Benefits offered by this job

Health Insurance

Extra holiday: Christmas Eve or New...

Access to Quanteam Academy

Elevate Program

Ongoing consultant support

Job summary

Quanteam, founding entity of RAINBOW PARTNERS, is seeking a Senior Data Engineer to join the Porto team. The role focuses on designing, building and operating real-time data products and streaming services using Apache Flink and Kafka, deployed on AWS with IaC.

The ideal candidate has 7+ years in Data Engineering, with 3+ years in production real-time systems, strong Java/Python skills, and fluency in English.

Qualifications

• Bachelor's degree or equivalent experience.
• 7+ years in Data Engineering, with 3+ years in real-time/streaming systems.
• Strong hands-on with Flink in production (Java, Scala, or Python).
• Extensive Kafka experience and event-driven architectures.

Responsibilities

• Design, build and operate real-time data products from ingestion to APIs.
• Develop stateful streaming apps using Flink (windowing, event-time, watermarks).
• Build and manage Kafka-based streams and schemas.
• Design REST and streaming APIs and microservices.
• Deploy on AWS with containerization and IaC (Terraform).
• Improve CI/CD pipelines and automated testing.
• Provide production support and runbooks.

Skills

Real-time data

Streaming systems

SQL

Data modeling

English language

Education

BSc in Computer Science/Engineering

Tools

Apache Flink

Apache Kafka

Java

Python

Terraform

AWS (ECS/EKS, Lambda, S3)

GitLab CI / GitHub Actions

Job description

Quanteam, founding entity of RAINBOW PARTNERS, is seeking a Senior Data Engineer to join the Porto team. The role focuses on designing, building and operating real-time data products and streaming services using Apache Flink and Kafka, deployed on AWS with IaC.

The ideal candidate has 7+ years in Data Engineering, with 3+ years in production real-time systems, strong Java/Python skills, and fluency in English.