Senior / Lead Data Engineer – Real-Time Streaming (Flink · Kafka · AWS)

Lùkla Portugal; Porto; Hybrid; EUR 70,000 - 95,000; Full time

Job summary

Lùkla Portugal in Porto is seeking a Senior/Lead Data Engineer to build real-time streaming pipelines using Flink and Kafka, and to own data products end-to-end. You will design APIs, drive AWS-based deployments, and contribute to production support and governance.

The role requires strong hands-on experience with streaming data, microservices, and cloud security, with hybrid Porto-based work three days on site. English fluency is essential.

Qualifications

• Strong hands-on experience with Apache Flink and Apache Kafka.
• Production experience with AWS data and application services.
• Good knowledge of APIs, microservices, event-driven systems and schema management.
• Experience with CI/CD, testing, observability and cloud security.
• Fluent English (international technical and business teams).

Responsibilities

• Build real-time and batch pipelines with Apache Flink and Apache Kafka.
• Develop event-driven microservices, REST APIs and OpenAPI specifications for data consumers.
• Work with AWS: MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS/EKS, S3, IAM.
• Put in place data quality, schema management, validation and automated tests.
• Set up CI/CD (GitLab CI, GitHub Actions) and observability (CloudWatch, Prometheus, Grafana, OpenTelemetry).
• Support production: incidents, performance and root-cause analysis.
• Write technical designs, API documentation and runbooks, and review peers’ work.

Skills

Apache Flink

Apache Kafka

AWS

API design

Microservices

CI/CD

Observability

OpenTelemetry

English

Tools

MSK

Kinesis

OpenAPI

CloudWatch

Prometheus

Grafana

GitLab CI

GitHub Actions

ECS/EKS

Job description

Senior / Lead Data Engineer - Real-Time Streaming (Flink · Kafka · AWS) | Porto, Hybrid

Do you like building data products that run in real time and in production?

We are looking for Data Engineers to join a Group Data Platform team at an international client in the financial sector, in Porto. You will build streaming data products end to end: ingestion, stream processing, APIs, monitoring and production support.

Two levels are open:

• Senior Data Engineer (7+ years): you design, build and run real-time pipelines, and support less experienced engineers.
• Tech Lead Data Engineer (10+ years): you also lead architecture decisions, technical reviews, engineering standards and mentoring.

What you will do

• Build real-time and batch pipelines with Apache Flink and Apache Kafka
• Develop event-driven microservices, REST APIs and OpenAPI specifications for data consumers
• Work with AWS: MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS/EKS, S3, IAM
• Put in place data quality, schema management, validation and automated tests
• Set up CI/CD (GitLab CI, GitHub Actions) and observability (CloudWatch, Prometheus, Grafana, OpenTelemetry)
• Support production: incidents, performance and root-cause analysis
• Write technical designs, API documentation and runbooks, and review your peers’ work

What we are looking for

• Strong hands-on experience with Apache Flink and Apache Kafka
• Production experience with AWS data and application services
• Good knowledge of APIs, microservices, event-driven systems and schema management
• Experience with CI/CD, testing, observability and cloud security
• Fluent English (international technical and business teams)

Porto, hybrid (3 days per week on site)