Senior Data Engineer (Apache Flink/Kafka/AWS) - Hybrid Lisbon (3 days/week office)

HumanIT Digital Consulting

Lisboa

Hybrid

EUR 70,000 - 95,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Hybrid work arrangement

Job summary

HumanIT Digital Consulting is seeking a Senior Data Engineer to join a Group Data Delivery team in Lisbon. You will own data products end-to-end, from ingestion and streaming to APIs, monitoring and production support, with room to influence engineering standards.

You will design and operate real-time data pipelines using Apache Flink and Kafka on AWS, deliver secure, observable data products and mentor other engineers while collaborating across teams.

Qualifications

  • 7+ years of experience in data engineering.
  • Hands-on experience with Apache Flink and Apache Kafka.
  • Experience with AWS data and application services.
  • Good knowledge of APIs, microservices, event-driven systems and schema management.
  • Experience with CI/CD, automated testing, observability and production support.
  • Ability to turn business requirements into clear technical designs.
  • Experience reviewing implementation quality and mentoring engineers.
  • English at B2 level or above (professional working proficiency).
  • Based in Lisbon and available to work on-site 3 days per week.

Responsibilities

  • Designing and building real-time and batch data pipelines with Apache Flink and Apache Kafka.
  • Developing event-driven services, microservices, REST APIs and OpenAPI specifications.
  • Delivering data products that are reliable, secure, observable and production-ready.
  • Implementing data quality controls, schema management, validation and automated testing.
  • Setting up CI/CD pipelines for build, test, deployment and rollback.
  • Implementing monitoring, logging, metrics, tracing and alerting with CloudWatch, Prometheus, Grafana and OpenTelemetry.
  • Supporting production services, investigating incidents, improving performance and contributing to root-cause analysis.
  • Applying cloud security practices: authentication, authorisation, encryption, secrets management and IAM.
  • Producing technical designs, API documentation, deployment documentation and runbooks.
  • Reviewing technical work, defining engineering standards and mentoring other engineers.

Skills

Apache Flink
Apache Kafka
AWS
REST APIs
CI/CD
Observability
Mentoring
English (B2)

Tools

CloudWatch
Prometheus
Grafana
OpenTelemetry
OpenAPI

Job description

Job Openings Senior Data Engineer (Apache Flink/Kafka/AWS) - Hybrid Lisbon (3 days/week office)

About the job Senior Data Engineer (Apache Flink/Kafka/AWS) - Hybrid Lisbon (3 days/week office)

ABOUT THE OPPORTUNITY

We're looking for a Senior Data Engineer to join a Group Data Delivery team that builds real-time data products on a group-wide data platform. You'll own your data products end to end, from ingestion and stream processing to APIs, monitoring and production support. You'll also have room to set engineering standards and mentor other engineers. If you enjoy building streaming systems with Apache Flink and Apache Kafka on AWS, this role puts you at the core of the platform.

PROJECT & CONTEXT

The team builds real-time and batch data products on an event-driven architecture, and keeps improving them after they reach production. Your work will include:

  • Designing and building real-time and batch data pipelines with Apache Flink and Apache Kafka
  • Developing event-driven services, microservices, REST APIs and OpenAPI specifications
  • Delivering data products that are reliable, secure, observable and production-ready
  • Implementing data quality controls, schema management, validation and automated testing
  • Setting up CI/CD pipelines for build, test, deployment and rollback
  • Implementing monitoring, logging, metrics, tracing and alerting with CloudWatch, Prometheus, Grafana and OpenTelemetry
  • Supporting production services, investigating incidents, improving performance and contributing to root-cause analysis
  • Applying cloud security practices: authentication, authorisation, encryption, secrets management and IAM
  • Producing technical designs, API documentation, deployment documentation and operational runbooks
  • Reviewing technical work, defining engineering standards and mentoring other engineers

WHAT WE'RE LOOKING FOR (Required)

  • 7+ years of experience in data engineering
  • Strong hands-on experience with Apache Flink and Apache Kafka
  • Experience with AWS data and application services
  • Good knowledge of APIs, microservices, event-driven systems and schema management
  • Experience with CI/CD, automated testing, observability and production support
  • Ability to turn business requirements into clear technical designs
  • Experience reviewing implementation quality and supporting less experienced engineers
  • English at B2 level or above (professional working proficiency)
  • Based in Lisbon and available to work on-site 3 days per week

NICE TO HAVE (Preferred)

  • Hands-on experience with AWS streaming services such as Amazon MSK, Kinesis or Managed Service for Apache Flink
  • Experience with container platforms on AWS (ECS/EKS)
  • Experience with schema registries and schema evolution strategies
  • Experience implementing OpenTelemetry-based distributed tracing
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineering Tech Lead (Apache Flink/Kafka/AWS) - Hybrid Lisbon (3 days/week office)
Data Engineering Tech Lead (Apache Flink/Kafka/AWS) - Hybrid Lisbon (3 days/week office)

HumanIT Digital Consulting • Lisboa

Hybrid
EUR 28,000 - 36,000
15th month salary
Health insurance for family
Birthday off
+2
Senior / Lead Data Engineer – Real-Time Streaming (Flink · Kafka · AWS)
Senior / Lead Data Engineer – Real-Time Streaming (Flink · Kafka · AWS)

Lùkla Portugal • Porto

Hybrid
EUR 70,000 - 95,000
Senior Real-Time Data Tech Lead (Flink/Kafka) – Hybrid Lisbon
Senior Real-Time Data Tech Lead (Flink/Kafka) – Hybrid Lisbon

HumanIT Digital Consulting • Lisboa

Hybrid
EUR 28,000 - 36,000
15th month salary
Health insurance for family
Birthday off
+2
Senior Data Engineer | Real-Time & Streaming
Senior Data Engineer | Real-Time & Streaming

Alongside • Porto

Hybrid
EUR 70,000 - 90,000
Senior Data Engineer – Real-Time Pipelines (Flink/Kafka/AWS)
Senior Data Engineer – Real-Time Pipelines (Flink/Kafka/AWS)

HumanIT Digital Consulting • Lisboa

Hybrid
EUR 70,000 - 95,000
Hybrid work arrangement
Senior Data Engineer (AWS) | Porto (m/f/x)
Senior Data Engineer (AWS) | Porto (m/f/x)

Randstad Portugal • Porto

Hybrid
EUR 60,000 - 90,000
Real-Time Data Engineer Lead (Flink/Kafka) – Hybrid Porto
Real-Time Data Engineer Lead (Flink/Kafka) – Hybrid Porto

Lùkla Portugal • Porto

Hybrid
EUR 70,000 - 95,000
Senior Data Engineer - Hybrid/Remote | AWS, Kafka & Flink
Senior Data Engineer - Hybrid/Remote | AWS, Kafka & Flink

KCS IT • Porto

Hybrid
EUR 70,000 - 90,000
Free training programs
International projects in Benelux
Full Remote projects
+2
Senior Data Engineer: Real-Time Streaming & AWS
Senior Data Engineer: Real-Time Streaming & AWS

Wire IT • Porto

Hybrid
EUR 65,000 - 95,000
Health Insurance
22 days paid vacation
4 extra days annually
+6
Senior Data Engineer (AWS) – Real-Time Data Platform, Porto
Senior Data Engineer (AWS) – Real-Time Data Platform, Porto

Randstad Portugal • Porto

Hybrid
EUR 60,000 - 90,000
Top locations