Senior Data Engineer: Real-Time Streaming & AWS

WIRE IT; Porto; Hybrid; EUR 65,000 - 95,000; Full time

Benefits offered by this job

Health Insurance

22 days paid vacation

4 extra days annually

Meal Allowance on card

Referral Bonus

Discounts and flex options

Annual training budget

Team-oriented culture

Opportunity to grow internationally

Job summary

Wire IT in Porto is seeking a Senior Data Engineer to design and operate real-time data pipelines and microservices. You will work hybrid from Porto on production-grade data platforms using Apache Flink and Kafka, with AWS services such as MSK, Kinesis, Lambda and S3.

You will collaborate with stakeholders, mentor engineers and contribute to data quality, security and observability across systems.

Qualifications

• 7+ years of experience in Data Engineering.
• Real-time streaming and distributed data processing expertise.
• Experience delivering production data products with Apache Flink/Kafka.
• Design/develop REST APIs, OpenAPI specs and microservices.
• Hands-on AWS data/cloud services: MSK, Kinesis, Lambda, API Gateway, ECS/EKS, S3.
• Data quality frameworks, schema management and automated tests.
• CI/CD tools such as GitLab CI or GitHub Actions.
• Monitoring/observability with CloudWatch, Prometheus, Grafana.
• Security, auth, data protection principles; production data services.

Responsibilities

• Develop and operate real-time data pipelines.
• Lead technical discussions, code reviews and mentoring.
• Collaborate with stakeholders to deliver scalable data platforms.
• Design and implement robust data schemas and quality checks.

Skills

Data engineering

Real-time streaming

Apache Flink

Apache Kafka

REST APIs

OpenAPI specifications

Microservices

AWS cloud services

MSK

Kinesis

Lambda

API Gateway

ECS/EKS

S3

Data quality & schema

Automated testing

CI/CD (GitLab CI)

CI/CD (GitHub Actions)

Cloud monitoring (CloudWatch)

Observability

Grafana

Tools

GitLab CI

GitHub Actions

AWS MSK

AWS Kinesis

AWS Lambda

AWS API Gateway

AWS ECS

AWS EKS

Grafana

CloudWatch

Job description

Wire IT in Porto is seeking a Senior Data Engineer to design and operate real-time data pipelines and microservices. You will work hybrid from Porto on production-grade data platforms using Apache Flink and Kafka, with AWS services such as MSK, Kinesis, Lambda and S3.

You will collaborate with stakeholders, mentor engineers and contribute to data quality, security and observability across systems.