AWS Data Engineer - Hybrid: Streaming & Lakehouse

Jobgether SRL; Ireland; Hybrid; EUR 27,000 - 32,000; Full time

Benefits offered by this job

Restaurant meals

Hybrid remote working

Job summary

Jobgether SRL in Ireland is partnering to fill a Software Data Engineer role focused on AWS-based data platform development for manufacturing operations worldwide. You will design streaming and batch pipelines with Kafka/MSK, Flink or Spark, deploy on AWS, and collaborate with international teams to modernize data solutions and ensure reliable production systems.

The role emphasizes CI/CD, infrastructure as code, observability, and data quality to support data-driven decisions across the

Qualifications

• Master's degree in Computer Science, Computer Engineering, or related field (PhD a plus).
• Strong programming and data engineering skills with Python and SQL.
• Hands-on experience with Kafka/MSK and Flink or Spark Streaming.
• Practical experience with AWS services including EKS, Fargate, Lambda, S3, Aurora/RDS PostgreSQL, DynamoDB, and VPC.
• Solid understanding of big data technologies like Spark, Hive, HDFS and lakehouse formats Iceberg/Parquet.
• Experience with Git, CI/CD, Docker, IaC tools, REST APIs, and Agile/Scrum.

Responsibilities

• Design and develop scalable streaming data pipelines using Kafka/MSK, Flink or Spark Streaming.
• Build batch transformation pipelines in a medallion lakehouse on Amazon S3 using Iceberg/Parquet.
• Design and manage data storage across Aurora/RDS PostgreSQL and DynamoDB, plus lakehouse storage.
• Design, deploy, and maintain AWS infra for data and ML workloads (EKS, Fargate, Lambda, S3, VPC).
• Move data solutions from prototype to production with CI/CD, containerization, and deployment best practices.
• Collaborate with international teams to gather requirements and define data loading/ingestion processes.
• Document developments, perform integration testing, and manage deployments in AWS environments.
• Monitor pipelines for observability, data quality, reliability, and maintainability.
• Support data ingestion improvements and issue investigations in production.

Skills

Python

SQL

Kafka/MSK

Flink

Spark Streaming

AWS

Terraform

Docker

CI/CD

Git

Education

Master's degree in Computer Science/Engineering or related

Tools

Aurora/RDS PostgreSQL

DynamoDB

Iceberg

Parquet

Kubernetes

Terraform

Job description

Jobgether SRL in Ireland is partnering to fill a Software Data Engineer role focused on AWS-based data platform development for manufacturing operations worldwide. You will design streaming and batch pipelines with Kafka/MSK, Flink or Spark, deploy on AWS, and collaborate with international teams to modernize data solutions and ensure reliable production systems.

The role emphasizes CI/CD, infrastructure as code, observability, and data quality to support data-driven decisions across the