Software Data Engineer (AWS) — Hybrid Remote Data Platform

Jobgether SRL; Netherlands; Hybrid; EUR 27,000 - 32,000; Full time

Benefits offered by this job

Restaurant meal/ticket benefits

Flexible working hours

Hybrid remote working model

Professional development opportunities

Job summary

Partner Company in the Netherlands is seeking a Software Data Engineer to contribute to a modern data platform supporting manufacturing operations. You will design and build scalable streaming and batch data pipelines using Kafka/MSK, Flink or Spark Streaming, and lakehouse architectures on AWS.

You will own solutions from prototype through deployment, optimization, monitoring, and maintenance, collaborating with international teams to modernize legacy data solutions and enable data-driven

Qualifications

• Master's degree in Computer Science, Computer Engineering, or a related technical discipline; a PhD is considered a plus.
• Strong programming and data engineering skills with Python and SQL.
• Hands-on experience building streaming data pipelines using Kafka/MSK and Flink or Spark Streaming.
• Practical experience with AWS services including EKS, Fargate, Lambda, S3, Aurora/RDS PostgreSQL, DynamoDB, and VPC.
• Solid understanding of big data technologies such as Spark, Hive, and HDFS, with lakehouse formats like Iceberg and Parquet.
• Experience with Git, CI/CD, Docker, Terraform or other Infrastructure as Code tools, REST APIs, and Agile/Scrum methodologies.
• Understanding of scalable data architectures, production data pipelines, data quality, monitoring, and operational best practices.
• Experience with Iceberg or Delta Lake, CDC, schema evolution at scale; Scala is an advantage.
• Strong communication skills and ability to collaborate with cross-functional and international teams.
• Curiosity and enthusiasm for learning new technologies, products, and capabilities.
• Strong attention to detail, organization, prioritization, and time-management.
• Ability to work independently while maintaining collaboration with stakeholders.

Responsibilities

• Design and develop scalable streaming data pipelines using Kafka/MSK, Flink or Spark Streaming, and reliable data routing to storage.
• Build batch transformation pipelines within a medallion lakehouse architecture (bronze, silver, gold) on Amazon S3 (Iceberg/Parquet).
• Design and manage storage across Aurora/RDS PostgreSQL, DynamoDB, and lakehouse storage.
• Develop AWS infrastructure for data and ML workloads using EKS, Fargate, Lambda, S3, VPC, and DynamoDB.
• Refactor, optimize, and deploy data solutions with CI/CD, containers, and deployment best practices.
• Collaborate with international teams to gather requirements and define loading/ingestion processes.
• Document developments, perform integration testing, and manage deployments in AWS environments.
• Transition completed solutions to support/governance teams and ensure reliable operation.
• Monitor pipelines for observability, data quality, performance, reliability, and maintainability.
• Investigate user-reported issues and implement improvements to data ingestion processes.

Skills

Python

SQL

Kafka/MSK

Flink

Spark Streaming

AWS

EKS

Fargate

Lambda

S3

Aurora/PostgreSQL

DynamoDB

Terraform

Git

Docker

Kubernetes

CI/CD

Education

Master's degree

PhD preferred

Tools

Terraform

Docker

Git

Kubernetes

Job description

Partner Company in the Netherlands is seeking a Software Data Engineer to contribute to a modern data platform supporting manufacturing operations. You will design and build scalable streaming and batch data pipelines using Kafka/MSK, Flink or Spark Streaming, and lakehouse architectures on AWS.

You will own solutions from prototype through deployment, optimization, monitoring, and maintenance, collaborating with international teams to modernize legacy data solutions and enable data-driven