AWS Cloud Data Engineer — Streaming & Lakehouse

Pirelli & C. S.p.A.; Bari; Hybrid; EUR 27,000 - 32,000; Full time

Benefits offered by this job

Ticket restaurant.

Flexible working hours.

Hybrid Remote Working.

Employee benefits.

Job summary

Pirelli & C. S.p.A. in Bari invites a Software Data Engineer (AWS) to join the Digital Solutions Center, focusing on data ingestion via Kafka and integration of plant systems. You will join the AMS team addressing global user issues and improving ingestion processes, while contributing to cloud-based big data solutions.

Collaborate with Milan team to align requirements, design loading chains and ensure smooth deployment to AWS, with CI/CD and governance handover upon production release.

Qualifications

• Master's in Computer Science/Engineering required or equivalent.
• Strong SQL and Python skills.
• Experience building streaming data pipelines with Kafka/MSK and Flink or Spark Streaming.
• Hands-on AWS knowledge: EKS, Fargate, Lambda, S3, Aurora/RDS, DynamoDB, VPC.
• Big-data stack (Spark, Hive, HDFS) and lakehouse formats (Iceberg/Parquet).
• Git, CI/CD, Docker, IaC (Terraform), REST APIs; agile/scrum.

Responsibilities

• Design and build streaming data pipelines using Kafka, MSK and Flink/Spark Streaming.
• Develop batch transformations to a medallion lakehouse on S3 (Iceberg/Parquet).
• Manage data storage across Aurora/RDS, DynamoDB and object storage.
• Design, deploy and manage AWS infra for data/ML workloads (EKS, Fargate, Lambda, VPC).
• Move prototypes to production with refactoring, optimization, CI/CD and governance handover.
• Ensure observability, data quality and production maintenance of pipelines.

Skills

SQL

Python

Kafka/MSK

Flink

Spark Streaming

AWS

EKS

Fargate

Lambda

S3

Aurora/RDS

DynamoDB

VPC

Spark

Iceberg/Parquet

Git

CI/CD

Docker

Terraform

REST APIs

Agile/Scrum

Education

Master's in Computer Science/Engineering

PhD a plus

Tools

Docker

Terraform

Job description

Pirelli & C. S.p.A. in Bari invites a Software Data Engineer (AWS) to join the Digital Solutions Center, focusing on data ingestion via Kafka and integration of plant systems. You will join the AMS team addressing global user issues and improving ingestion processes, while contributing to cloud-based big data solutions.

Collaborate with Milan team to align requirements, design loading chains and ensure smooth deployment to AWS, with CI/CD and governance handover upon production release.