Data Engineer — Flexible, ML-Driven Data Pipelines

Helloprima; Milano; Ibrido; EUR 70.000 - 100.000; Tempo pieno

Vantaggi offerti da questo lavoro

Healthcare

Gym discounts

Wellbeing programs

Mental health support

Work from home flexibility

Descrizione del lavoro

Prima is seeking a Data Engineer in Milan to join the Engineering team. You will shape data product architectures for analytics and ML, build scalable data pipelines, and collaborate with data scientists to refine data requirements.

You will champion data governance and deploy reusable ingestion and serving components in a cloud-based environment. You will work across batch and streaming processing using Kafka, Flink, and Spark, with Databricks and Airflow experience helping accelerate delivery.

Competenze

• Proficient in Python programming and software engineering best practices.
• Experience with batch and streaming data pipelines (Kafka/Flink/Spark).
• Experience with Data Lake/Big Data Analytics on cloud platforms (AWS preferred).
• Strong SQL skills, data warehousing and data modeling with Redshift/PostgreSQL/NoSQL databases.

Mansioni

• Shape architecture of data products for analytics and data science use cases.
• Lead data transformation and data governance practices to ensure reliable data assets.
• Build reusable data ingestion, storage, transformation, and serving components.
• Collaborate with data scientists and ML engineers to refine data requirements.
• Stay updated on emerging technologies and contribute to internal knowledge sharing.

Conoscenze

Python

SQL

Data modeling

Batch processing

Streaming data pipelines

DevOps

Data governance

CI/CD

Cloud (AWS)

Strumenti

Kafka

Flink

Spark

Databricks

Airflow

Oozie

Descrizione del lavoro

Prima is seeking a Data Engineer in Milan to join the Engineering team. You will shape data product architectures for analytics and ML, build scalable data pipelines, and collaborate with data scientists to refine data requirements.

You will champion data governance and deploy reusable ingestion and serving components in a cloud-based environment. You will work across batch and streaming processing using Kafka, Flink, and Spark, with Databricks and Airflow experience helping accelerate delivery.