Data Engineer: Build Real-Time Data Pipelines & ML

Schwarz Digits; Barcelona; On-site; EUR 60,000 - 90,000; Full time

Job summary

Schwarz Digits seeks a Data Engineer to craft scalable data solutions in Barcelona, Spain. You will build and optimize batch and real‑time pipelines, develop ML‑driven features, and work closely with stakeholders to translate business needs into robust data architectures.

Required skills include Python, SQL, Spark, Kafka, Kubernetes, Hive, and experience with SQL Server and MongoDB/Elk/Cassandra. Agile experience and a passion for learning are essential in this collaborative, multilingual

Qualifications

• Proficient in Python and SQL for data engineering tasks.
• Experience with Spark, Kafka, Kubernetes and Hive is required.
• Familiar with both SQL Server and NoSQL databases like MongoDB/Elasticsearch/Cassandra.
• Agile methodology experience is a must.

Responsibilities

• Design, build, and maintain batch and real‑time data pipelines.
• Conduct data provisioning, cleaning, testing, and ALM processes.
• Develop algorithms in statistics and machine learning.
• Collaborate with stakeholders to translate requirements into technical solutions.
• Ensure data quality, integrity, and availability across systems.
• Extract actionable business insights from datasets.

Skills

Python

SQL

Big Data

Spark

Kafka

Kubernetes

Hive

Agile

Scikit-Learn

Pandas

Tools

MongoDB

Elasticsearch/ELK

Cassandra

MLflow

Spark ML

Job description

Schwarz Digits seeks a Data Engineer to craft scalable data solutions in Barcelona, Spain. You will build and optimize batch and real‑time pipelines, develop ML‑driven features, and work closely with stakeholders to translate business needs into robust data architectures.

Required skills include Python, SQL, Spark, Kafka, Kubernetes, Hive, and experience with SQL Server and MongoDB/Elk/Cassandra. Agile experience and a passion for learning are essential in this collaborative, multilingual