Data Engineer (m/f/d)

Schwarz Digits; Barcelona; Presencial; EUR 60.000 - 90.000; Jornada completa

Descripción de la vacante

Schwarz Digits seeks a Data Engineer to craft scalable data solutions in Barcelona, Spain. You will build and optimize batch and real‑time pipelines, develop ML‑driven features, and work closely with stakeholders to translate business needs into robust data architectures.

Required skills include Python, SQL, Spark, Kafka, Kubernetes, Hive, and experience with SQL Server and MongoDB/Elk/Cassandra. Agile experience and a passion for learning are essential in this collaborative, multilingual

Formación

• Proficient in Python and SQL for data engineering tasks.
• Experience with Spark, Kafka, Kubernetes and Hive is required.
• Familiar with both SQL Server and NoSQL databases like MongoDB/Elasticsearch/Cassandra.
• Agile methodology experience is a must.

Responsabilidades

• Design, build, and maintain batch and real‑time data pipelines.
• Conduct data provisioning, cleaning, testing, and ALM processes.
• Develop algorithms in statistics and machine learning.
• Collaborate with stakeholders to translate requirements into technical solutions.
• Ensure data quality, integrity, and availability across systems.
• Extract actionable business insights from datasets.

Conocimientos

Python

SQL

Big Data

Spark

Kafka

Kubernetes

Hive

Agile

Scikit-Learn

Pandas

Herramientas

MongoDB

Elasticsearch/ELK

Cassandra

MLflow

Spark ML

Descripción del empleo

Schwarz Digits creates the technological foundation for digital sovereignty in Europe. As the IT and digital division of the Schwarz Group, we develop and manage the IT infrastructures for the retail divisions Lidl and Kaufland, as well as Schwarz Production and PreZero. At the same time, we operate as an independent provider in the external market to support companies across Europe in their digital transformation. We bundle our core services in the areas of Cloud, Cyber Security, Data & AI, Communication, and Workspace.

Join us and contribute to digital sovereignty in Europe. With us, you will work at the intersection of agility and security: You will benefit from fast decision‑making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group.

Your tasks

• We are seeking a highly skilled and motivated Data Engineer to join our team. In this role, you will be involved in building scalable data solutions, driving data operations, and developing statistical and machine learning algorithms that deliver real business value.
• This is an exciting opportunity for someone who thrives in dynamic, agile environments and is passionate about using data to solve complex problems.
• Design, build, and maintain batch and real‑time data pipelines.
• Conduct data operations, including exploration, provisioning, cleaning, testing, and ALM.
• Develop and implement algorithms in statistics and machine learning.
• Collaborate closely with business stakeholders to translate requirements into technical solutions.
• Ensure data integrity, quality, and availability across all systems.
• Extract actionable business insights.

Your profile

• Must‑have: Programming languages: Python, SQL.
• Must‑have: Experience with Big Data frameworks such as Spark, Kafka, Kubernetes, Hive.
• Must‑have: Familiarity with relational (e.g., SQL Server) and non‑relational databases (e.g., MongoDB, ELK, Cassandra).
• Agile methodology experience.
• Nice‑to‑have: Knowledge of Machine Learning tools: Scikit‑Learn, Pandas, Spark ML, MLflow.
• Nice‑to‑have: Knowledge of deploying infrastructure and DevOps.
• Nice‑to‑have: Experience in .NET.
• Passion for continuous learning and staying up to date with emerging technologies.
• Creative, innovative thinker with a proactive mindset.
• Strong problem‑solving skills and ability to adapt quickly to change.
• Collaborative spirit with excellent communication skills.
• Comfortable working in a multi‑cultural environment with fluency in English.

We look forward to receiving your application.

• Reference no. 48246 Stiftsbergstraße 1
• 74172 Neckarsulm, Germany