Data Quality Engineer (m / f / d)

Schwarz IT Barcelona; Barcelona; Presencial; EUR 30.000 - 45.000; Jornada completa

Descripción de la vacante

A leading technology services provider in Barcelona is seeking a Data Quality Engineer. This role involves designing automated data quality checks and collaborating with data engineers on Spark pipelines. Ideal candidates will have strong skills in Python or Scala, experience with data quality frameworks, and good communication in English. Join a dynamic team dedicated to data excellence.

Formación

• Strong experience in Python or Scala, focusing on backend or data-related systems.
• Proficient in Spark and Databricks, understanding distributed data processing.
• Hands-on experience implementing data quality frameworks or tools.
• Comfortable working with structured, semi-structured, and streaming data.
• Knowledge about writing automated tests and integrating them into CI/CD pipelines.
• Proactive in identifying data quality challenges.

Responsabilidades

• Design and implement automated data quality checks across data layers.
• Develop and maintain services to monitor and enforce data quality rules.
• Collaborate with Data Engineers to integrate quality checks into Spark pipelines.
• Configure alerting mechanisms for data quality incidents.
• Perform root cause analysis on data quality issues.

Conocimientos

Python

Scala

Spark

Databricks

Data Quality Frameworks

CI/CD

TDD

BDD

Data Validation

Monitoring Tools

English Communication

Herramientas

Deequ

DQX

Prometheus

Grafana

Descripción del empleo

Join to apply for the Data Quality Engineer (m / f / d) role at Schwarz IT Barcelona

1 week ago Be among the first 25 applicants

Join Schwarz Global Services Barcelona - IT Hub of Europe's Largest Retail Group.

At Schwarz Global Services Barcelona, we provide high-value IT services for the entire Schwarz Group, which includes Lidl, Kaufland, Schwarz Produktion, PreZero, Schwarz Digits, STACKIT, and XMCyber.

As part of a top 5 global retail company, we serve 6 billion customers through 13,700 stores in 32 countries, supported by over 575,000 employees.

We are looking for open-minded colleagues with a passion for technology, who are willing to find diverse and exciting career opportunities in a dynamic work environment that stands for development and progress.

Elevate your career with us, where development and progress are at the heart of everything we do.

Your tasks

1. You design and implement automated data quality checks across all data layers.
2. You develop and maintain sidecar services or libraries to monitor and enforce data quality rules.
3. You collaborate with Data Engineers to integrate data quality checks into Spark pipelines on Databricks.
4. You define and maintain data quality metrics.
5. You configure and manage alerting mechanisms for data quality incidents.
6. You perform root cause analysis on data quality issues and work with the team to resolve them.
7. You contribute to the creation of data quality dashboards and reports.
8. You support the adoption of best practices around data validation and schema enforcement.
9. You ensure the documentation of data entities, data quality checks, and their rationale across datasets.

Your profile

1. You have strong experience in Python or Scala, with a focus on backend or data-related systems.
2. You are proficient in Spark and Databricks, and understand distributed data processing.
3. You have hands-on experience implementing data quality frameworks or tools (e.g., Deequ, DQX, etc.).
4. You are comfortable working with structured, semi-structured, and streaming data.
5. You have knowledge about writing automated tests and integrating them into CI / CD pipelines, as well as being familiar with terms like TDD or BDD.
6. You understand the data quality challenges at each layer and are proactive in identifying data issues.
7. You are familiar with monitoring tools and alerting systems (e.g., Prometheus, Grafana, or alternatives).
8. You can communicate effectively with both technical and non-technical stakeholders.
9. You take ownership of your work and have ideally already worked in agile teams.
10. You have a passion and enthusiasm for new technologies and topics related to data.
11. You have a good command of English.

We look forward to receiving your application.

Schwarz Dienstleistung KG

• Xavier Coll Porqueres
• Reference no. 46249 Stiftsbergstraße 1
• 74172 Neckarsulm, Germany

Seniority level

Entry level

Employment type

Full-time

Job function

Quality Assurance

Industries

IT Services and IT Consulting

Note: The additional job posting about INGENIERO DE CALIDAD appears unrelated and should be omitted for clarity.