Senior Data Analyst - Databricks & PySpark (m/w/d)

Lidl E-Commerce; Neckarsulm; Vor Ort; EUR 60.000 - 80.000; Vollzeit

Zusammenfassung

A leading digital system provider is seeking an experienced Data Analyst to perform exploratory data analysis and build ETL pipelines. The ideal candidate should have a minimum of 8 years in data analysis, strong skills in Python and PySpark, and a good command of English. Responsibilities include ensuring data quality and working flexibly within a collaborative environment. Knowledge of German is a plus. This position is based in Germany, Baden-Württemberg, Neckarsulm.

Qualifikationen

• Minimum 8 years of experience as a data or BI analyst.
• Demonstrated ability in stakeholder communication and management.
• Very good English skills - German is a plus at minimum B1 level.

Aufgaben

• Perform exploratory data analysis on large datasets to identify inconsistencies, trends & anomalies.
• Build ETL pipelines & curate data following medallion architecture.
• Ensure data quality & integrity through robust data quality frameworks.

Kenntnisse

Data analysis

Stakeholder communication

Agile methodology

Flexibility

Project documentation

Data engineering

Data science

Collaboration

English

German (B1)

Tools

SQL

PySpark

Python

Databricks

Snowflake

VSCode

PyCharm

Git

Jobbeschreibung

• Minimum 8 years of experience as a data or BI analyst
• Demonstrated ability in stakeholder communication and management
• Experience working with Agile methodology
• Ability to work flexibly and independently
• Experience in creating and maintaining project documentation
• Good understanding of related data disciplines (e.g. data engineering, data science)
• Ability to understand, analyze and translate business requirements into data-driven solutions
• Enthusiasm for collaboration, knowledge sharing and joint learning
• Very good English skills - German is a plus at minimum B1 level.

Einleitungstext

As a digital system provider for Lidl's online business, we at Lidl e-commerce create efficient, scalable digital products and services and develop them further for the future. As a brand of the IT and digital division Schwarz Digits, our divisions are divided into Commerce Platforms, Marketing Tech & Enablement, Payment, New Digital Business Models and SCRM Loyalty Platforms.

Your tasks

• Perform exploratory data analysis on large datasets to identify inconsistencies, trends & anomalies
• Building ETL pipelines & curate data following medallion architecture
• Ensuring data quality & integrity: design and implement robust data quality frameworks, including unit tests automated schema checks
• Apply statistical methods & techniques to answer business questions
• Experience with Databricks and Snowflake platforms
• Strong proficiency in SQL (nice to have), PySpark and Python (must have)
• Proficiency with local development tools including VSCode, PyCharm, and Git
• Experience in building reports
• Being able to work with or in a setup with: CI/CD, Unit & Integration Tests, Code Quality Tools , Vulnerability Scans
• Working in Cloud Environments