Lead Data Engineer (all genders)

Beiersdorf; Hamburg; Vor Ort; EUR 90.000 - 130.000; Vollzeit

Zusammenfassung

Beiersdorf is seeking a Lead Data Engineer to design, implement, and support data pipelines and databases within our Azure/Databricks Data & Analytics platform in Hamburg. You will balance stakeholder requirements with robust, scalable solutions and explore new technologies to enable deeper insights into data.

You will collaborate with project leads, reporting consultants, data scientists, and cloud engineers on global projects, mentoring mid-level Data Engineers and aligning with architectural

Qualifikationen

• Bachelor’s or Master’s degree in a related field.
• Several years of experience in Data Engineering or software development in cloud native environments.
• Deep operational expertise across the Azure ecosystem (Azure Data Factory, Databricks, Synapse, ADLS Gen2, Azure SQL).
• Strong knowledge of Azure serverless and integration services (Functions, Cosmos DB, Event Hubs/Service Bus).
• Proficient in Python with PySpark and at least one compiled language.

Aufgaben

• Design and implement data pipelines and databases within Azure/Databricks platform.
• Develop advanced data processing solutions within Azure/Databricks stack.
• Concept and implement relational and NoSQL databases in the platform.
• DevOps integration and code management using Azure DevOps.
• Manage Data Lake House architecture for structured, semi-structured, and unstructured data.
• Liaise with Architecture Team to ensure standards and guidelines are followed.
• Establish feedback loops between design and implementation.
• Mentor mid-level Data Engineers (technical guidance, no people mgmt).

Kenntnisse

Python

PySpark

Azure

Databricks

Scala/Java

CI/CD

Observability

Multi-cloud

Data governance

Mentoring

Ausbildung

Bachelor/Master in CS/SE

Tools

Azure Data Factory

Databricks

Azure Synapse

ADLS Gen2

Azure SQL

Azure Functions

Cosmos DB

Event Hubs/Service Bus

Kafka

Jobbeschreibung

Your Tasks

As a Lead Data Engineer you concept, design, implement and support data pipelines and databases within our Azure/Databricks Data & Analytics platform. You will always find the balance between individual requirements and stable solutions. You are open to new technologies and see them as an opportunity to enable even deeper insights into data. You will work closely with our project leads, reporting consultants, data scientist and cloud engineers. We work together on global projects in mixed project teams. It is important to us that everyone can contribute their experiences and concerns to discussions.

Main tasks

• Design and develop data pipelines within Azure and Databricks tech stack
• Code advanced data processing solutions within Azure and Databricks tech stack
• Concept and implement relational and NoSQL database solutions within Azure and Databricks
• Development/code management using Azure DevOps
• Manage our Data Lake House which stores structured, semi-structured data and unstructured data
• Act as primary technical liaison to the Architecture Team, ensuring alignment with standards and guidelines
• Establish and maintain a productive feedback loop between architectural design and implementation
• Mentor technically (no people management) mid-level Data Engineers in the team

Your Profile

• Bachelor’s or Master’s degree in related field
• Several years of experience in Data Engineering or Software Development within cloud native environments.
• Deep operational expertise across the Azure ecosystem (Azure Data Factory, Databricks, Synapse, ADLS Gen2, Azure SQL).
• Strong knowledge of Azure serverless and integration services (Functions, Cosmos DB, Event Hubs/Service Bus).
• Solid implementation of observability practices (logging, metrics, distributed tracing) and secure secrets management.
• Expert-level proficiency in Python with strong PySpark experience.
• Proficiency in at least one compiled/typed language (Scala, Java, or Go).
• Ability to write clean, modular, and performance optimized code.
• Demonstrated capability in technology scouting and evaluating emerging trends for practical business value.
• Multi-cloud exposure (AWS/GCP) and experience with streaming architectures (Kafka, Spark Structured Streaming).
• Strong understanding of data governance concepts and CI/CD automation principles.

At Beiersdorf, we want to help people feel good about their skin – and our commitment goes far beyond caring for skin. For 140 years, we have developed innovative skin and body care products for well-known brands such as NIVEA, Eucerin, La Prairie, Hansaplast, and Labello. We act according to our purpose, WE CARE BEYOND SKIN, and take responsibility for our consumers, our employees, the environment and society. Behind every brand, every product and every accomplishment are our more than 20,000 employees. It is for them that we live an inclusive culture of respect and trust that is strongly aligned with our values – CARE, COURAGE, SIMPLICITY and TRUST. We also embrace diversity by valuing the uniqueness of each individual and being committed to equal opportunities for all.

Additional Information

If you have any questions, please check our application FAQ first. If your question is not answered there, feel free to contact our Talent Acquisition Expert Melanie via [e-mail].