(Senior) Data Engineer (f/m/x)

exmox GmbH; Deutschland; Hybrid; EUR 45.000 - 75.000; Vollzeit

Zusammenfassung

Ein innovatives Unternehmen sucht einen talentierten Data Engineer, der ETL-Pipelines entwirft und verwaltet. In dieser spannenden Rolle werden Sie für die Entwicklung von Databricks-Lösungen verantwortlich sein, die Daten aus verschiedenen Quellen integrieren und optimieren. Mit einem starken Fokus auf Datenqualität und -integrität arbeiten Sie eng mit interdisziplinären Teams zusammen, um sicherzustellen, dass die Datenflüsse reibungslos funktionieren. Das Unternehmen bietet eine ausgewogene Work-Life-Balance, flexible Arbeitszeiten und zahlreiche Vorteile, um Ihre berufliche Entwicklung zu unterstützen. Wenn Sie leidenschaftlich an Datenengineering interessiert sind und in einem dynamischen Umfeld arbeiten möchten, ist dies die perfekte Gelegenheit für Sie.

Leistungen

30 Tage Urlaub

Öffentliche Verkehrsmittel Zuschüsse

Jährliches Bildungsbudget von 1.500€

Workation-Möglichkeiten

Mitgliedschaft im Fitnessstudio - Wellpass

Monatliche Team-Lunches

Flexibles Arbeiten

Exklusive Rabatte für große Marken

Diversity und internationales Team

Soziale Aktivitäten im Büro

Qualifikationen

• Mindestens 3 Jahre Berufserfahrung in der ETL-Prozessgestaltung und -optimierung.
• Erfahrung mit Databricks und AWS-Diensten für Datenverarbeitung.

Aufgaben

• Entwicklung und Wartung von skalierbaren ETL-Pipelines auf Databricks.
• Zusammenarbeit mit Teams zur Sicherstellung des Datenflusses in das DataLakehouse.

Kenntnisse

ETL-Prozesse

Python

SQL

PySpark

Datenintegration

Problemlösungsfähigkeiten

Kommunikationsfähigkeiten

Ausbildung

Bachelor in Informatik

Bootcamp-Erfahrung

Tools

Databricks

AWS (S3, Kinesis, Lambda)

GitLab CI/CD

PostgreSQL

Jobbeschreibung

Your mission

• Design, develop, and maintain scalable ETL pipelines on Databricks to integrate data from various sources, including app / web products, and marketing partner data.
• Build and manage the DataLakehouse on Databricks, including migrating legacy data products. Implement data transformations and processing logic using Databricks and PySpark to ensure efficient data handling and analysis.
• Monitor and maintain the data stack for nightly and near-real-time processing of in-house tracking solutions, ensuring high performance and reliability. Continuously optimize and troubleshoot data pipelines to ensure data quality and integrity.
• Collaborate with cross-functional teams to ensure seamless data flow and integration into the DataLakehouse. Provide Tableau support for data analysts as needed.
• Stay updated with industry best practices and emerging technologies in data engineering.

Your profile

• Bachelor's degree in Computer Science, Engineering, Information Systems or related field is preferred -or- Bootcamp experience with a minimum of 3 years professional experience.
• Proficiency in designing, implementing, and optimizing ETL processes, also orchestrating ETL workflows.
• Hands-on experience with DataBricks and AWS services (e.g., S3, Kinesis, Lambda) or similar technologies.
• Strong proficiency in Python, SQL, and PySpark for data manipulation and processing.
• Knowledge of data integration and data quality best practices.
• Experience with GitLab CI/CD pipelines is a plus.
• Familiarity with PostgreSQL is a plus.
• Excellent problem-solving skills and attention to detail.
• Ability to work independently and collaborate effectively in a team environment.
• Strong communication and interpersonal skills.
• Fluent English in both verbal and written skills.

Why us?

• Work Life Balance: We value rest and work life balance, we offer you 30 days of paid vacation days.
• Commuter Benefits: We provide you with public transportation tickets.
• Professional Development: We support you in deepening your skills and provide you an annual education budget of 1.500€.
• Workation: Combine Vacation with work: we offer annual workation opportunities.
• Gym membership - Wellpass: With Wellpass you can use more than 7000 Spas/ Gyms/ etc. in Germany.
• Catering: We offer monthly team lunches, daily fruits and vegetables and every beverage you could wish for.
• Flexibility: Benefit from flexible working hours and working from home.
• Corporate Benefits: Benefit from exclusive discounts for big brands & platforms.
• Diversity: We are an international team of talented people with different cultural backgrounds.
• Fun and Games: We have a big socializing area to make room for having relaxing activities within the working day.
• Desk Setup: Wherever you work, we will provide you with your workspace utensils.

Please note: this is not a remote only position, we offer you a flexible hybrid model here in Hamburg, Germany - working from home on Mondays & Fridays, coming to the office on Tuesday, Wednesday & Thursday!