SENIOR DATA ENGINEER

New Yorker; Braunschweig; Vor Ort; EUR 50.000 - 80.000; Vollzeit

Zusammenfassung

A leading company is looking for a Data Engineer to improve business processes through advanced data techniques. In a growing industry, join an international team to design data architectures and optimize data pipelines using tools like Python and Spark. This role allows for significant impact in the digital transformation and offers a permanent contract with a competitive salary, extensive benefits, and a supportive work environment.

Leistungen

30 days of vacation

Attractive salary

Further training opportunities

Structured onboarding and mentoring

30% staff discount at stores

Company and team events

Canteens with diverse food selection

Qualifikationen

• Three or more years of working experience as a data engineer or in a similar position.
• Extensive experience with Spark, Hadoop, SQL & relational databases.
• Ability to write efficient, maintainable code in Python.

Aufgaben

• Design, implement and optimize data processing architectures.
• Extract, transform, analyze, clean and model data from different sources.
• Operationalize machine learning pipelines with a team.

Kenntnisse

Data architecture

Data processing

Data cleaning

Data modeling

Data pipelines

Team collaboration

Communication

Ausbildung

Master's degree in Computer Science

Tools

Python

Spark

Hadoop

SQL

Docker

Kubernetes

Airflow

Jobbeschreibung

The Data Science department uses state-of-the-art machine learning and optimization techniques to continuously improve business processes at NEW YORKER. We work in agile project teams on a variety of use cases, including image recognition, order optimization, pricing, distribution and logistics. We are a very ambitious and international team and are proud of our high standards.

• Design, implement and optimize effective data processing architectures in Python
• Extract, transform, analyze, clean and model data from different sources
• Implement and operate maintainable and reliable data pipelines using PySpark and Airflow with a strong focus on data quality
• Strive to understand how the data is actually generated and what impact this has on data quality and our use cases through proactive communication with other departments
• Operationalize machine learning pipelines together with a team of highly motivated data scientists
• Architect and develop continuous integration & deployment processes
• Operate and optimize Hadoop (Cloudera) clusters with support of the DevOps and Infrastructure teams
• Mentor more junior team members through insightful code reviews and pair programming sessions
• Master's degree in Computer Science or equivalent

Three or more years of working experience as a data engineer or similar position

• Extensive experience with Spark, Hadoop, SQL & relational databases, data models and ETL pipelines
• Ability to write efficient, well-tested code with a keen eye on scalability and maintainability in Python; Airflow and Scala experience is a plus
• Experience with Docker, Kubernetes and usage of continuous integration & deployment is a plus
• You are a team player and strong communicator with a hands-on mentality
• Good spoken and written German is a plus, fluent English is a must-have
• A secure, permanent job in an internationally operating company in a future-proof industry that is characterized by growth
• Participation in shaping the digital transformation in an innovative company
• Permanent employment contract with 30 days of vacation, an attractive salary and further training opportunities / career model
• A structured onboarding and mentoring program in a great team with international colleagues, a “Duz Kultur” and open doors
• Numerous benefits, such as a 30% staff discount at our NEW YORKER stores, company and team events, and canteens with a diverse food selection
• Your gender doesn't matter to us - the main thing is that you fit in with us! NEW YORKER is open to all people who want to contribute to our company's success.