Senior Data Engineer*

TieTalent; Braunschweig; Vor Ort; EUR 55.000 - 85.000; Vollzeit

Zusammenfassung

A leading company in the retail industry is seeking a skilled Data Engineer to join their ambitious Data Science team. The role involves designing and optimizing data architectures, enhancing data processing pipelines, and collaborating closely with various departments to improve data quality for impactful business solutions. This position offers the chance for continual growth and development within a supportive and international work environment, complemented by an attractive salary and numerous benefits.

Leistungen

30 days of vacation

Attractive salary

Career development opportunities

Structured onboarding and mentoring program

30% employee discount at NEW YORKER stores

Company and team events

Diverse food selection in canteens

Qualifikationen

• 3 or more years of working experience as a data engineer or similar position.
• Extensive experience with Spark, Hadoop, SQL & relational databases, data models, and ETL pipelines.
• Ability to write efficient, well-tested code in Python.

Aufgaben

• Design, implement and optimize effective data processing architectures.
• Operationalize machine learning pipelines and ensure data quality.
• Mentor junior team members through code reviews and pair programming.

Kenntnisse

Python

Communication

Pair Programming

Docker

Data Quality

Scala

Kubernetes

Machine Learning

Scalability

SQL

Linux

Architecture

PySpark

Hadoop

ETL

Ausbildung

Master's degree in Computer Science or equivalent

Jobbeschreibung

About

The Data Science department uses state-of-the-art machine learning and optimization techniques to continuously improve business processes at NEW YORKER. We work in agile project teams on a variety of use cases, including image recognition, order optimization, pricing, distribution and logistics. We are a very ambitious and international team and are proud of our high standards.

• Design, implement and optimize effective data processing architectures in Python
• Extract, transform, analyze, clean and model data from different sources
• Implement and operate maintainable and reliable data pipelines using PySpark and Airflow with a strong focus on data quality
• Strive to understand how the data is actually generated and what impact this has on data quality and our use cases through proactive communication with other departments
• Operationalize machine learning pipelines together with a team of highly motivated data scientists
• Architect and develop continuous integration & deployment processes
• Operate and optimize Hadoop (Cloudera) clusters with support of the DevOps and Infrastructure teams
• Mentor more junior team members through insightful code reviews and pair programming sessions
• Master's degree in Computer Science or equivalent Three or more years of working experience as a data engineer or similar position
• Extensive experience with Spark, Hadoop, SQL & relational databases, data models and ETL pipelines
• Ability to write efficient, well-tested code with a keen eye on scalability and maintainability in Python; Airflow and Scala experience is a plus
• Experience with Docker, Kubernetes and usage of continuous integration & deployment is a plus
• Good Linux knowledge
• You are a team player and strong communicator with a hands-on mentality
• Good spoken and written German is a plus, fluent English is a must-have
• A secure, permanent job in an internationally operating company in a future-proof industry that is characterized by growth
• Participation in shaping the digital transformation in an innovative company
• Permanent employment contract with 30 days of vacation, an attractive salary and further training opportunities/career model
• A structured onboarding and mentoring program in a great team with international colleagues, a “Duz Kultur” and open doors
• Numerous benefits, such as a 30% staff discount at our NEW YORKER stores, company and team events, and canteens with a diverse food selection
• Your gender doesn't matter to us - the main thing is that you fit in with us! NEW YORKER is open to all people who want to contribute to our company's success.
  
  

TITL1_DE

Nice-to-have skills

• Python
• Communication
• Pair Programming
• Docker
• Data Quality
• Scala
• Kubernetes
• Machine Learning
• Scalability
• SQL
• Linux
• Architecture
• Computer Science
• Python
• PySpark
• Hadoop
• Spark
• SQL
• ETL
• Scala
• Docker
• Kubernetes
• Linux
• Brunswick, Lower Saxony, Germany
  
  

Work experience

• Data Engineer
• Fullstack
• Data Infrastructure
  
  

Languages

• English