Data Engineer - E-Bike repository

Upway; Paris; Sur place; EUR 50 000 - 70 000; Plein temps

Résumé du poste

A leading company in refurbished e-bikes is seeking a dedicated professional to create a comprehensive repository of all e-bike models. This role involves analyzing brands, building data models, and ensuring efficient data processing to enhance user experience and trust.

Qualifications

• Experience with Big Data technologies is essential.
• Understanding of data modeling and pipelines.

Responsabilités

• Analyze e-bike brands and understand catalog structures.
• Build data models and pipelines to store information.
• Extract structured information from manufacturers.

Connaissances

Apache Hive

Hadoop

AWS

Scala

Big Data

Data Warehouse

NoSQL

Kafka

Redshift

Spark

Description du poste

Upway is the world leader in refurbished e-bikes. We have purchased and sold more than 50,000 e-bikes globally, representing 400 brands and thousands of models.

Properly identifying bikes is key for Upway as it impacts all areas of the business:

• Improved user experience for sellers on Upway
• Efficiency and automation in our internal processes
• Customer trust and providing the most reliable information for e-bikes

Goal

The goal of this role is to create a comprehensive repository of all e-bike models ever produced, including model name, year of production, sizes, specifications (motor, battery, transmission), options, equipment, and price.

Key Responsibilities

You will be the first person hired on this topic. You will be responsible for understanding the domain in depth, building your game plan, and executing it. This includes:

• Analyzing e-bike brands and understanding how their catalogs are structured
• Prioritizing which brands to tackle first
• Processing and extracting structured information from manufacturers or retailers
• Building pipelines and data models to store this information and making it accessible to applications

Key Skills

Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala

Employment Details

Type: Full-Time

Experience: [Specify years of experience]

Vacancy: 1