Mobilisights Senior Data Engineer

Mopar; Poissy; À distance; EUR 60 000 - 100 000; Plein temps

Résumé du poste

Une entreprise mondiale à la pointe de l'innovation recherche un expert en systèmes de données cloud natifs. Dans ce rôle, vous concevrez des plateformes de données robustes et évolutives, en utilisant des technologies de streaming en temps réel pour transformer des ensembles de données massifs en services de données de haute qualité. Vous travaillerez avec des équipes transversales pour optimiser le traitement des données tout en garantissant la sécurité et la qualité des données. Si vous êtes passionné par la technologie et souhaitez faire partie d'une équipe dynamique qui façonne l'avenir de la mobilité, cette opportunité est faite pour vous.

Qualifications

• 5+ ans d'expérience dans les systèmes de données en streaming cloud natifs.
• Expérience avec des technologies Big Data pour le traitement de données à faible latence.

Responsabilités

• Concevoir et construire une plateforme de données robuste et évolutive.
• Développer des pipelines de données en streaming à faible latence.

Connaissances

Cloud native data streaming

AWS infrastructure

Spark-Scala

Python

SQL

Data privacy and quality control

Operational excellence

Docker

Kubernetes

Big Data NoSQL technologies

Outils

Databricks Intelligent Platform

Kafka

Flink

Kinesis

Lambda

EMR

EKS

Docker

Helm

Description du poste

Nous rejoindre, c'est intégrer une entreprise d'envergure mondiale. Mû par la recherche permanente de l'innovation et de l'excellence, pionnier et leader des technologies propres et de la mobilité durable, le Groupe entend rester à la pointe des grandes tendances qui font bouger le monde. Fort de son efficience, de son agilité et de son esprit d'équipe, le Groupe fait preuve d'exigence et d'audace pour définir la mobilité de demain. Pour réussir ces transformations, l'entreprise a besoin de tous les talents. Rejoignez-nous !

Chez Stellantis, nous évaluons les candidats selon leurs qualifications, leurs mérites et les besoins du métier. Nous accueillons les candidatures des personnes de tout genre, âge, ethnie, nationalité, religion, orientation sexuelle, et handicap. La diversité de nos équipes nous permettra de mieux appréhender l'évolution des besoins de nos clients et de notre environnement futur.

Mobilisights : enabling a smarter world

Exponential growth in adoption and deployment of connected cars and devices is bringing previously unavailable datasets to market – at scale and in real-time. Our vision is a ‘smarter' world where innovative applications and services leverage connected vehicle datasets, and the insights they provide, to dramatically transform and continually improve everyday lives for consumers and businesses.

Stellantis, one of the largest global car makers and the parent company of fourteen of the most iconic industry brands including Jeep, Fiat, Maserati, Peugeot, and more, has created Mobilisights, a Data-as-a-Service Business Unit, which will harness sensor and other data from millions of connected vehicles and other devices to support data products and services for a growing array of customers. Mobilisights represents this vision and future. We are part of Stellantis - a global company with 300,000 employees and will fully leverage the resources and the benefits that provides, but we are built like a startup and operate like one, too. A truly global company, Mobilisights has teams all over the world and we work entirely remotely.

Position Responsibilities:

• Design and build a best-in-class robust scalable data platform that can ingest, store, manage and stream massive amounts of data while simplifying its analysis and processing to enable rapid development of high-quality data products and services.
• Design, implement and test robust low latency streaming data pipelines using state of the art big data technologies for preparing / curating data that will support various data as a service product.
• You will work with various cross functional teams to explore data and figure out all the data wrangling needed to clean, curate the data and build the end-to-end data pipeline per requirements.
• You will design necessary privacy and security preventive and detective controls into the CICD of each data pipeline.
• You will have a strong bias for operational excellence ensuring error handling, restart-ability ensuring data consistency, logging, monitoring and alerting is built into the pipeline.
• You will drive continual improvements for reliability, performance, scalability, quality and own associated KPI.
• You will provide on-call support for the platform and troubleshooting any issues that arise.

Basic Qualifications:

• 5+ years of experience in development and operation in production of Cloud native data streaming data systems (with an emphasis on scalability, robustness, data delivery low latency and data privacy and quality control).
• 5+ years' experience working in Cloud native real-time streaming data ecosystem such as Spark, Flink, Kinesis, Lambda, Kafka, EMR / EKS platform, Lakehouse platform (i.e Delta.io). Experience in using Databricks Intelligent Platform is a plus.
• 5+ years of experience in developing optimizing AWS data system architecture: Infrastructure as Code, integration and deployment automation, security.
• 5+ years of experience in ensuring operation reliability of cloud native data system in production – Particularly experience in deploying and monitoring AWS infrastructure using MSK, EKS clusters in Production.
• 5+ years' experience with languages like Spark-Scala, Py-Spark and / or Python, Java.
• Experience in relational database concepts with a solid knowledge of SQL, SQL Tuning, Big Data NoSQL technologies.
• Experience in implementing application processing large-scale Geo-spatial data is a plus.
• Experience with development and deployment of containerized application using Docker, Kubernetes, Helm.
• Experience in building systems that monitor data losses and data quality control.
• Demonstrated knowledge of data structures and algorithms.
• Experience in designing foundations of Operational excellence and implementing.
• Curiosity and passion to learn with a strong bias to action.