Data Engineer - Data Platform - Spain (Remote in Spain)

OLX; Torrejón de Ardoz; A distancia; EUR 45.000 - 75.000; Jornada completa

Descripción de la vacante

Join a forward-thinking company as a Data Engineer, where you'll play a crucial role in building and enhancing data platforms. This position offers the opportunity to work with cutting-edge technologies and collaborate with talented data specialists across Europe. You will lead initiatives to automate data processes, improve data access, and contribute to the strategic vision of treating data as a product. With a focus on mentorship and collaboration, you'll help shape the future of data-driven decision-making in a dynamic and supportive environment. Embrace the chance to make a meaningful impact while enjoying flexible work arrangements and comprehensive benefits.

Servicios

Work from home allowance

Flexible retribution plan

Employee Assistance program

Tax declaration assistance

Formación

• 3-5 years of experience in data platforms and complex data pipelines.
• Experience with AWS and cloud data technologies.
• Proficient in Python and SQL, with knowledge of Spark.

Responsabilidades

• Architect and develop scalable data platform solutions.
• Collaborate with analytics and data science teams.
• Monitor data ecosystem and optimize performance.

Conocimientos

Python

SQL

AWS

Data Architecture

Data Pipelines

Spark

CI/CD

Docker

Kubernetes

Data Mesh

Herramientas

AWS S3

Redshift

Kafka

GitLab

Terraform

Airflow

Descripción del empleo

OLX – Data Science and Analytics / Full-time / Remote

At OLX, we work together to build a more sustainable world through trade. We make it safe, smart, and convenient to buy and sell cars, find housing, get jobs, buy and sell household goods, and more. Our colleagues around the world help to serve millions of people every month, through its well-loved consumer brands including OLX, Otomoto, Property24. Join OLX and see how far you can go.

About the Data Engineering team :

Become a part of an agile team of data specialists taking care of the massive amounts of data and groundbreaking technologies. Your work will manage and grow our current data platform used by hundreds of data engineers, data / business analysts, and data scientists all over Europe. While being part of a central team of data engineers and software engineers across Lisbon, Berlin, Barcelona, and Poznan, you will grow our data platform in several aspects such as automating data acquisition processes, democratizing data access even for non-tech roles, building a streaming architecture, or even working on data taxonomy to allow better data platform and product integration. You will lead a business domain from the technical perspective and contribute to the data architecture and platform definition while also mentoring more junior team members. You will also be involved in strategic goals such as shifting to the paradigm of looking at data as a product, not just as an asset, and bring the platform to the next level by enabling data streaming allowing for faster data-driven decisions.

What you will do :

• Reporting to the Data Platform Engineering Manager, within the Data Platform and Services team.
• Collaborate with analytics, data science, and data product management to support our shared Data mission : "We harness data to drive intelligent decisions and deliver products our customers love."
• Contribute to strategic goals and initiatives, taking responsibility for specific results that support the technical and product roadmap.
• Assist in architecting and developing scalable data platform solutions and architectures that support various domains utilizing the data platform, addressing stakeholders' needs.
• Support and collaborate with domain-oriented data teams, ensuring they have the necessary toolkits and processes to operate effectively within the larger Data Mesh framework.
• Participate in identifying and suggesting improvements based on error fixing, debugging, bug fixes, and performance tuning.
• Assist in researching, recommending, testing, and adopting new (big) data technologies and techniques to enhance our data ecosystem.
• Support monitoring of our data ecosystem, identifying inefficiencies, and assisting in automation or fine-tuning of data products to optimize their performance and usability.
• Contribute to enhancing and enforcing governance frameworks and processes to ensure the security and compliance of our data ecosystem.
• Provide support and guidance to less experienced staff members, fostering a collaborative and learning-focused environment.

Who we are looking for :

• 3-5 years of experience creating and maintaining data platforms, implementing complex data pipelines, and working with both technical and business stakeholders.
• Demonstrated experience in designing governed and scalable data architectures and platforms, with a focus on storage and performance optimization.
• Experience with at least one major cloud data technology (AWS, GCP, or Azure Cloud), with practical experience in architecting solutions within the AWS ecosystem.
• Proficient in Python and SQL, capable of writing efficient, easy-to-read, and clear code, with some experience in Spark and / or Scala.
• Experience working with Redshift, Presto / Trino, Hive / Glue, Kafka, and Athena.
• Experience working with AWS services, including S3, DynamoDB, SQS, EC2 Auto Scaling, Kinesis, Lambda, EMR, and general AWS APIs.
• Hands-on experience with CI / CD tools (e.g., GitLab), infrastructure as code (Terraform), containerization (Docker), and container orchestration (Kubernetes).
• Relevant knowledge of collaborative analytics and orchestration tools (e.g., Airflow, dbt) and open table formats (e.g., Apache Iceberg, Apache Hudi, Delta Lake).
• Relevant knowledge of metadata concepts and tools (e.g., DataHub, OpenMetadata, Marquez).
• Knowledge of the Data Mesh paradigm.
• Excellent written and verbal proficiency in English.
• This role is based in Spain.

Our Benefits :

• Work from home allowance.
• Flexible retribution plan (up to 30% of your salary in products / services such as restaurant ticket, transportation ticket, nursery check).
• Employee Assistance program - service managed by ComPsych which provides confidential support, resources, and information for personal and work-life matters.
• Tax declaration assistance - fiscal advisory.