Global Data Pipeline Architect | PySpark, SQL & Cloud

PepsiCo; Vitoria; Presencial; EUR 60.000 - 90.000; Jornada completa

Descripción de la vacante

PepsiCo is expanding its Global Digital Commerce Team to power international growth, seeking seasoned data engineers to build a Global Data Product using cloud and data warehouse techniques. You will own end-to-end data pipelines and collaborate with cross-functional teams to deliver scalable solutions.

Ideal candidates have 5+ years in data systems, strong Python/PySpark/SQL skills, and experience with AWS, Azure, and Snowflake, in a retail, e-commerce, or financial services context.

Formación

• 5+ years of experience in designing and building systems for collecting, storing, and analysing data at scale.
• Strong Python, PySpark, SQL, Airflow, DBT, and Big Data technologies such as Hadoop Hive/Impala.
• Experience with AWS, Azure, and Snowflake.
• Strong interpersonal skills to interact with client/onshore personnel to understand Enterprise Information Management requirements.
• Experience in Retail, E-commerce or Financial Services is preferred.
• Excellent analytical skills to research and solve complex customer problems.
• Hands-on experience handling large data sets and data analysis with Python/PySpark/SQL/Hive/Impala.

Responsabilidades

• Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics.
• Contribute to best practices for engineering and coding as part of a world-class PepsiCo team.
• Work with the product team leveraging core technology platforms.
• Collaborate in architecture discussions and decisions to improve platforms.
• Deliver high quality data pipelines and tools through analysis, peer reviews, and test automation.
• Introduce new tools and practices to improve data and code quality and workflow.
• Support data pipelines with exception handling, monitoring, and debugging production issues.
• Manage large numbers of data sources and work with client IT teams to resolve issues.

Conocimientos

Python

PySpark

SQL

Airflow

DBT

Big Data

Hadoop Hive/Impala

AWS

Azure

Snowflake

Descripción del empleo

PepsiCo is expanding its Global Digital Commerce Team to power international growth, seeking seasoned data engineers to build a Global Data Product using cloud and data warehouse techniques. You will own end-to-end data pipelines and collaborate with cross-functional teams to deliver scalable solutions.

Ideal candidates have 5+ years in data systems, strong Python/PySpark/SQL skills, and experience with AWS, Azure, and Snowflake, in a retail, e-commerce, or financial services context.