Data Engineer

Emdgroup; Madrid; Presencial; EUR 50.000 - 90.000; Jornada completa

Descripción de la vacante

Join a forward-thinking company as a Data Engineer, where your skills will shape impactful data solutions that enhance productivity and support data-driven decisions. In this role, you will design scalable data pipelines, develop ETL/ELT processes, and collaborate with cross-functional teams to drive data-related initiatives. Your expertise in technologies like PySpark and AWS will empower stakeholders with insights that inform their decisions. If you're passionate about leveraging data to drive business outcomes and thrive in a collaborative environment, this opportunity is perfect for you.

Formación

• 5+ years of IT experience with a focus on Foundry or AWS development.
• Expertise in data modeling and big data technologies.

Responsabilidades

• Design and implement scalable data pipelines using PySpark and Palantir Foundry.
• Develop robust ETL/ELT processes for large-scale datasets.

Conocimientos

Data Modeling

ETL / ELT Processes

PySpark

SQL

Python

Kafka

Hadoop

Pandas

Herramientas

AWS

Palantir Foundry

Cloud Data Warehouses

Lakehouse Frameworks

Descripción del empleo

Your role : Join our dynamic team as a Data Engineer, where your expertise will drive impactful data solutions that enhance productivity and support data-driven decision-making across the organization. You will design and implement scalable data pipelines using PySpark and Palantir Foundry, integrating data from various systems such as SAP and LIMS to create usable formats for analytics. Your role will involve developing robust ETL / ELT processes for large-scale datasets in manufacturing, supply chain, and commercial operations. Collaborate with cross-functional teams to identify and drive data-related use cases, translating complex business contexts into actionable deliverables. By ensuring data quality, lineage, and performance through monitoring and automation, you will play a crucial part in delivering reliable data products. Additionally, you will develop front-end applications that eliminate manual processes and enhance user experience. Your contributions will not only streamline operations but also empower stakeholders with the insights they need to make informed decisions. If you're passionate about leveraging data to drive business outcomes and thrive in a collaborative environment, we want to hear from you!

Who you are :

• You have a minimum of 5 years of IT experience, with at least 5 years in Foundry or AWS development.
• You possess expertise in data modeling, ETL / ELT processes, and big data technologies such as Spark, Kafka, and Hadoop.
• You are skilled in advanced development using PySpark and Pandas within Foundry for sophisticated data processing.
• You have strong experience with cloud data warehouses and lakehouse frameworks.
• You are proficient in SQL, Python, and distributed data processing frameworks.
• You have a proven track record of delivering scalable and efficient data engineering solutions.
• You possess strong communication and problem-solving skills to bridge technical and business perspectives.
• You are willing to travel domestically and internationally (25% travel required).