Data Engineer

buscojobs España; Burgos; Presencial; EUR 40.000 - 80.000; Jornada completa

Descripción de la vacante

Ein innovatives Unternehmen sucht einen erfahrenen Senior Data Engineer, um die Datenpipelines und -produkte für die Expansion des Loyalitätsprogramms zu gestalten und zu implementieren. In dieser Rolle sind Sie verantwortlich für die Entwicklung und Wartung von Datenpipelines, die Sicherstellung der Datenintegrität und die Optimierung der Datenarchitektur. Sie arbeiten eng mit funktionsübergreifenden Teams zusammen, um die Datenanforderungen zu verstehen und Lösungen zu liefern. Wenn Sie eine Leidenschaft für Daten haben und die Möglichkeit suchen, in einem dynamischen Umfeld zu arbeiten, ist diese Position genau das Richtige für Sie.

Formación

• 6+ Jahre Erfahrung in der Datenverarbeitung und Pipeline-Entwicklung.
• Erfahrung mit Cloud-Plattformen (GCP) und Big Data-Technologien.

Responsabilidades

• Leitung der Gestaltung und Implementierung der Datenpipelines für das Loyalitätsprogramm.
• Integration von Daten aus verschiedenen Quellen in den Datenlake.

Conocimientos

Python

Pyspark

GCP

Airflow

Databricks

SQL

Data modelling

Schema design

Data warehousing

Problem-solving

Herramientas

Airflow

Spark

DBT

BigQuery

PostgreSQL

MySQL

MongoDB

Cassandra

Descripción del empleo

About us

For more than 20 years, our global network of passionate technologists and pioneering craftspeople has delivered cutting-edge technology and game-changing consulting to companies on the brink of AI driven digital transformation. Since 2001, we have grown into a full service digital consulting company with 5500+ professionals working on a worldwide ambition. Driven by the desire to make a difference, we keep innovating. Fuelling the growth of our company with our knowledge worker culture. When teaming up with Xebia, expect in-depth expertise based on an authentic, value-led, and high quality way of working that inspires all we do.

About the Role

We are seeking a highly skilled and experienced onsite Senior Data Engineer to lead the design and implementation of data pipelines and data products arising out of expansion of the Loyalty program. The ideal candidate will have extensive experience building scalable data solutions, strong analytical skills, and a passion for leveraging data to drive business decisions.

1. Design and Implementation :

• Lead the design and implementation of the Loyalty program expansion.
• Develop and maintain data pipelines to ensure seamless data flow from the Loyalty system to the data lake and data warehouse.
• Ensure data integrity, consistency, and availability across all data systems.

2. Data Integration :

• Integrate data from various sources, including transactional databases, third-party APIs, and external data sources, into the data lake.
• Implement ETL processes to transform and load data into the data warehouse for analytics and reporting.

3. Collaboration :

• Work closely with cross-functional teams including Engineering, Business Analytics, Data Science and Product Management to understand data requirements and deliver solutions.
• Collaborate with data engineers to ensure data engineering best practices are integrated into the development process.

4. Performance Optimisation :

• Optimise data storage and retrieval to improve performance and scalability.
• Monitor and troubleshoot data pipelines to ensure high reliability and efficiency.

5. Data Governance :

• Implement and enforce data governance policies to ensure data security, privacy, and compliance.
• Develop documentation and standards for data processes and procedures.

Experience :

• 6+ years of experience in data engineering, with a focus on data architecture and pipeline development.
• Proven experience with cloud platforms (GCP) and big data technologies (e.g., Airflow, Spark, DBT, Databricks, BigQuery, GCP Services).
• Hands-on experience with ETL tools and processes.
• Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).

Skills :

• Proficiency in programming languages such as Python.
• Pyspark, GCP, Airflow, Databricks, SQL.
• Experience with data modelling, schema design, and data warehousing concepts.
• Familiarity with data lake architectures and best practices.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.