Data Engineer

buscojobs España; Pontevedra; Presencial; EUR 40.000 - 80.000; Jornada completa

Descripción de la vacante

Ein etabliertes Unternehmen sucht einen erfahrenen Senior Data Engineer, der die Verantwortung für das Design und die Implementierung von Datenpipelines und Produkten im Rahmen der Expansion eines Loyalitätsprogramms übernimmt. In dieser Schlüsselrolle werden Sie die Entwicklung und Wartung von Datenlösungen leiten, um die Datenintegrität und -verfügbarkeit sicherzustellen. Sie werden eng mit funktionsübergreifenden Teams zusammenarbeiten, um Datenanforderungen zu verstehen und Lösungen zu liefern. Wenn Sie eine Leidenschaft für Daten haben und in einem dynamischen Umfeld arbeiten möchten, ist dies die perfekte Gelegenheit, um Ihre Fähigkeiten einzubringen und einen echten Unterschied zu machen.

Formación

• 6+ Jahre Erfahrung in der Datenengineering mit Schwerpunkt auf Datenarchitektur.
• Erfahrung mit Cloud-Plattformen (GCP) und Big Data Technologien.

Responsabilidades

• Leitung des Designs und der Implementierung der Expansion des Loyalitätsprogramms.
• Integration von Daten aus verschiedenen Quellen in den Daten-See.

Conocimientos

Python

Pyspark

GCP

Airflow

Databricks

SQL

Data Modelling

Schema Design

Data Warehousing

Problem-Solving

Herramientas

Airflow

Spark

DBT

BigQuery

PostgreSQL

MySQL

MongoDB

Cassandra

Descripción del empleo

About us
For more than 20 years, our global network of passionate technologists and pioneering craftspeople has delivered cutting-edge technology and game-changing consulting to companies on the brink of AI driven digital transformation. Since 2001, we have grown into a full service digital consulting company with 5500+ professionals working on a worldwide ambition. Driven by the desire to make a difference, we keep innovating. Fuelling the growth of our company with our knowledge worker culture. When teaming up with Xebia, expect in-depth expertise based on an authentic, value-led, and high quality way of working that inspires all we do.

About the Role
We are seeking a highly skilled and experienced onsite Senior Data Engineer to lead the design and implementation of data pipelines and data products arising out of the expansion of the Loyalty program. The ideal candidate will have extensive experience building scalable data solutions, strong analytical skills, and a passion for leveraging data to drive business decisions.

Responsibilities

1. Design and Implementation:
   Lead the design and implementation of the Loyalty program expansion. Develop and maintain data pipelines to ensure seamless data flow from the Loyalty system to the data lake and data warehouse. Ensure data integrity, consistency, and availability across all data systems.
2. Data Integration:
   Integrate data from various sources, including transactional databases, third-party APIs, and external data sources, into the data lake. Implement ETL processes to transform and load data into the data warehouse for analytics and reporting.
3. Collaboration:
   Work closely with cross-functional teams including Engineering, Business Analytics, Data Science, and Product Management to understand data requirements and deliver solutions. Collaborate with data engineers to ensure data engineering best practices are integrated into the development process.
4. Performance Optimisation:
   Optimise data storage and retrieval to improve performance and scalability. Monitor and troubleshoot data pipelines to ensure high reliability and efficiency.
5. Data Governance:
   Implement and enforce data governance policies to ensure data security, privacy, and compliance. Develop documentation and standards for data processes and procedures.

Experience

1. 6+ years of experience in data engineering, with a focus on data architecture and pipeline development.
2. Proven experience with cloud platforms (GCP) and big data technologies (e.g., Airflow, Spark, DBT, Databricks, BigQuery, GCP Services).
3. Hands-on experience with ETL tools and processes.
4. Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).

Skills

1. Proficiency in programming languages such as Python, Pyspark, GCP, Airflow, Databricks, SQL.
2. Experience with data modelling, schema design, and data warehousing concepts.
3. Familiarity with data lake architectures and best practices.
4. Strong problem-solving skills and attention to detail.
5. Excellent communication and collaboration skills.

Data Engineer • Pontevedra, Kingdom Of Spain, ES