Senior Big Data Engineer — Hybrid Madrid, Real-Time Data

Tecnalis-Solution-Providers; Madrid; Híbrido; EUR 90.000 - 120.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid working model

International Health Insurance

Health and Wellbeing Package

Birthday Day Off

Me Time - 1 day off per year

Great career development opportunities

Descripción de la vacante

GiG is seeking a Senior Big Data Engineer to own design, development, and support of major realtime data projects within the Data department. You will help drive data-driven decision making and contribute to robust, scalable data solutions.

The role emphasizes ownership of ETL pipelines, data quality, and optimization of large-scale data processing in a hybrid working environment in Madrid.

Formación

• Strong expertise with Spark, Kafka, NiFi, ClickHouse and Big Data datastores.
• Strong understanding of schema design and data models.
• Proficiency in SQL and experience with SQL databases.
• Experience with Python and/or Java.
• Experience with cloud computing and distributed systems.

Responsabilidades

• Design, create, and maintain ETL processes, data integrations, and data pipelines
• Ensure seamless handling of vast amounts of data.
• Develop high-performance services to process, store, and analyze large datasets with optimized code
• Lead data validation and quality checks tailored to business needs
• Troubleshoot live production systems and ensure smooth operations
• Test and implement new technologies, staying updated with advancements in big data

Conocimientos

SQL

Data modeling

Data pipelines

Python

Java

Herramientas

Spark

Kafka

NiFi

ClickHouse

Big Data Datastores

Cloud platforms

Descripción del empleo

GiG is seeking a Senior Big Data Engineer to own design, development, and support of major realtime data projects within the Data department. You will help drive data-driven decision making and contribute to robust, scalable data solutions.

The role emphasizes ownership of ETL pipelines, data quality, and optimization of large-scale data processing in a hybrid working environment in Madrid.