Senior Data Engineer - Scalable Pipelines & Data Lakes

Parser; Madrid; On-site; EUR 75,000 - 110,000; Full time

Benefits offered by this job

Knowledge sharing culture

Work on cloud-based data lake with 최신데

Cutting-edge data technologies

Job summary

Parser is a boutique technology services and consulting firm helping global organisations solve complex business challenges through digital transformation, product development and AI enablement. As a Senior Data Engineer at Parser, you will join a fast-growing team handling over 3.6 billion domain event messages per day (11.5 TB).

You will enrich and transform this data so it becomes available to all internal functions, people, and services, while embracing a growth mindset and solving complex

Qualifications

• 6–7 years of data engineering experience with Python or Scala.
• Experience delivering highly available and scalable data systems.
• Proficiency in SQL across relational and non-relational stores.

Responsibilities

• Develop data capture, processing, storage, distribution, and visualization.
• Understand and apply AWS standard methodologies and products (compute, storage, databases).
• Write clean, maintainable, and well-tested code.
• Develop scalable distributed systems focusing on availability and resiliency.
• Communicate and document solutions and design decisions.
• Propose new approaches and contribute to system architecture.
• Be part of an agile team that is continuously learning and improving.

Skills

Python

Scala

SQL

Distributed systems

AWS

Data modeling

Problem solving

Team collaboration

ETL

Tools

Kafka

Spark

Airflow

Hive

Kinesis

EMR

Docker

Job description

Parser is a boutique technology services and consulting firm helping global organisations solve complex business challenges through digital transformation, product development and AI enablement. As a Senior Data Engineer at Parser, you will join a fast-growing team handling over 3.6 billion domain event messages per day (11.5 TB).

You will enrich and transform this data so it becomes available to all internal functions, people, and services, while embracing a growth mindset and solving complex