Senior Data Engineer (Spark/Kafka/Hadoop) - Hybrid Lisbon (3 days/week office)

HumanIT Digital Consulting; Lisboa; Hybrid; EUR 19.000 - 26.000; Vollzeit

Benefits dieser Stelle

15th month salary

Health insurance covering your family

Birthday off

Mobility program for digital nomads

Real work-life balance

Zusammenfassung

HumanIT Digital Consulting in Lisbon seeks a Senior Data Engineer to design, build and operate scalable data platforms and pipelines for marketing analytics, customer insights and AI/ML initiatives. The role involves shaping data architecture and accelerating cloud transformations in a 12-month project starting in November 2026.

Responsibilities include creating batch, streaming and real-time pipelines, frameworks for ingestion and orchestration, and governance, with a strong emphasis on

Qualifikationen

• Bachelor's degree required.
• Fluent English, written and spoken.
• Experience designing scalable data platforms and pipelines.
• Experience with Spark, Kafka, Hadoop and cloud-native data services.
• Experience with data governance, security, and lineage.

Aufgaben

• Build batch, streaming and real-time data pipelines for campaign measurement, reporting and insights.
• Develop reusable data ingestion, transformation and orchestration frameworks across lake/warehouse/lakehouse.
• Support modernization and cloud migration of legacy platforms.
• Strengthen data quality, observability, governance, lineage and security across data ecosystems.
• Mentor engineers, lead root-cause analysis and influence architecture decisions.
• Collaborate with Product, Engineering, Data Science and Analytics teams.

Kenntnisse

Spark

Kafka

Hadoop ecosystem

Cloud-native data services

Python

Java

SQL

ETL/ELT design patterns

Data architecture

CI/CD/DevOps

Ausbildung

Bachelor's degree in Computer Science, Engineering, Information Systems or a related field

Tools

AWS

Azure

GCP

Jobbeschreibung

Senior Data Engineer (Spark/Kafka/Hadoop) - Hybrid Lisbon (3 days/week office)

ABOUT THE OPPORTUNITY

Join the marketing technology division of a global technology leader. Its platforms power marketing measurement, customer insights and campaign optimization for businesses worldwide. As a Senior Data Engineer, you’ll design, build and operate scalable data platforms and pipelines at enterprise scale. You’ll also influence future‑state data architecture and help accelerate an ongoing cloud transformation. This is a 12‑month project starting in November 2026.

PROJECT & CONTEXT

• Build batch, streaming and real‑time data pipelines for business‑critical products in campaign measurement, reporting, customer insights and AI/ML.
• Develop reusable frameworks for data ingestion, transformation, orchestration and delivery across data lake, warehouse and lakehouse environments.
• Support the modernization and cloud migration of legacy platforms toward cloud‑native architectures.
• Strengthen data quality, observability, governance, lineage and security across the data ecosystem.
• Mentor engineers, lead root‑cause analysis on complex production issues and contribute to architectural decisions and technology roadmaps.
• Work in close partnership with Product, Engineering, Data Science, Analytics and Business stakeholders.
• The work model is hybrid, with 3 days per week on‑site in Lisbon and regular working hours. The selection process includes an interview with the client.

WHAT WE’RE LOOKING FOR (Required)

• Extensive experience designing and building scalable data platforms and distributed data processing solutions
• Strong expertise in Apache Spark, Apache Kafka, the Hadoop ecosystem, cloud‑native data services and large‑scale data processing frameworks
• Proficiency in one or more of the following: Python, Java, Scala or SQL
• Experience developing data pipelines for analytics, reporting, machine learning and operational data products
• Deep understanding of data modeling, ETL/ELT design patterns, data architecture and data lifecycle management
• Experience building and supporting solutions on AWS, Azure or GCP
• Knowledge of data governance, security, privacy, lineage, metadata management and regulatory compliance
• Experience with CI/CD, DevOps automation, Infrastructure-as‑Code and observability frameworks
• Proven experience leading technical initiatives, influencing architectural decisions and mentoring engineers
• Strong communication and stakeholder management skills across engineering, product, analytics and business teams
• Bachelor’s degree in Computer Science, Engineering, Information Systems or a related field
• Fluent English, written and spoken

NICE TO HAVE (Preferred)

• Advanced degree (MSc or equivalent)

Why HumanIT people stay (4.4 Glassdoor, 89% recommend)

• 15th month salary
• Health insurance covering your family
• Birthday off
• Mobility program for digital nomads
• Real work‑life balance

Compensation: €1700 – 2300 €/month net, depending on experience and seniority level.

Full benefits: https://www.humanit.pt/careers/#perks
What it’s really like: https://www.humanit.pt/careers/#work-at