Data Platform Lead: Spark, Kafka & BI (Remote Portugal)

Sportingtech; Viseu; Teletrabalho; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

Sportingtech is a multi-award-winning provider of turnkey betting and gaming solutions with offices worldwide and Portugal-based teams. The Data Engineer Team Lead will oversee the data development lifecycle, lead a growing team of engineers, and collaborate with project management, product, and architecture.

The role focuses on maintaining and evolving the data platform (Spark ETL, Kafka, PostgreSQL), implementing next-generation data lake architecture, and delivering reliable data for

Qualificações

• Excellent level of English, written and verbal.
• Experience in open-source data technologies (Spark, Hadoop, HBase, Hive, Kafka, Storm etc.).
• SQL and NoSQL technologies with data modelling and DWH design.
• Experience with Version Control Systems (GitLab/Git).
• Strong object-oriented design and development skills (Scala).
• Unix/Linux and shell scripting proficiency.
• Experience managing data pipelines in production with monitoring, alerting, incident response.
• Proactive thinking, result-oriented approach, and proven ability to lead and mentor engineers.
• Experience designing and consuming RESTful APIs.
• Solid understanding of database paradigms - columnar, distributed, and row-based.

Responsabilidades

• Lead the data platform, ETL pipelines, and data lake architecture.
• Align with SDLC, CI/CD, and database standards.
• Monitor data quality across datasets for regulatory reporting and BI.
• Improve data reliability, observability, and incident response.
• Develop and maintain Power BI reports and dashboards with BI team.
• Upskill and grow a team of Data Engineers and BI professionals.
• Audit and maintain current data platform for improvements.
• Coordinate data integration strategies with cross-functional teams.

Conhecimentos

English proficiency

Spark

Hadoop

HBase

Hive

Kafka

Storm

SQL

NoSQL

Scala

GitLab/Git

Unix/Linux

Shell scripting

RESTful APIs

Data modelling

DWH design

Ferramentas

GitLab/Git

Descrição da oferta de emprego

Sportingtech is a multi-award-winning provider of turnkey betting and gaming solutions with offices worldwide and Portugal-based teams. The Data Engineer Team Lead will oversee the data development lifecycle, lead a growing team of engineers, and collaborate with project management, product, and architecture.

The role focuses on maintaining and evolving the data platform (Spark ETL, Kafka, PostgreSQL), implementing next-generation data lake architecture, and delivering reliable data for