Data Platform Lead: Spark, Kafka & Data Excellence

Sportingtech; Lisboa; Remote; EUR 60,000 - 90,000; Full time

Job summary

Sportingtech is seeking a Data Engineer Team Lead to steer the data development lifecycle, supervise a growing team, and ensure timely delivery of data initiatives. You will maintain and enhance a Spark-based ETL platform, Kafka messaging, and a PostgreSQL data warehouse while aligning with SDLC and CI/CD practices.

Collaboration with cross-functional teams and a focus on data quality are essential. Exposure to iGaming or regulated environments, and strong English communication are required for

Qualifications

• Fluent in English, both written and spoken.
• Proven experience leading data teams and mentoring engineers.
• Strong background in building and operating data pipelines in production.
• Experience designing and consuming RESTful APIs.
• Proficient with Unix/Linux and shell scripting.
• Demonstrated proactive, results-oriented leadership.
• Ability to operate in regulated iGaming or similar environments.

Responsibilities

• Lead a team of Data Engineers and BI professionals, focusing on delivery and performance.
• Maintain and evolve Spark-based ETL, Kafka pipelines, and PostgreSQL data warehouse.
• Collaborate with project management, product, and architecture.
• Develop reports/dashboards in Power BI with BI Developers.
• Oversee data quality, observability, and incident response across data platforms.
• Coordinate data integration strategies with cross-functional teams.

Skills

English fluency

Leadership & mentoring

Data pipeline design

RESTful APIs

Unix/Linux scripting

Proactive problem solving

Incident response

Regulated environment experience

Tools

Spark

Hadoop

HBase

Hive

Kafka

Storm

GitLab/Git

PostgreSQL

Power BI

Grafana

AWS (S3)

Job description

Sportingtech is seeking a Data Engineer Team Lead to steer the data development lifecycle, supervise a growing team, and ensure timely delivery of data initiatives. You will maintain and enhance a Spark-based ETL platform, Kafka messaging, and a PostgreSQL data warehouse while aligning with SDLC and CI/CD practices.

Collaboration with cross-functional teams and a focus on data quality are essential. Exposure to iGaming or regulated environments, and strong English communication are required for