TechLead Data Engineering

Talan Group; Warszawa; On-site; PLN 340,280 - 467,886; Full time

Benefits offered by this job

Career development opportunities

Challenging multicultural environment

Training opportunities in finance and technology

Job summary

A global IT consultancy is seeking an experienced Tech Lead in Data Engineering based in Warsaw, Poland. This permanent, full-time position combines hands-on engineering with leadership responsibilities across significant data engineering projects. The ideal candidate will have over 7 years of experience in Big Data systems, combined with strong expertise in Scala/Spark and a proven track record in cloud environments. They will manage and mentor a team to ensure successful project delivery while maintaining high standards of code quality and security.

Qualifications

• 7+ years of experience in Big Data systems and data management.
• 3+ years of hands-on experience with Scala/Spark.
• Strong documentation and communication skills.

Responsibilities

• Lead end-to-end technical delivery of data engineering projects.
• Architect and optimize scalable data pipelines.
• Mentor and support engineers, ensuring technical excellence.

Skills

Data engineering projects

Scala/Spark experience

Big Data technologies

Cloud environments

CI/CD pipelines

Team leadership

English fluency

Education

Bachelor’s degree in technical or mathematical studies

Tools

GitHub Actions

Databricks

Airflow

Docker

Kubernetes

Kafka

React

Job description

Job Description

We are looking for a Tech Lead in Data Engineering team with a strong background in Spark/Scala technology to lead the design and delivery of cutting‑edge data‑driven solutions. This role combines hands‑on engineering with technical leadership – you will both architect scalable data systems and guide a team to successful implementation.

As a Technical Leader, your will:

• Lead end‑to‑end technical delivery of data engineering projects.
• Architect, design, and implement scalable data pipelines and platforms.
• Optimize workflows for data ingestion, processing, and storage (Spark, Airflow, Cloudera, DataBricks, Hive).
• Develop and maintain data lake solutions for structured and unstructured data.
• Collaborate with global teams (business, data, and technology) to align solutions with organizational objectives.
• Oversee code quality, CI/CD pipelines, versioning, and release management.
• Write and review high‑quality Scala/Spark code and contribute to automation.
• Mentor and support engineers, fostering technical excellence and growth.
• Ensure delivery is aligned with regulatory and compliance requirements.
• Hands‑on experience with testing Big Data solutions – unit tests, integration tests, E2E tests.
• Understanding AI tools and techniques and how they can contribute to increasing development efficiency.

Qualifications

• 7+ years of experience in Big Data systems and data management.
• 3+ years of hands‑on experience with Scala/Spark.
• Hands‑on with Big Data technologies like Spark, Cloudera, Data Platform, Airflow, Hive.
• Excellent understanding of dimensional data and data modeling techniques.
• Experience implementing and deploying solutions in cloud environments.
• Ability to work independently and take ownership of project deliverables.
• Fluent in English (at least C1 level).
• Bachelor’s degree in technical or mathematical studies.
• Strong communication skills, at least 2 years leading development teams.

• CI/CD and orchestration tools: GitHub Actions, Airflow, Control‑M, Bash scripting.
• Knowledge of Databricks, Kafka, Docker, Kubernetes, OpenShift.
• Familiarity with cybersecurity practices, code quality (Sonar), code security (Fortify) and SDLC.
• Experience with microservices architecture, REST APIs, front‑end technologies (React, NextJS) and back‑end technologies (NodeJS).

Additional Information

What do we offer you?

• Hybrid position based in Warsaw, Poland.
• Permanent, full‑time contract with career development opportunities.
• Chance to work in a challenging, multicultural environment with international projects.
• Exposure to large‑scale financial IT systems and cross‑country operations.
• Training opportunities to develop new skills in finance, technology, and data management.

Talan Spain’s commitment to non‑discrimination based on gender, race, ideology, or any other reason, in accordance with the company’s "Equality Plan" and the current regulations on gender equality between women and men (Royal Decree‑Law 6/2019).