Senior Spark Backend Architect | Big Data Platform

Talan Group; Málaga; Presencial; EUR 70.000 - 110.000; Jornada completa

Descripción de la vacante

Talan Group in Spain is seeking a Senior Backend Spark Developer to join the Client Contribution Platform team. You will design, develop, and optimize large-scale data processing solutions, mentoring peers and driving architecture decisions to ensure scalability, reliability, and performance.

You will lead data pipelines, collaborate with cross-functional teams, and promote Agile and CI/CD practices, while exploring AI-assisted development and automation enhancements.

Formación

• 5+ years of hands-on experience developing Big Data solutions with Apache Spark.
• Strong experience programming in Scala (preferred) or Python.
• Solid SQL skills and experience with data modeling.
• Experience working with Big Data platforms such as Azure Databricks, Apache Hive, or similar Spark-based environments.
• Experience working in Agile environments and applying CI/CD and DevOps best practices.
• Hands-on experience with Git, GitHub, SonarQube, Nexus.
• English level B2+ or above.

Responsabilidades

• Design, develop, and optimize scalable Big Data solutions using Apache Spark.
• Lead technical decisions and contribute to the architecture of data processing solutions.
• Develop, maintain, and optimize Big Data pipelines.
• Support data integration initiatives across multiple systems and workstreams.
• Ensure the performance, scalability, and reliability of data processing applications.
• Troubleshoot and resolve complex technical and performance issues.
• Collaborate with stakeholders to define and implement solutions.
• Promote Agile practices and CI/CD/DevOps processes.
• Mentor and support junior and mid-level developers.
• Explore AI-assisted development and automation adoption.

Conocimientos

Apache Spark

Scala

Python

SQL

Data modeling

CI/CD

DevOps

Mentoring

English B2+

Analytical skills

Herramientas

Azure Databricks

Apache Hive

Control-M

Apache Airflow

Hadoop ecosystems

Git

GitHub

SonarQube

Nexus

Descripción del empleo

Talan Group in Spain is seeking a Senior Backend Spark Developer to join the Client Contribution Platform team. You will design, develop, and optimize large-scale data processing solutions, mentoring peers and driving architecture decisions to ensure scalability, reliability, and performance.

You will lead data pipelines, collaborate with cross-functional teams, and promote Agile and CI/CD practices, while exploring AI-assisted development and automation enhancements.