Big Data Developer

Talan; Málaga; À distance; EUR 40 000 - 60 000; Plein temps

Avantages offerts par ce poste

100% remote

Career growth

Multicultural environment

Private medical insurance

Life insurance

Lunch and transport cards

Online language classes

Smart Office Pack

Résumé du poste

Talan is seeking a Big Data Developer to design and evolve data lake solutions for Market Risk, leveraging Spark, Scala and SQL to process large data volumes.

You will collaborate within Agile squads across production support and functional teams, implementing ingestion, validation and publication workflows while ensuring performance, reliability and scalability across platforms.

Qualifications

• 2+ years of professional experience in Big Data, Data Lakes or cloud-based data platforms.
• Strong hands-on experience with Apache Spark, Scala and SQL for large-scale data processing.
• Good understanding of Data Lake architecture, data quality controls, data lineage and production-grade data pipelines.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork skills, with the ability to collaborate with technical and functional stakeholders.
• Adaptability and a proactive approach to solving technical challenges.
• English: C1 level or equivalent professional fluency.
• Spanish is considered a plus.

Responsabilités

• Design, develop and maintain data lake pipelines using Apache Spark, Scala and SQL.
• Build and maintain scalable data processing solutions for large volumes of data.
• Orchestrate batch workflows and dependencies using Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases.
• Analyse and optimise performance, reliability and scalability of Spark-based workloads.
• Analyse requirements, identify gaps and propose effective solutions.
• Contribute to delivery planning and collaborate with teams for successful implementation.
• Support production incidents, perform root-cause analysis and contribute to operational improvements.
• Work with Agile squads and production support teams to deliver high-quality solutions.

Connaissances

Spark

Scala

SQL

English C1

Outils

Control-M

Airflow

Databricks

Azure

AWS

YARN

GitHub

Jenkins

SonarQube

Description du poste

We are looking for a Big Data Developer to join an Agile environment and work on the design, development and evolution of data lake solutions for Market Risk use cases.

You will work with technologies such as Spark, Scala and SQL, developing large-scale data processing pipelines and contributing to the ingestion, transformation, validation and publication of critical data.

The role combines hands‑on technical development with problem‑solving and collaboration across Agile squads, functional teams and production support teams.

What will you do?

• Design, develop and maintain data lake pipelines using Apache Spark, Scala and SQL.
• Build and maintain scalable data processing solutions for large volumes of data.
• Orchestrate batch workflows and dependencies using tools such as Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases.
• Analyse and optimise the performance, reliability and scalability of Spark‑based workloads.
• Analyse technical and functional requirements, identify gaps and propose effective solutions.
• Contribute to delivery planning and collaborate with different teams to ensure successful implementation.
• Support production incidents, perform root‑cause analysis and contribute to continuous improvement of operational processes.
• Work closely with Agile squads, functional teams and production support teams to deliver high‑quality solutions and business value.
• Follow software engineering and data development best practices to ensure robust, maintainable and production‑ready solutions.

Qualifications

What are we looking for?

Mandatory requirements:

• 2+ years of professional experience in Big Data, Data Lakes or cloud‑based data platforms.
• Strong hands‑on experience with Apache Spark, Scala and SQL for large‑scale data processing.
• Good understanding of Data Lake architecture, data quality controls, data lineage and production‑grade data pipelines.
• Strong analytical and problem‑solving skills.
• Excellent communication and teamwork skills, with the ability to collaborate effectively with technical and functional stakeholders.
• Adaptability and a proactive approach to solving technical challenges.
• English: C1 level or equivalent professional fluency.
• Spanish is considered a plus.

Nice to have

Experience with any of the following will be highly valued:

• Workflow orchestration and scheduling tools, particularly Control-M and Airflow.
• Databricks and cloud technologies such as Azure and AWS.
• YARN and cloud‑based compute environments.
• CI/CD and software engineering practices, including GitHub, Jenkins and SonarQube.
• Banking production environments, operational monitoring and incident management tools such as ServiceNow.
• Knowledge of Market Risk processes, including P&L, valuations, risk metrics and regulatory reporting data flows.

Additional Information

What do we offer you?

• 100% remote working with the flexibility to work from wherever you are.
• Professional growth and career development opportunities, with access to continuous learning.
• The opportunity to join a multicultural and international environment, collaborating with colleagues and teams across different countries.
• A comprehensive range of benefits designed to support your physical, emotional and financial wellbeing, including:
  • Private medical insurance
  • Life insurance
  • Lunch and transport cards through our flexible remuneration programme
  • Online language classes
• Smart Office Pack to support your remote working experience.

Talan Spain’s commitment to non‑discrimination based on gender, race, ideology, or any other reason, in accordance with the company’s "Equality Plan" and the current regulations on gender equality between women and men (Royal Decree‑Law 6/2019).

Company Description

Talan is an international consulting group specializing in innovation and business transformation through technology. With over 7,200 consultantsin 21 countriesand a turnover of €850M, we are committed to delivering impactful, future‑ready solutions.

Talan at a Glance

Headquartered in Paris and operating globally, Talan combines technology, innovation, and empowermentto deliver measurable results for our clients. Over the past 22 years, we’ve built a strong presence in the IT and consulting landscape, and we’re on track to reach €1 billion in revenuethis year.

Our Core Areas of Expertise

• Data & Technologies:We design and implement large-scale, end‑to‑end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI.
• Cloud & Application Services:We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS, and IBM Maximo, helping clients transition to the cloud and improve operational efficiency.
• Management & Innovation Consulting:We lead business and digital transformation initiativesthrough project and change management best practices (PM, PMO, Agile, Scrum, Product Ownership), and support domains such as Supply Chain, Cybersecurity, and ESG/Low‑Carbon strategies.

We work with major global clients across diverse sectors, including Transport & Logistics, Financial Services, Energy & Utilities, Retail, and Media & Telecommunications.