Senior Data Engineer (Spark/Scala)

Talan Group; Málaga; A distancia; EUR 40.000 - 70.000; Jornada completa

Descripción de la vacante

An international consulting group is seeking a Senior Data Engineer based in Málaga, Spain. This position involves designing and optimizing ETL pipelines and working with big data technologies. The ideal candidate will have over 5 years of experience in data engineering, specifically with Apache Spark and Scala. A competitive full-time contract with remote work options and various benefits is offered.

Servicios

Private medical insurance

Life insurance

Training and career development

Smart Office Pack

Formación

• 5+ years of experience in implementing ETL pipelines.
• 3+ years of experience working with Apache Spark.
• 3+ years of hands-on experience with Scala programming.
• 2+ years of experience with BI tools (Databricks, Power BI, Starburst).
• Strong expertise in SQL and relational database systems.

Responsabilidades

• Design, develop, and optimize robust ETL pipelines.
• Build and maintain high-performance data models.
• Work with large-scale distributed systems.
• Ensure data quality through strong validation practices.
• Collaborate with cross-functional teams.

Conocimientos

ETL processes

Apache Spark

Scala programming

SQL

BI tools

Data validation

CI/CD principles

Herramientas

Databricks

Power BI

Starburst

Apache Hive

AWS S3

Descripción del empleo

Talan is an international consulting group specializing in innovation and business transformation through technology. With over 7,200 consultants in 21 countries and a turnover of €850M, we are committed to delivering impactful, future-ready solutions.

Talan at a Glance

Headquartered in Paris and operating globally, Talan combines technology, innovation, and empowerment to deliver measurable results for our clients. Over the past 22 years, we’ve built a strong presence in the IT and consulting landscape, and we’re on track to reach €1 billion in revenue this year.

Our Core Areas of Expertise

Data & Technologies: We design and implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI.
Cloud & Application Services: We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS, and IBM Maximo, helping clients transition to the cloud and improve operational efficiency.
Management & Innovation Consulting: We lead business and digital transformation initiatives through project and change management best practices (PM, PMO, Agile, Scrum, Product Ownership), and support domains such as Supply Chain, Cybersecurity, and ESG/Low-Carbon strategies.
We work with major global clients across diverse sectors, including Transport & Logistics, Financial Services, Energy & Utilities, Retail, and Media & Telecommunications.

Job Description

We are looking for a highly skilled Senior Data Engineer with strong experience in designing, building, and maintaining scalable data solutions. The ideal candidate has a deep understanding of ETL processes, big data technologies, and modern analytics platforms, and is comfortable working in fast-paced, data-driven environments.

Key Responsibilities

• Design, develop, and optimize robust ETL pipelines to support data ingestion, transformation, and processing at scale.
• Build and maintain high-performance data models to support analytics, reporting, and data science initiatives.
• Work with large-scale distributed systems and data lake architectures (Apache Hive, AWS S3, etc.).
• Ensure data quality through strong validation practices and automated testing.
• Collaborate closely with cross-functional teams to deliver secure, clean, and reliable data to downstream consumers.
• Implement and maintain CI/CD pipelines and align code to static analysis tools such as Sonar or Fortify.
• Work with BI tools and platforms (Databricks, Power BI, Starburst, etc.) to enable effective data visualization and insights.

Required Experience & Skills

• 5+ years of experience in implementing ETL pipelines.
• 3+ years of experience working with Apache Spark.
• 3+ years of hands‑on experience with Scala programming.
• 2+ years of experience with BI tools (Databricks, Power BI, Starburst, or similar).
• Strong expertise in SQL and relational database systems.
• Experience designing and implementing data models for enterprise use cases.
• Familiarity with data lakes and cloud-based storage environments (Apache Hive, AWS S3).
• Strong background in data validation, unit testing, and best practices for code quality.
• Solid understanding of CI/CD principles and experience delivering high-quality code in production environments.

Additional Information

• Full-time contract.
• Smart Office Pack so that you can work comfortably from home.
• Training and career development.
• Benefits and perks such as private medical insurance, life insurance.
• Possibility to be part of a multicultural team and work on international projects.
• This is a remote position based in Málaga, Spain. Relocation is mandatory.
• Possibility to manage work‑permits.

If you are passionate about development & tech, we want to meet you!

Talan Spain’s commitment to non-discrimination based on gender, race, ideology, or any other reason, in accordance with the company’s "Equality Plan" and the current regulations on gender equality between women and men (Royal Decree-Law 6/2019).