Big Data Developer

buscojobs España; Lugo; A distancia; EUR 40.000 - 70.000; Jornada completa

Descripción de la vacante

A leading company in Spain is seeking an experienced Big Data Engineer to join their team. The role involves developing high-performance data analytics platforms and requires strong skills in Spark, Scala, and data pipeline architecture. Ideal candidates will have a degree in Computer Science or Engineering and proven experience in data engineering.

Formación

• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in Spark, HDFS, Airflow.
• Solid programming skills in Java and/or Scala.

Responsabilidades

• Develop migration tooling for job configurations.
• Write efficient, high-performance code in Scala.
• Design and implement distributed data systems.

Conocimientos

Spark

HDFS

Airflow

Java

Scala

Data pipeline architecture

Problem-solving

Communication

Educación

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field

Descripción del empleo

We are looking for an experienced Big Data Engineer to join the Grid Dynamics team in Spain. In this project, we are working at the forefront of Big Data technology to develop a high-performance data analytics platform capable of handling petabyte-scale datasets.

Key Responsibilities:

1. Develop migration tooling to facilitate the transfer of job configurations to a new data platform.
2. Write efficient, high-performance code in Scala.
3. Design and implement distributed data systems for high availability, reliability, and performance.
4. Collaborate with stakeholders and other software engineers to build robust platform features.
5. Ensure data integrity, governance, and security within the infrastructure.

Minimum Requirements:

1. Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
2. Proven experience as a Data Engineer or in a similar role.
3. Strong proficiency in Spark, HDFS, Airflow.
4. Solid programming skills in Java and/or Scala.
5. Experience with data pipeline architecture and implementation.
6. Expertise in building and maintaining continuous reporting systems and dashboards.
7. Familiarity with data warehousing concepts and technologies.
8. Strong problem-solving skills and attention to detail.
9. Excellent communication and collaboration skills.
10. Ability to work independently and in a remote team environment.