Big Data Developer

Grid Dynamics; Pamplona; Presencial; EUR 45.000 - 70.000; Jornada completa

Descripción de la vacante

A leading company in Spain is seeking an experienced Big Data Engineer to develop a high-performance data analytics platform. The role involves writing efficient code, designing distributed systems, and ensuring data integrity. Ideal candidates will have strong programming skills and experience with big data technologies.

Formación

• Proven experience as a Data Engineer or in a similar role.
• Experience with data pipeline architecture and implementation.

Responsabilidades

• Develop migration tooling for job configurations to a new data platform.
• Design and implement distributed data systems for high availability.

Conocimientos

Problem Solving

Communication

Collaboration

Educación

Bachelor’s or Master’s degree in Computer Science

Herramientas

Spark

HDFS

Airflow

Java

Scala

Descripción del empleo

We are looking for an experienced Big Data Engineer to join the Grid Dynamics team in Spain. In this project, we are working at the forefront of Big Data technology to develop a high-performance data analytics platform capable of handling petabyte-scale datasets.

Key Responsibilities:

1. Develop migration tooling to facilitate the transfer of job configurations to a new data platform.
2. Write efficient, high-performance code in Scala.
3. Design and implement distributed data systems for high availability, reliability, and performance.
4. Collaborate with stakeholders and other software engineers to build robust platform features.
5. Ensure data integrity, governance, and security within the infrastructure.

Minimum Requirements:

1. Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
2. Proven experience as a Data Engineer or in a similar role.
3. Strong proficiency in Spark, HDFS, Airflow.
4. Solid programming skills in Java and/or Scala.
5. Experience with data pipeline architecture and implementation.
6. Expertise in building and maintaining continuous reporting systems and dashboards.
7. Familiarity with data warehousing concepts and technologies.
8. Strong problem-solving skills and attention to detail.
9. Excellent communication and collaboration skills.
10. Ability to work independently and in a remote team environment.