Senior Big Data Engineer

Grid Dynamics International, Inc.; Málaga; A distancia; EUR 60.000 - 90.000; Jornada completa

Descripción de la vacante

A leading technology consulting firm seeks a Senior Big Data Engineer to design and implement scalable data processing pipelines. The role requires excellent skills in Scala, Apache Spark, and SQL. The position is remote from Spain and offers an opportunity to work on innovative projects with a dedicated team.

Servicios

Opportunity to work on cutting-edge projects

Work with a motivated team

Formación

• Strong programming experience with Scala and distributed data frameworks like Apache Spark.
• Proficiency in SQL and experience handling large datasets in HDFS environments.
• Hands-on experience developing and testing in Docker and/or Kubernetes environments.

Responsabilidades

• Design and develop large-scale data pipelines and infrastructure to process high-volume datasets.
• Build and maintain scalable, production-grade ETL / ELT workflows.
• Collaborate with analysts, platform teams, and product stakeholders to deliver data-driven solutions.

Conocimientos

Scala programming

Apache Spark

SQL

Python

Docker

Kubernetes

Descripción del empleo

Location : Remote from Spain

Employment Type : Full-Time Contractor

About the Project

Join the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and external stakeholders. Our team develops robust data infrastructure and high-performance pipelines that power critical media analytics and projection datasets.

About the Role

We’re seeking a Senior Big Data Engineer who can work independently and proactively to design, implement, and maintain scalable data processing pipelines. You will contribute to a high-performing team responsible for infrastructure critical to analytics, modeling, and media performance reporting.

Essential functions

• Design and develop large-scale data pipelines and infrastructure to process high-volume datasets.
• Build and maintain scalable, production-grade ETL / ELT workflows using Apache Spark, Scala, and SQL.
• Work with distributed file systems (HDFS) and optimize data processing performance.
• Write and test reusable and reliable code using functional programming libraries like Cats and fs2.
• Develop and test solutions in containerized environments (e.g., Docker, Kubernetes).
• Collaborate with analysts, platform teams, and product stakeholders to deliver data-driven solutions.
• Take ownership of services with minimal supervision, demonstrating initiative and autonomy.

Qualifications

• Strong programming experience with Scala and distributed data frameworks like Apache Spark.
• Proficiency in SQL and experience handling large datasets in HDFS environments.
• Working knowledge of Python for scripting and data manipulation tasks.
• Hands-on experience developing and testing in Docker and/or Kubernetes environments.
• Familiarity with Cats, fs2, or other advanced Scala functional programming libraries.
• Ability to work autonomously in a dynamic, fast-paced environment and take full ownership of projects.

We offer

• Opportunity to work on cutting-edge projects.
• Work with a highly motivated and dedicated team.

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Founded in 2006 and headquartered in Silicon Valley, with offices across the Americas, Europe, and India, we solve pressing technical challenges and enable positive business outcomes for enterprise companies undergoing digital transformation.

Apply to the position

• Country of application
• Resume
• Social profile
• First name
• Last name
• E-mail
• Phone
• City of application
• Consent to personal data processing for future recruitment processes

I consent to Grid Dynamics processing my personal data for future recruitment purposes.

We are an equal opportunity employer committed to creating an inclusive environment for all employees and candidates. Qualified applicants will be considered without regard to age, race, gender, or other protected categories.