Data Engineer-Big Data. Teletrabajo

buscojobs España; Madrid; A distancia; EUR 40.000 - 60.000; Jornada completa

Descripción de la vacante

Une entreprise dynamique recherche un Data Engineer spécialisé en Scala et Spark pour un projet stable. Ce poste offre la flexibilité du travail à distance et nécessite des compétences en gestion d'infrastructure big data et en mentorat de développeurs juniors. Vous travaillerez avec des technologies avancées et intégrerez une équipe de professionnels passionnés.

Formación

• Proficient in SQL, capable of testing changes.
• Solid experience with Control-M.
• High proficiency in Spanish and English.

Responsabilidades

• Support and mentor junior developers.
• Implement scalable big data infrastructure.
• Utilize AWS services and develop scripts.

Conocimientos

SQL

Bash

Python

Scala

Spark

Control-M

Infrastructures as Code

AWS

NoSQL

Hadoop

Educación

Formation en Technologie et Compétences Douces

Herramientas

Terraform

Jira

Descripción del empleo

Job Title: Data Engineer Scala Spark (Full Remote)

Company: Grupo Digital

Location: Madrid (Remote)

EU Work Permit Required: Yes

Job Description

We are seeking a Data Engineer with expertise in Scala and Spark for a stable project. This role offers the flexibility of full remote work.

Responsibilities

1. Support, oversee, mentor, and guide junior developers, including providing guidance on best practices, technical solutions, peer reviews, and testing documentation.
2. Implement and manage scalable big data infrastructure using Infrastructure as Code (IaC) tools such as Terraform.
3. Utilize AWS services such as EMR, EC2, Lambda, Step Functions, and Glue.
4. Work with Big Data Technologies including Hadoop, Spark/Scala, and NoSQL databases.
5. Design and monitor batch processing workflows.
6. Develop scripts using Bash and Python.
7. Use deployment tools and manage tasks with Jira.
8. Create test case scenarios and perform testing.
9. Perform data and process analysis to create specification documents.

Requirements

1. Proficiency in SQL, capable of testing changes and replicating code functionality.
2. Experience with creating and executing test cases.
3. Solid experience with Control-M.
4. High proficiency in Spanish and English.
5. Training in Technology and Soft Skills.