Data Engineer

Ubique Systems; Málaga; Presencial; EUR 40.000 - 60.000; Jornada completa

Descripción de la vacante

A leading technology firm in Andalucía, Málaga is seeking a Data Engineer to participate in Markets Data Hub tasks. Responsibilities include the definition and automation of processes using Big Data technologies like Spark Scala and Databricks. The ideal candidate should possess strong SQL skills and experience in ETL design and data validation. This position requires a professional level of English proficiency.

Formación

• Experience working in Big Data technologies such as Spark Scala and Databricks.
• Ability to automate processes using software deployments.

Responsabilidades

• Define and automate processes in Market Risk.
• Prepare data, create requests, and validate tests.

Conocimientos

Experience in technology-related projects

High knowledge of SQL statements

Experience in ETL design and data models

Knowledge of Control-M and Job as Code

Experience in testing and data validation

Professional competence in English

Descripción del empleo

Description: Participation in Markets Data Hub tasks as a Data Engineer in the definition and automation of processes developed using Big Data technologies (Spark Scala, Databricks, Airflow) in Market Risk. The key responsibilities will not be those of a Spark Scala developer, but rather process definition, data preparation, request creation following the department's procedures for process automation and configuration, and execution and validation of integrated tests. Process automation will be achieved through software deployments via Job as a Code.

• Experience in technology-related projects
• High knowledge of SQL statements
• Experience in ETL design and data models
• Knowledge of Control-M and Job as Code
• Experience in testing and data validation
• English – professional competence