Remote Spark, Scala & SQL Developer – Big Data

UST España & Latam; España; Remote; EUR 52,000 - 76,000; Full time

Benefits offered by this job

Health insurance

teleworking compensation

Life and Accident Insurances

Free access to training platforms

Professional stability and careerplans

Referral bonuses

12 or 14 payments

Work-life balance measures

UST Club Platform discounts

Job summary

UST España & Latam is seeking a Backend Developer Analyst with at least 2 years of experience in Apache Spark, Scala and SQL, preferably within Big Data environments. You will design and develop data pipelines and collaborate within agile teams in a setting remote from Spain.

The ideal candidate will have strong knowledge of Spark/Scala/SQL, CI/CD practices (GitHub, Jenkins, Sonar) and experience with Control-M and Airflow for workflow orchestration, supporting Market Risk data use cases.

Qualifications

• Minimum 2+ years of experience in big data or cloud data platforms.
• Hands-on Spark, Scala and SQL for large-scale data processing.
• Experience with CI/CD and software engineering practices (GitHub, Jenkins, Sonar).

Responsibilities

• Design, develop and maintain datalake pipelines using Spark, Scala and SQL.
• Orchestrate batch workflows with Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication for Market Risk use cases.
• Optimize performance, reliability and scalability of Spark workloads.
• Collaborate with agile squads and production support teams.
• Support production incidents and root-cause analysis.

Skills

Spark

Scala

SQL

CI/CD

Git

Jenkins

Airflow

Control-M

Data pipelines

Big Data

Teamwork

Tools

GitHub

Jenkins

Sonar

Control-M

Airflow

Job description

UST España & Latam is seeking a Backend Developer Analyst with at least 2 years of experience in Apache Spark, Scala and SQL, preferably within Big Data environments. You will design and develop data pipelines and collaborate within agile teams in a setting remote from Spain.

The ideal candidate will have strong knowledge of Spark/Scala/SQL, CI/CD practices (GitHub, Jenkins, Sonar) and experience with Control-M and Airflow for workflow orchestration, supporting Market Risk data use cases.