Senior Spark & Scala SQL Engineer for Big Data (Remote)

UST; Madrid; Remote; EUR 55,000 - 75,000; Full time

Benefits offered by this job

Annual leave 23 days

Health care plan

Teleworking allowance

Flexible compensation

Training platforms

Career plans

Referral bonuses

Job summary

UST is seeking a Apache Spark Backend Developer Analyst with 2+ years in backend development and Big Data environments. You will design and maintain datalake pipelines using Spark, Scala and SQL, while orchestrating batch workflows with Control-M and Airflow.

The candidate should be fluent in English (C1) and comfortable working in a fully remote role based in Spain. Expect collaboration in agile squads, CI/CD practices, and production-support activity along with a strong focus on data quality

Qualifications

• Minimum 2+ years of experience in big data, datalake or cloud-based data platforms.
• Strong hands-on experience with Spark, Scala and SQL for large-scale data processing.
• Knowledge of datalake architecture, data quality controls, lineage and production-grade data pipelines.
• Excellent communication, teamwork, adaptability, productivity.
• Experience with workflow orchestration and scheduling tools, especially Control-M and Airflow.
• Databricks, Azure, YARN, AWS compute.
• Experience with CI/CD and software engineering practices, including GitHub, Jenkins and Sonar.
• Understanding of banking production processes, operational monitoring and incident management tools such as ServiceNow.
• Basic knowledge of Market Risk processes, including P&L, valuations, metrics and regulatory reporting data flows.

Responsibilities

• Design, develop and maintain datalake pipelines using Spark, Scala and SQL.
• Orchestrate batch workflows and dependencies with Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases.
• Optimize performance, reliability and scalability of Spark-based workloads.
• Analyze technical and functional gaps, propose solutions and support delivery planning.
• Support production incidents, root-cause analysis and continuous improvement of operational processes.
• Collaborate with agile squads, functional teams and production support teams to deliver business value.

Skills

AWS

Agile

Apache Airflow

Apache Spark

CI/CD

Control-M

Data Governance

Incident Management

Jenkins

GitHub

ETL

Job description

UST is seeking a Apache Spark Backend Developer Analyst with 2+ years in backend development and Big Data environments. You will design and maintain datalake pipelines using Spark, Scala and SQL, while orchestrating batch workflows with Control-M and Airflow.

The candidate should be fluent in English (C1) and comfortable working in a fully remote role based in Spain. Expect collaboration in agile squads, CI/CD practices, and production-support activity along with a strong focus on data quality