Spark, Scala, SQL Developer (100% remote within Spain)

UST; Madrid; Remote; EUR 55,000 - 75,000; Full time

Benefits offered by this job

Annual leave 23 days

Health care plan

Teleworking allowance

Flexible compensation

Training platforms

Career plans

Referral bonuses

Job summary

UST is seeking a Apache Spark Backend Developer Analyst with 2+ years in backend development and Big Data environments. You will design and maintain datalake pipelines using Spark, Scala and SQL, while orchestrating batch workflows with Control-M and Airflow.

The candidate should be fluent in English (C1) and comfortable working in a fully remote role based in Spain. Expect collaboration in agile squads, CI/CD practices, and production-support activity along with a strong focus on data quality

Qualifications

• Minimum 2+ years of experience in big data, datalake or cloud-based data platforms.
• Strong hands-on experience with Spark, Scala and SQL for large-scale data processing.
• Knowledge of datalake architecture, data quality controls, lineage and production-grade data pipelines.
• Excellent communication, teamwork, adaptability, productivity.
• Experience with workflow orchestration and scheduling tools, especially Control-M and Airflow.
• Databricks, Azure, YARN, AWS compute.
• Experience with CI/CD and software engineering practices, including GitHub, Jenkins and Sonar.
• Understanding of banking production processes, operational monitoring and incident management tools such as ServiceNow.
• Basic knowledge of Market Risk processes, including P&L, valuations, metrics and regulatory reporting data flows.

Responsibilities

• Design, develop and maintain datalake pipelines using Spark, Scala and SQL.
• Orchestrate batch workflows and dependencies with Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases.
• Optimize performance, reliability and scalability of Spark-based workloads.
• Analyze technical and functional gaps, propose solutions and support delivery planning.
• Support production incidents, root-cause analysis and continuous improvement of operational processes.
• Collaborate with agile squads, functional teams and production support teams to deliver business value.

Skills

AWS

Agile

Apache Airflow

Apache Spark

CI/CD

Control-M

Data Governance

Incident Management

Jenkins

GitHub

ETL

Job description

Role Description

We are looking for the very Top Talent…and we would be delighted if you were to join our team!

More in details, UST is a multinational company based in North America, certified as a Top Employer and Great Place to Work company with over 35.000 employees all over the world and presence in more than 35 countries. We are leaders on digital technology services, and we provide large-scale technologic solutions to big companies.

What we look for?

We are looking for Apache Spark (Backend Developer Analyst) with at least 2 years of experience in backend application development, particularly within Big Data environments using Apache Spark.

The ideal candidate is passionate about technology, follows Agile development methodologies, and has experience working in collaborative, continuously improving software teams.

Strong knowledge of SQL, Continuous Integration practices (Git, GitHub, Jenkins), and excellent communication skills in English C1 level are essential.

Main Tasks And Accountabilities Will Be

• Design, develop and maintain datalake pipelines using Spark, Scala and SQL.
• Orchestrate batch workflows and dependencies with Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases.
• Optimize performance, reliability and scalability of Spark-based workloads.
• Analyze technical and functional gaps, propose solutions and support delivery planning.
• Support production incidents, root-cause analysis and continuous improvement of operational processes.
• Collaborate with agile squads, functional teams and production support teams to deliver business value.

What do we expect from you?

Mandatory Requirements

• Minimum 2+ years of experience in big data, datalake or cloud-based data platforms.
• Strong hands-on experience with Spark, Scala and SQL for large-scale data processing.
• Knowledge of datalake architecture, data quality controls, lineage and production-grade data pipelines.
• Excellent communication, teamwork, adaptability, productivity.
• Experience with workflow orchestration and scheduling tools, especially Control-M and Airflow.
• Databricks, Azure, YARN, AWS compute.
• Experience with CI/CD and software engineering practices, including GitHub, Jenkins and Sonar.
• Understanding of banking production processes, operational monitoring and incident management tools such as ServiceNow.
• Basic knowledge of Market Risk processes, including P&L, valuations, metrics and regulatory reporting data flows.

Work Location

100% remote (Spain)

Work Schedule

Business hours.

What can we offer?

• 23 days of Annual Leave plus the 24th and 31st of December as discretionary days!
• Numerous benefits (Health Care Plan, teleworking compensation, Life and Accident Insurances).
• Retribución Flexible Program: (Meals, Kinder Garden, Transport, online English lessons, Health Care Plan)
• Free access to several training platforms
• Professional stability and career plans
• UST also, compensates referrals from which you could benefit when you refer professionals.
• The option to pick between 12 or 14 payments along the year.
• Real Work Life Balance measures (flexibility, WFH or remote work policy, compacted hours during summertime)
• UST Club Platform discounts and gym Access discounts

In UST we are committed to equal opportunities in our selection processes and do not discriminate based on race, gender, disability, age, religion, sexual orientation or nationality. We have a special commitment to Disability & Inclusion, so we are interested in hiring people with disability certificate.

Skills

• AWS
• Agile
• Apache Airflow
• Apache Spark
• CI/CD
• Control-M
• Data Governance
• Incident Management
• Jenkins
• GitHub
• ETL