Remote Spark-Scala SQL Backend Engineer

UST; United States; Remote; USD 62,000 - 92,000; Full time

Benefits offered by this job

Annual leave

Health care plan

Teleworking compensation

Life and Accident Insurance

Flexible compensation program

Training platforms access

Career plans

Referral bonuses

Flexible payment options

Work-life balance measures

Platform discounts

Job summary

UST is seeking a Backend Developer Analyst with 2+ years in big data and Spark to design and maintain datalake pipelines. You will work with Spark, Scala and SQL, orchestrate workflows with Control-M and Airflow, and ensure data quality and production readiness in a collaborative Agile environment.

Responsibilities include data ingestion, transformation, validation and publication for Market Risk use cases, plus troubleshooting and continuous improvement. 100% remote (Spain) with flexible hours.

Qualifications

• Minimum 2+ years of experience in big data, datalake or cloud-based data platforms.
• Strong hands-on experience with Spark, Scala and SQL for large-scale data processing.
• Knowledge of datalake architecture, data quality controls, lineage and production-grade data pipelines.
• Excellent communication, teamwork, adaptability, productivity.
• Experience with workflow orchestration and scheduling tools, especially Control-M and Airflow.
• Databricks, Azure, YARN, AWS compute.
• Experience with CI/CD and software engineering practices, including GitHub, Jenkins and Sonar.
• Understanding of banking production processes, operational monitoring and incident management tools such as ServiceNow.
• Basic knowledge of Market Risk processes, including P&L, valuations, metrics and regulatory reporting data flows.

Responsibilities

• Design, develop and maintain datalake pipelines using Spark, Scala and SQL.
• Orchestrate batch workflows and dependencies with Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases.
• Optimize performance, reliability and scalability of Spark-based workloads.
• Analyze technical and functional gaps, propose solutions and support delivery planning.
• Support production incidents, root-cause analysis and continuous improvement of operational processes.
• Collaborate with agile squads, functional teams and production support teams to deliver business value.

Skills

Apache Spark

Scala

SQL

Airflow

Control-M

CI/CD

GitHub

Jenkins

AWS

ETL

Data Governance

Incident Management

Agile

Tools

Databricks

Azure

AWS

YARN

ServiceNow

Job description

UST is seeking a Backend Developer Analyst with 2+ years in big data and Spark to design and maintain datalake pipelines. You will work with Spark, Scala and SQL, orchestrate workflows with Control-M and Airflow, and ensure data quality and production readiness in a collaborative Agile environment.

Responsibilities include data ingestion, transformation, validation and publication for Market Risk use cases, plus troubleshooting and continuous improvement. 100% remote (Spain) with flexible hours.