Remote Big Data Engineer – Spark, Scala & SQL

Talan; United States; Remote; USD 90,000 - 150,000; Full time

Benefits offered by this job

Remote work

Career development

Multicultural environment

Private medical insurance

Life insurance

Meal and transport cards

Online language classes

Smart Office Pack

Job summary

Talan is hiring a Big Data Developer to design, develop, and evolve data lake solutions for Market Risk in an Agile environment. You will work with Spark, Scala and SQL to build large-scale data pipelines, enabling ingestion, transformation and publication of critical data.

The role combines hands-on development with collaboration across squads and production support, following best practices to deliver robust, scalable data solutions. 100% remote work is offered with global collaboration.

Qualifications

• 2+ years of professional experience in Big Data, Data Lakes or cloud-based data platforms.
• Strong hands-on experience with Apache Spark, Scala and SQL for large-scale data processing.
• Good understanding of Data Lake architecture, data quality controls, data lineage and production-grade data pipelines.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork skills, with the ability to collaborate with technical and functional stakeholders.

Responsibilities

• Design, develop and maintain data lake pipelines using Apache Spark, Scala and SQL.
• Build and maintain scalable data processing solutions for large volumes of data.
• Orchestrate batch workflows using tools like Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication for Market Risk use cases.
• Analyse and optimise Spark-based workloads for performance, reliability and scalability.
• Collaborate with Agile squads and production support teams to deliver high-quality solutions.

Skills

Big Data

Spark

Scala

SQL

Data Lake architecture

Analytical thinking

Communication

Adaptability

English proficiency

Tools

Apache Spark

Databricks

Azure

AWS

Control-M

Airflow

GitHub

Jenkins

SonarQube

Job description

Talan is hiring a Big Data Developer to design, develop, and evolve data lake solutions for Market Risk in an Agile environment. You will work with Spark, Scala and SQL to build large-scale data pipelines, enabling ingestion, transformation and publication of critical data.

The role combines hands-on development with collaboration across squads and production support, following best practices to deliver robust, scalable data solutions. 100% remote work is offered with global collaboration.