Senior Spark/Scala Data Engineer - Complex Implementations

Skillfinder International; Remote; GBP 60,000 - 85,000; Full time

Job summary

A leading international recruitment firm is seeking a Senior Data Engineer with strong expertise in Spark and Scala for Quantexa implementations. This role involves building scalable data pipelines, mentoring junior engineers, and delivering key components of projects. The position is remote with occasional client site visits, requiring candidates to have a valid UK work visa. The ideal candidate will have hands-on delivery experience and excellent programming skills.

Qualifications

• Strong Spark + Scala engineering experience at a production level is essential.
• Excellent skills in object-oriented programming are required.
• Experience delivering Quantexa implementations must be hands-on.

Responsibilities

• Develop and optimise scalable data pipelines using Spark (Scala).
• Deliver key components of Quantexa implementations including data ingestion and transformation.
• Mentor and support junior engineers through code reviews and coaching.

Skills

Strong Spark + Scala engineering experience

Excellent object-oriented programming skills

Ability to mentor / coach junior engineers

Tools

Databricks

AWS

Azure

GCP

Airflow

ADF

Job description

A leading international recruitment firm is seeking a Senior Data Engineer with strong expertise in Spark and Scala for Quantexa implementations. This role involves building scalable data pipelines, mentoring junior engineers, and delivering key components of projects. The position is remote with occasional client site visits, requiring candidates to have a valid UK work visa. The ideal candidate will have hands-on delivery experience and excellent programming skills.