Data Engineer - Streaming Platform

TN United Kingdom; London; Hybrid; GBP 50,000 - 90,000; Full time

Job summary

An innovative digital bank is seeking talented data professionals to join their dynamic team in London. This role emphasizes collaboration and ownership, allowing you to design and implement cutting-edge data solutions. With a focus on streaming technologies and data quality, you'll work closely with cross-functional teams to drive impactful insights. Enjoy a hybrid work environment that fosters creativity and innovation, while benefiting from generous perks and a supportive culture. If you're passionate about transforming banking through technology, this is the perfect opportunity for you.

Benefits

25 days holiday plus public holidays

Extra day off for your birthday

Annual leave increases with service

16 hours paid volunteering time

Company enhanced pension scheme

Life insurance at 4x salary

Private Medical Insurance

Generous family-friendly policies

Perkbox membership

Cycle to Work scheme

Qualifications

• Strong experience in data transformation pipelines using Spark and PySpark.
• Familiarity with AWS EMR and managing Spark workloads.

Responsibilities

• Analyze source data from PostgreSQL to understand structures and relationships.
• Design and implement streaming data pipelines using AWS EMR and PySpark.

Skills

Python

Java

SQL

AWS EMR

DBT

Terraform

Docker

Kubernetes

Kafka

PySpark

Tools

PostgreSQL

BigQuery

Feast

Spark

Flink

KSQL

GCP

Job description

Social network you want to login/join with:

col-narrow-left

Client:

Starling Bank

Location:

London, United Kingdom

Job Category:

-

EU work permit required:

Yes

col-narrow-right

Job Reference:

a26a3b7b59bb

Job Views:

2

Posted:

08.05.2025

Expiry Date:

22.06.2025

col-wide

Job Description:

Starling is the UK’s first and leading digital bank on a mission to fix banking! Our vision is fast technology, fair service, and honest values. All at the tap of a phone, all the time.

Starling is the UK’s first and leading digital bank on a mission to fix banking! We built a new kind of bank because we knew technology had the power to help people save, spend and manage their money in a new and transformative way.

We’re a fully licensed UK bank with the culture and spirit of a fast-moving, disruptive tech company. We’re a bank, but better: fairer, easier to use and designed to demystify money for everyone. We employ more than 3,000 people across our London, Southampton, Cardiff and Manchester offices.

Our technologists are at the very heart of Starling and enjoy working in a fast-paced environment that is all about building things, creating new stuff, and disruptive technology that keeps us on the cutting edge of fintech. We operate a flat structure to empower you to make decisions regardless of what your primary responsibilities may be, innovation and collaboration will be at the core of everything you do. Help is never far away in our open culture, you will find support in your team and from across the business, we are in this together!

The way to thrive and shine within Starling is to be a self-driven individual and be able to take full ownership of everything around you: From building things, designing, discovering, to sharing knowledge with your colleagues and making sure all processes are efficient and productive to deliver the best possible results for our customers. Our purpose is underpinned by five Starling values: Listen, Keep It Simple, Do The Right Thing, Own It, and Aim For Greatness.

Hybrid Working

We have a Hybrid approach to working here at Starling - our preference is that you're located within a commutable distance of one of our offices so that we're able to interact and collaborate in person. In Technology, we're asking that you attend the office a minimum of 1 day per week.

Our Data teams are aligned to divisions covering the following Banking Services & Products, Customer Identity & Financial Crime and Data & ML Engineering. Our Data teams are excited about delivering meaningful and impactful insights to both the business and more importantly our customers. Hear from the team in our latest blogs or our case studies with Women in Tech.

We are looking for talented data professionals at all levels to join the team. We value people being engaged and caring about customers, caring about the code they write and the contribution they make to Starling. People with a broad ability to apply themselves to a multitude of problems and challenges, who can work across teams do great things here at Starling, to continue changing banking for good.

Responsibilities:

• Analyse source data from source databases (PostgreSQL) to understand structures, relationships and semantics.
• Design and implement streaming data pipelines using AWS EMR and PySpark to generate real-time (fast-moving) features for the feature store.
• Develop and maintain batch processing pipelines using DBT and BigQuery to generate batch (slow-moving) features, ensuring data quality, consistency and reliability.
• Work with Feast feature store, manage feature life cycle and maintain data quality.
• Collaborate with data scientists, ML engineers and software engineers to identify requirements, define feature schemas and ensure efficient integration into Feast feature store.

Requirements

• Good knowledge of programming languages such as Python or Java.
• Strong experience with streaming technologies (Spark, PySpark, Flink, KSQL or similar) for developing data transformation pipelines.
• Solid understanding and practical experience with SQL and relational databases (PostgreSQL preferred).
• Proficiency with AWS EMR for running and managing Spark workloads.
• Experience in SQL-based transformation workflows, particularly using DBT.
• Experience with Terraform to define and manage cloud infrastructure through code.
• Familiarity with GCP.
• Experience with containerisation technologies (Docker, Kubernetes).
• Familiarity with streaming data ingestion technologies (Kafka, Debezium).
• Exposure to feature store concepts and practices (Feast or similar).

Interviewing is a two way process and we want you to have the time and opportunity to get to know us, as much as we are getting to know you! Our interviews are conversational and we want to get the best from you, so come with questions and be curious. In general you can expect the below, following a chat with one of our Talent Team:

• Stage 1 - 45 mins with one of the team
• Stage 2 - Take-home challenge
• Stage 3 - 60 mins technical interview with two team members
• Stage 4 - 45 min final with two data executives
• 25 days holiday (plus take your public holiday allowance whenever works best for you)
• An extra day’s holiday for your birthday
• Annual leave is increased with length of service, and you can choose to buy or sell up to five extra days off
• 16 hours paid volunteering time a year
• Salary sacrifice, company enhanced pension scheme
• Life insurance at 4x your salary & group income protection
• Private Medical Insurance with VitalityHealth including mental health support and cancer care. Partner benefits include discounts with Waitrose, Mr&Mrs Smith and Peloton
• Generous family-friendly policies
• Perkbox membership giving access to retail discounts, a wellness platform for physical and mental health, and weekly free and boosted perks
• Access to initiatives like Cycle to Work, Salary Sacrificed Gym partnerships and Electric Vehicle (EV) leasing

About Us

You may be put off applying for a role because you don't tick every box. Forget that! While we can’t accommodate every flexible working request, we're always open to discussion. So, if you're excited about working with us, but aren’t sure if you're 100% there yet, get in touch anyway. We’re on a mission to radically reshape banking – and that starts with our brilliant team. Whatever came before, we’re proud to bring together people of all backgrounds and experiences who love working together to solve problems.

Starling Bank is an equal opportunity employer, and we’re proud of our ongoing efforts to foster diversity & inclusion in the workplace. Individuals seeking employment at Starling Bank are considered without regard to race, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, physical or mental disability, military or veteran status, or any other characteristic protected by applicable law.

When you provide us with this information, you are doing so at your own consent, with full knowledge that we will process this personal data in accordance with our Privacy Notice. By submitting your application, you agree that Starling Bank will collect your personal data for recruiting and related purposes. Our Privacy Notice explains what personal information we will process, where we will process your personal information, its purposes for processing your personal information, and the rights you can exercise over our use of your personal information.