Senior Data Engineer

New Day; City Of London; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading financial services company in London is seeking a skilled data developer to work on their Nexus Platform. The role involves ensuring high code quality and collaborating with data engineers in an Agile environment. Ideal candidates should have expertise in Spark, Kafka, and AWS technologies. This permanent position requires a self-starter who can deliver high-quality results with minimal guidance.

Qualifications

• Proficiency in technologies such as Spark (SQL and/or Scala), and Kafka.
• Analytical and problem-solving skills applied to data solutions.
• Experience with integration of data from multiple sources.

Responsibilities

• Hands-on development on Nexus Platform.
• Responsible for the code quality and system simplicity.
• Work within an Agile framework with data engineers and designers.

Skills

Spark (SQL and/or Scala)

Kafka

Analytical skills

Problem-solving skills

Traditional database SQL

CI/CD best practices

AWS

DBT

Snowflake

Self-starter

Tools

MS SQL Server

Redshift

Aurora

Job description

What you will deliver

• Hands on development on Nexus Platform
• Responsible for the code quality and simplicity in the system
• Working with the team of data engineers and data designers within an Agile framework
• Building knowledge of all data resources within ND and prototype new data sources internally and externally

Skills and Experience

Essential

• Proficiency in technologies such as Spark (SQL and/or Scala), Kafka.
• Analytical and problem-solving skills, applied to data solution
• Proficiency with traditional database SQL technologies
• Experience with integration of data from multiple data sources
• Experience of CI/CD best practices
• Experience using AWS, DBT and Snowflake.
• Self starter with a proven track record of delivering work to high standard with minimal guidance.

Desirable

• Experience of ETL technologies
• AWS exposure (Athena, Glue, EMR, Step functions)
• Experience of relational database technologies (MS SQL Server, Redshift, Aurora)
• Experience with data solution BAU processes (ETL, table refresh, amongst others)

We work with Textio to make our job design and hiring inclusive.

Permanent