Senior Data Engineer - Leeds Based

Lorien; West Yorkshire; On-site; GBP 50,000 - 80,000; Full time

Job summary

A leading technology company is seeking a Senior Data Engineer to join their new start-up engineering capability in Leeds. The role involves providing data engineering services to major Public Sector organisations and requires proficiency in Python, Scala, SQL, and Databricks. Applicants must demonstrate experience with data pipelines and a solid understanding of system architecture focused on data security. This opportunity offers significant growth potential in a collaborative and innovative environment.

Qualifications

• Experience in prominent languages such as Python, Scala, Spark, SQL.
• Good experience in using Databricks.
• Experience working with any database technologies.
• Experience with the design, build and maintenance of data pipelines.
• Understanding of design practices and system architecture with a focus on data security.

Responsibilities

• Provide best in class Data Engineering services to Public Sector organisations.
• Help establish the culture and ways of working of a new onshore engineering team.
• Build and be part of a new concept in the technology market.

Skills

Python

Scala

Spark

SQL

Databricks

Oracle

MySQL

MongoDB

Data security

Problem solving

Job description

Senior Data Engineers with a background are required by this major client, who is creating a new start up engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations.

As a result of the work that they do, this client requires applicants to hold or be capable of obtaining UK National Security Vetting, the requirements for which could include but not be limited to having resided in the UK for at least the past 5 years and being a UK national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements.

In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience:

• Experience in prominent languages such as Python, Scala, Spark, SQL.
• Good experience in using Databricks
• Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc.
• Experience with the design, build and maintenance of data pipelines and infrastructure
• Understanding of design practices and system architecture and with a focus on data security
• Excellent problem solving skills with experience of troubleshooting and resolving data-related issues

Skills they would love to see:

• Experience in data engineering/analytics/ architecture using native technologies of least one cloud platform (AWS, Azure, GCP)
• Interest in building Machine learning and Data science applications
• Ability to use wide variety of open-source technologies
• Knowledge and experience using at least one Data Platform Technology such as Quantexa, or Palantir
• Knowledge of test automation frameworks and ability to automate testing within the pipeline

This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of a new concept. This client is creating an onshore engineering team to gain access to a new segment of the technology market where there is opportunity for significant growth. They are looking for people to help establish the culture and ways of working of the team so we are well placed to make the most of this opportunity.

Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.