Enable job alerts via email!

Data Engineer

Ripjar

Manchester

Remote

GBP 80,000 - 100,000

Full time

Today
Be an early applicant

Job summary

A UK based software company is looking for a Data Engineer to enhance their Data Collection Hub. The role requires at least 2 years of experience with data processing systems and knowledge of Python and Node.js. This position offers remote working, a competitive salary, and generous benefits including healthcare, pension contributions, and technology perks.

Benefits

25 days annual leave + your birthday off
Remote working
Private Family Healthcare
Company contributions to your pension
Enhanced maternity/paternity pay
Latest tech including a MacBook Pro

Qualifications

  • At least 2 years experience in data processing systems.
  • Fluency in at least one programming language.
  • Experience with moderately complex software systems in production.

Responsibilities

  • Contribute production quality code and unit-tests to Data Collection Hub.
  • Improve test and build pipelines.
  • Support data processing pipelines as needed.
  • Model data for specific business needs.

Skills

Python (specifically pyspark)
Node.js
Hadoop stack technologies (HDFS, HBase)
MongoDB
Elasticsearch
Airflow
Nifi
Ansible

Education

Numerate degree (Computer Science preferred)

Tools

Jenkins
Jira
Confluence
Github

Job description

About Ripjar

Ripjar is a UK based software company that uses data and machine learning technologies to help companies and governments prevent financial crimes and terrorism. For example, our software was helping many financial institutions and corporations comply with the recent addition of sanctions on Russian entities.

Ripjar originally span out from GCHQ and now has 130 staff based in Cheltenham and remotely and are beginning to expand globally. We have two successful, inter-related products; Labyrinth Screening and Labyrinth Intelligence. Labyrinth Screening allows companies to monitor their customers or suppliers for entities that they aren't allowed to or do not want to do business with (for ethical or environmental reasons). Labyrinth Intelligence empowers organisation to perform deep investigations into varied datasets to find interesting patterns and relationships.

Data infuses everything Ripjar does. We work with a wide variety of datasets of all scales, including an always-growing archive of 8 billion news articles in (nearly!) every language in the world going back over 30 years, sanctions and watchlist data provided by governments, 250 million organisations and ownership data from global corporate registries.

About The Role

Ripjar has several engineering teams that are responsible for the processing infrastructure and many of the analytics that collect, organise, enrich and distribute this data. Central to almost all of Ripjar's systems is the Data Collection Hub, which captures data from various sources, processes and analyses it, and then forwards it on to multiple end-user applications. The system is developed and maintained by 3 teams of software engineers, data engineers, and data scientists.

We are looking for an individual with a least 2 years industrial or commercial experience in data processing systems to come in and add to this team. Ripjar values engineers who are thoughtful and thorough problem solvers who are able to learn new technologies, ideas and paradigms quickly.

Technology Stack

The specific technical skills you possess aren't as important to us as the ability to understand complex systems and get to the heart of problems. We do, however, expect you to be fluent in at least one programming language, have at least two years experience working with moderately complex software systems in production and have a curiosity and interest in learning more.

In this role, you will be using python (specifically pyspark) and Node.js for processing data, backed by various Hadoop stack technologies such as HDFS and HBase. MongoDB and Elasticsearch are used for indexing smaller datasets. Airflow & Nifi are used to co-ordinate the processing of data, while Jenkins, Jira, Confluence and Github are used as support tools. We use ansible to manage configuration and deployments. Most developers use Macbooks for development and our servers all run the CentOS flavour of Linux.

If you have any experience in this tech stack, that's useful, as is a numerate degree, such as Computer Science, but neither are required for the role.

Responsibilities:

  • Contributing production quality code and unit-tests to our Data Collection Hub
  • Contributing improvements to the test and build pipelines
  • Considering the impact and implications of changes and communicating these clearly
  • Helping to support the data processing pipelines as needed
  • Modelling data in the best way for specific business needs
  • Staying abreast of the latest developments in Data Engineering to contribute to Ripjar's best practices
  • Adding to Ripjar's culture and make it a fun and rewarding place to work!

Requirements:

The specific technical skills you possess aren't as important to us as the ability to understand complex systems and get to the heart of problems. We do, however, expect you to be fluent in at least one programming language, have at least two years experience working with moderately complex software systems in production and have a curiosity and interest in learning more.

  • You will be using Python (specifically pyspark) and Node.js for processing data
  • You will be using Hadoop stack technologies such as HDFS and HBase
  • Experience using MongoDB and Elasticsearch for indexing smaller datasets would be beneficial
  • Experience using Airflow & Nifi to co-ordinate the processing of data would be beneficial
  • You will be using Ansible to manage configuration and deployments

Salary And Benefits

  • Salary DOE
  • 25 days annual leave + your birthday off, in addition to bank holidays, rising to 30 days after 5 years of service
  • Remote working
  • Private Family Healthcare
  • Employee Assistance Programme
  • Company contributions to your pension
  • Pension salary sacrifice
  • Enhanced maternity/paternity pay
  • The latest tech including a top of the range MacBook Pro
Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.

Similar jobs