Data Engineer

Ripjar; Manchester; Remote; GBP 40,000 - 55,000; Full time

Job summary

A leading UK software company seeks a Data Engineer to join their expanding team. The role involves contributing to the Data Collection Hub, utilizing technologies like Python and Hadoop. Ideal candidates will have experience in data processing systems and a passion for learning. The company offers a supportive work environment and competitive benefits.

Benefits

25 days annual leave + birthday off

Remote working

Private Family Healthcare

Employee Assistance Programme

Pension contributions

Enhanced maternity/paternity pay

Latest tech including MacBook Pro

Qualifications

• At least 2 years experience in data processing systems.
• Fluent in at least one programming language.

Responsibilities

• Contributing production quality code to the Data Collection Hub.
• Improving test and build pipelines.
• Supporting data processing pipelines as needed.

Skills

Python

Node.js

Data Processing

Education

Numerate Degree

Tools

Hadoop

MongoDB

Elasticsearch

Airflow

Nifi

Ansible

Jenkins

Jira

Confluence

Github

Job description

3 weeks ago Be among the first 25 applicants

About Ripjar

Ripjar is a UK based software company that uses data and machine learning technologies to help companies and governments prevent financial crimes and terrorism. For example, our software was helping many financial institutions and corporations comply with the recent addition of sanctions on Russian entities.

About Ripjar

Ripjar is a UK based software company that uses data and machine learning technologies to help companies and governments prevent financial crimes and terrorism. For example, our software was helping many financial institutions and corporations comply with the recent addition of sanctions on Russian entities.

Ripjar originally span out from GCHQ and now has 130 staff based in Cheltenham and remotely and are beginning to expand globally. We have two successful, inter-related products; Labyrinth Screening and Labyrinth Intelligence. Labyrinth Screening allows companies to monitor their customers or suppliers for entities that they aren't allowed to or do not want to do business with (for ethical or environmental reasons). Labyrinth Intelligence empowers organisation to perform deep investigations into varied datasets to find interesting patterns and relationships.

Data infuses everything Ripjar does. We work with a wide variety of datasets of all scales, including an always-growing archive of 8 billion news articles in (nearly!) every language in the world going back over 30 years, sanctions and watchlist data provided by governments, 250 million organisations and ownership data from global corporate registries.

About The Role

Ripjar has several engineering teams that are responsible for the processing infrastructure and many of the analytics that collect, organise, enrich and distribute this data. Central to almost all of Ripjar's systems is the Data Collection Hub, which captures data from various sources, processes and analyses it, and then forwards it on to multiple end-user applications. The system is developed and maintained by 3 teams of software engineers, data engineers, and data scientists.

We are looking for an individual with a least 2 years industrial or commercial experience in data processing systems to come in and add to this team. Ripjar values engineers who are thoughtful and thorough problem solvers who are able to learn new technologies, ideas and paradigms quickly.

Technology Stack

The specific technical skills you possess aren't as important to us as the ability to understand complex systems and get to the heart of problems. We do, however, expect you to be fluent in at least one programming language, have at least two years experience working with moderately complex software systems in production and have a curiosity and interest in learning more.

In this role, you will be using python (specifically pyspark) and Node.js for processing data, backed by various Hadoop stack technologies such as HDFS and HBase. MongoDB and Elasticsearch are used for indexing smaller datasets. Airflow & Nifi are used to co-ordinate the processing of data, while Jenkins, Jira, Confluence and Github are used as support tools. We use ansible to manage configuration and deployments. Most developers use Macbooks for development and our servers all run the CentOS flavour of Linux.

If you have any experience in this tech stack, that's useful, as is a numerate degree, such as Computer Science, but neither are required for the role.

Responsibilities:

• Contributing production quality code and unit-tests to our Data Collection Hub
• Contributing improvements to the test and build pipelines
• Considering the impact and implications of changes and communicating these clearly
• Helping to support the data processing pipelines as needed
• Modelling data in the best way for specific business needs
• Staying abreast of the latest developments in Data Engineering to contribute to Ripjar's best practices
• Adding to Ripjar's culture and make it a fun and rewarding place to work!
  
  
  

Requirements:

The specific technical skills you possess aren't as important to us as the ability to understand complex systems and get to the heart of problems. We do, however, expect you to be fluent in at least one programming language, have at least two years experience working with moderately complex software systems in production and have a curiosity and interest in learning more.

• You will be using Python (specifically pyspark) and Node.js for processing data
• You will be using Hadoop stack technologies such as HDFS and HBase
• Experience using MongoDB and Elasticsearch for indexing smaller datasets would be beneficial
• Experience using Airflow & Nifi to co-ordinate the processing of data would be beneficial
• You will be using Ansible to manage configuration and deployments
  
  
  

Salary And Benefits

• Salary DOE
• 25 days annual leave + your birthday off, in addition to bank holidays, rising to 30 days after 5 years of service
• Remote working
• Private Family Healthcare
• Employee Assistance Programme
• Company contributions to your pension
• Pension salary sacrifice
• Enhanced maternity/paternity pay
• The latest tech including a top of the range MacBook Pro

Seniority level

• Seniority level

  Entry level

Employment type

• Employment type

  Full-time

Job function

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Ripjar by 2x

Get notified about new Data Engineer jobs in Manchester, England, United Kingdom.

Manchester, England, United Kingdom 2 months ago

Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 2 weeks ago

Manchester, England, United Kingdom 1 week ago

Manchester, England, United Kingdom 1 week ago

Manchester, England, United Kingdom 2 days ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Manchester, England, United Kingdom 3 months ago

Manchester, England, United Kingdom 1 day ago

Manchester, England, United Kingdom 2 months ago

Manchester, England, United Kingdom 1 month ago

Greater Manchester, England, United Kingdom 5 months ago

Greater Manchester, England, United Kingdom 5 months ago

Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 1 month ago

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 2 months ago

Graduate Software Engineer, Open Source and Linux, Canonical Ubuntu

Manchester, England, United Kingdom 2 months ago

Manchester Area, United Kingdom 3 days ago

Manchester, England, United Kingdom 1 week ago

Manchester, England, United Kingdom 4 months ago

Software Engineer - Python - Container Images

Manchester, England, United Kingdom 4 weeks ago

Python Software Engineer, Commercial Systems

Manchester, England, United Kingdom 1 month ago

Software Engineer (Python/Linux/Packaging)

Manchester, England, United Kingdom 6 months ago

Distributed Systems Software Engineer, Python / Go

Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 1 month ago

Customer Success Engineer, Data (end of Q3 hire)

Manchester, England, United Kingdom 2 months ago

Manchester, England, United Kingdom 2 weeks ago

Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 3 weeks ago

Manchester Area, United Kingdom 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.