Associate Data Engineer

Quantexa; City Of London; Hybrid; GBP 50,000 - 70,000; Full time

Job summary

A leading technology firm in London seeks a Data Engineer to join their Applications team. This role involves developing data pipelines, enhancing SaaS offerings, and managing demos for clients. Candidates should possess strong coding skills, particularly in Scala, and experience with big data technologies like Spark. The team values innovation and collaboration in a fast-paced, Agile environment. Competitive salary and benefits offered.

Benefits

Competitive salary and Company Bonus

Flexible working hours

Pension Scheme with company contribution

25 days annual leave

Private Healthcare with AXA

Work from Anywhere Scheme

Team's Social Budget

Volunteer Day off

Dog-friendly Offices

Qualifications

• Strong coding background, ideally in Scala or Java/Python.
• Experience with big data technology.
• Experience in building data processing pipelines.

Responsibilities

• Developing Quantexa libraries for data cleansing and parsing.
• Managing internal data lakes.
• Building and maintaining Quantexa demos.
• Building Quantexa's cloud hosted SaaS offerings.

Skills

Data processing/ETL pipelines

Analysing and examining real varied data

Full stack development with focus on data

Solving difficult problems

Working in the cloud

Defining best-practices

Agile environment

Tools

Scala

Spark

Airflow

Elasticsearch

Job description

What we’re all about.

It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. We’re a real team. Collaborating and constantly engineering better and better solutions. We’re ambitious, we think things through and we’re on a mission to discover just how far we can go. Nearly half of our colleagues come from an ethnic or religious minority background. We’re made up of people from 47 nationalities who speak over 20 languages. As a diverse mix of individuals, we make one big unstoppable team.

If our incredible culture sounds like you, we’d love you to join us.

What will you be doing?

You’ll be joining the Applications team, which is an Engineering function within Quantexa’s R&D department that is focused on internally building real-world applications of the Quantexa Platform.

This function enables demonstrations of the product and develops SaaS offerings, whilst also testing and refining new Platform features before they are deployed by clients. The function develops and releases its own tools that feed into these internal applications and are also packaged and released to help standardize and accelerate all Quantexa deployments. It encompasses four distinct sub-teams:

Data Engineering Accelerators

• Developing Quantexa’s libraries for cleansing, parsing and standardising data used in entity resolution

• Finding efficiency/performance improvements through big data testing and building performance tooling

• Owning best practices in entity resolution and network building

Data Feeds

• Building standardised and reusable code for processing various third party/open source data sets

• Managing an internal data lake for the provision of this data by other teams for testing and analytics

• Owning general best practices for ingesting and processing data to get it ready for use in the Quantexa Platform, including pipelines and scheduling

Demos

• Developing, deploying and maintaining all Quantexa demos, showcasing the different use cases for the Quantexa Platform

• Owning the Quantexa Trial platform, for prospective Quantexa clients to see the product in action using real data provided by Data Feeds

• Building tools to enable solution owners and sales to create their own custom demos

SaaS

• Building Quantexa’s emerging SaaS offering, a cloud hosted, standardized deployment of the Quantexa Platform

• Targeting mid-market banks in the US for Retail AML initially, providing them with a cost-effective Quantexa solution, then expanding in future to more use cases and geographies

• Implementing cutting edge features of the Quantexa Platform ensuring SaaS customers always on the latest and greatest of Quantexa

More detailed information on the day to day activities of the four sub-teams can be shared on request. The teams all work together closely and team members are able to rotate between the teams to enable knowledge sharing and personal development.

We are looking for candidates who enjoy the following to join us:

• Data processing/ETL pipelines

• Analysing and examining real and varied data

• Full stack development, but with a heavy focus on the data processing/ETL side

• Solving difficult problems with efficient, resilient, high impact code

• Working in the cloud with production-grade systems

• Defining best-practices and sharing expertise you’ve developed

• Working in a fast moving, Agile environment

• Growing and thriving within one of the UK’s fastest growing scale-ups

Experience in the following would be beneficial:

• A strong coding background, ideally in Scala or otherwise in a relevant language that will allow you to learn Scala quickly (e.g. Java/Python)

• Big data, either from a software deployment/implementation or a data science perspective

• Working with big data technology, ideally Spark but others will also be useful such as Airflow or Elasticsearch

• Working in an Agile environment

• Building data processing pipelines for use in production batch systems, including either traditional ETL pipelines and/or analytics pipelines

• Manipulating data through cleansing, parsing, standardising etc, especially in relation to improving data quality/integrity

• Building and deploying SaaS products

Our perks and quirks.

What makes you Q will help you to realize your full potential, flourish and enjoy what you do, while being recognized and rewarded with our broad range of benefits.

We offer:

• Competitive salary and Company Bonus 💰

• Flexible working hours in a hybrid workplace & free access to global WeWork locations & events

• Pension Scheme with a company contribution of 6% (if you contribute 3%)

• 25 days annual leave (with the option to buy up to 5 days) + birthday off! 🌴

• Work from Anywhere Scheme: Spend up to 2 months working outside of your country of employment over a rolling 12-month period

• Family: Enhanced Maternity, Paternity, Adoption, or Shared Parental Leave

• Private Healthcare with AXA

• EAP, Well-being Days, Gym Discounts 🧘

• Free Calm App Subscription #1 app for meditation, relaxation and sleep 🧘♀️

• Workplace Nursery Scheme

• Team's Social Budget & Company-wide Summer & Winter Parties

• Tech & Cycle-to-Work Schemes

• Volunteer Day off

• Dog-friendly Offices

Our mission.

We have one mission. To help businesses grow. To make data easier. And to make the world a better place. We’re not a start-up. Not anymore. But we’ve not been around that long either. What we are is a collection of bright, passionate minds harnessing complexities and helping our clients and their communities. One culture, made of many. Heading in one direction – the future.

It’s all about you.

It’s important to us that you feel welcome, valued and respected. After all, it’s your individuality and passion for what you do that will make you Q. We see that – which is why we’re proud to be an Equal Opportunity Employer. We’ve created and will continue to improve our inclusive and diverse work environment. Regardless of your race, beliefs, color, national origin, gender, sexual orientation, age, marital status, neurodiversity or ableness – whoever you are – if you are a passionate, curious and caring human being who wants to push the boundaries of what’s possible, then we want to hear from you.

start. don’t stop – Apply