Data Engineer - Applications

Quantexa; London; Hybrid; GBP 50,000 - 70,000; Full time

Job summary

A leading data analytics company in London seeks a Data Engineer to design and build scalable data infrastructure. You will collaborate closely with teams to enhance Quantexa's platform capabilities. The ideal candidate has robust experience in cloud-based environments and data processing, along with strong analytical skills. This role offers competitive salary and flexible working options.

Benefits

Competitive salary and Company Bonus

Flexible working hours

Pension Scheme

25 days annual leave

Work from Anywhere Scheme

Private Healthcare

Qualifications

• Experience designing scalable data infrastructure for high-volume data flows.
• Development and maintenance of production-grade data pipelines.
• Strong analytical skills with varied datasets.

Responsibilities

• Build data infrastructure and processing capabilities.
• Develop libraries for cleansing and standardizing data.
• Manage internal data lake for testing and analytics.

Skills

Data infrastructure design

ETL and data processing

Analytical skills

Cloud-based environments

Collaboration

Agile methodology

Tools

Scala

Spark

Python

Airflow

Elasticsearch

Job description

What we're all about.

It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. We're a real team. Collaborating and constantly engineering better and better solutions. We're ambitious, we think things through and we're on a mission to discover just how far we go. 41% of our colleagues come from an ethnic or religious minority background. We speak over 20 languages across our 47 nationalities, creating a sense of belonging for all. If our incredible culture sounds like you, we'd love you to join us.

Opportunity

Applications is an Engineering function within Quantexa's R&D department that is focused on internally building real-world applications of the Quantexa Platform. Data Engineers are focused on building the data infrastructure and processing capabilities that power Quantexa's platform and applications. This role encompasses two closely related teams working on the foundational data layer of Quantexa's offerings:

• Data Engineering Accelerators

• Developing Quantexa's libraries for cleansing, parsing and standardising data used in entity resolution

• Finding efficiency/performance improvements through big data testing and building performance tooling

• Owning best practices in entity resolution and network building

• Data Feeds

• Building standardised and reusable code for processing various third party/open source data sets

• Managing an internal data lake for the provision of this data by other teams for testing and analytics

• Owning general best practices for ingesting and processing data to get it ready for use in the Quantexa Platform, including pipelines and scheduling

The teams work together closely and team members are able to rotate between them to enable knowledge sharing and personal development.

Requirements

What do I need to have?

• Experience designing and building robust, scalable data infrastructure to support high-volume, high-velocity data flows
• Experience in developing and maintaining production-grade ETL and data processing pipelines, with a focus on performance, reliability, and maintainability
• Strong analytical skills, with experience working on real-world, varied datasets to extract insights and improve data quality
• Hands-on experience working with data in cloud-based environments, ideally with distributed systems and modern data platforms
• Familiarity with performance tuning and optimisation techniques for data processing workflows
• A collaborative mindset, with a track record of defining and sharing best practices across teams
• Comfortable working in a fast-paced Agile environment, with a focus on iterative delivery and continuous improvement
• A growth mindset and the drive to thrive within one of the UK's fastest-growing scale-ups

Experience in the following would be beneficial:

• A strong coding background, ideally in Scala, or in a language such as Java or Python that supports a quick transition to Scala
• Working with big data technologies, ideally Spark, but experience with tools like Airflow or Elasticsearch is also valuable
• Manipulating and transforming data - cleansing, parsing, standardising - to improve data quality and integrity

Benefits

Why join Quantexa?

Our perks and quirks.

What makes you Q will help you to realize your full potential, flourish and enjoy what you do, while being recognized and rewarded with our broad range of benefits.

We offer:

• Competitive salary and Company Bonus

• Flexible working hours in a hybrid workplace & free access to global WeWork locations & events

• Pension Scheme with a company contribution of 6% (if you contribute 3%)

• 25 days annual leave (with the option to buy up to 5 days) + birthday off!

• Work from Anywhere Scheme: Spend up to 2 months working outside of your country of employment over a rolling 12-month period

• Family: Enhanced Maternity, Paternity, Adoption, or Shared Parental Leave

• Private Healthcare with AXA

• EAP, Well-being Days, Gym Discounts

• Free Calm App Subscription #1 app for meditation, relaxation and sleep

• Workplace Nursery Scheme

• Team's Social Budget & Company-wide Summer & Winter Parties

• Tech & Cycle-to-Work Schemes

• Volunteer Day off

• Dog-friendly Offices

Our mission.

We have one mission. To help businesses grow. To make data easier. And to make the world a better place. We're not a start-up. Not anymore. But we've not been around that long either. What we are is a collection of bright, passionate minds harnessing complexities and helping our clients and their communities. One culture, made of many. Heading in one direction - the future.

It's all about you.

It's important to us that you feel welcome, valued and respected. After all, it's your individuality and passion for what you do that will make you Q. We see that - which is why we're proud to be an Equal Opportunity Employer. We've created and will continue to improve our inclusive and diverse work environment. Regardless of your race, beliefs, color, national origin, gender, sexual orientation, age, marital status, neurodiversity or ableness - whoever you are - if you are a passionate, curious and caring human being who wants to push the boundaries of what's possible, then we want to hear from you.

start. don't stop - Apply