Senior Data Engineer

Kharon; Greater London; Hybrid; GBP 1,060,000 - 1,283,000; Full time

Benefits offered by this job

Private health insurance

Pension plan

Annual leave + holidays

Job summary

Kharon seeks a Senior Data Engineer in London for building large-scale data processing systems and data lakes on AWS Databricks. You will create pipelines, monitor data quality, and collaborate with engineers, data scientists, and product teams to define business metrics.

The role requires 5+ years in data engineering, Python/PySpark, SQL, and experience with cloud-based ETL and data warehousing tools. Hybrid work (3 days/week) and a discretionary annual bonus accompany compensation in the

Qualifications

• 5+ years in data engineering or related software/data roles.

Responsibilities

• Build large-scale distributed data processing systems and data lakes on AWS Databricks.
• Create data pipelines and orchestration to ingest data into the Kharon Data Lake.
• Monitor data quality across inbound/outbound data flows.
• Collaborate with engineers, architects and data scientists on scalable solutions.
• Interact with internal and external APIs.
• Define metrics with product and business teams.
• Document diagrams and unit/validation tests.
• Own development, deployment, adoption monitoring and maintenance of data systems.

Skills

5+ years exp

Python

Pandas

PySpark

Notebooks

SQL

AWS Glue

Airflow

Kafka

Databricks

Snowflake

Docker

Kubernetes

Communication

Education

BS/MS CS or equivalent

Tools

Docker

Kubernetes

Job description

Description

TL;DR Kharon is seeking a full-time London-based Senior Data Engineer.

Location: London, UK

Annual Remuneration: £95,000 - £115,000 salary and discretionary annual bonus

Pay Frequency: Monthly

Probationary Period: 180 days

Work Arrangement: Hybrid, 3-days per week

RESPONSIBILITIES:

• Help build large-scale distributed automated data processing systems and data lakes, while optimizing for both computational and storage efficiency on AWS Databricks.
• Create data pipelines, infrastructure, and overall workflow orchestration to pull data from a diverse set of data sources into the Kharon Data Lake.
• Build systems to track, monitor and validate the quality of data coming into or going out of Kharon Data Lake.
• Collaborate with engineers, architects, and data scientists to implement scalable solutions to solve complex problems.
• Interact and develop with internal and external APIs.
• Work with product and business teams to define novel and critical metrics for the business.
• Follow good engineering practices like documentation, diagrams, and unit/validation tests
• Take full responsibilities for the development, deployment, adoption monitoring and maintenance of the data systems and services you build.

QUALIFICATIONS:

• 5+ years of experience, not including internships as a software engineer or a data engineer and a strong passion to learn.
• BS/MS in Computer Science or equivalent experience in related fields.
• Experience in Python, Pandas, PySpark, and Notebooks.
• SQL knowledge and experience working with relational databases including schema design, access patterns, query performance optimization, etc.
• Experience with data pipeline technologies like AWS Glue, Airflow, Kafka, or other cloud based equivalence.
• Experience with ETL and data warehousing like Databricks, Snowflake, or equivalent.
• Container-based deployment experience using Docker and Kubernetes.
• Strong verbal and written communication skills.

NICE TO HAVE:

• Experience working with or data modeling for graph databases like Neo4J, Neptune, etc.
• API experience using FastAPI, Flask, Spring Boot or equivalent.
• Understanding of elasticsearch data and query modeling is a big plus.
• Interests or experience in Geopolitics, Sanction Compliance, or Financial Risk.

ABOUT KHARON:

Kharon operates at the nexus of global security and is on a mission to revolutionize the current landscape. We take complex data as it relates to global security and empower our clients to not only understand the risk associated with their potential business relationships but to operationalize that data so that they can make the best and most informed decisions possible.

From financial crimes and sanctions to export controls and threat identifications, our tools optimize protection against the types of risks that could otherwise be incredibly dangerous and excessively costly to any business. Serving many of today’s leading global financial and multinational institutions, Kharon products are the most powerful in the space with a precision and depth that is absolutely unparalleled.

When you look at any major global crisis event, we're providing intelligence that's at the heart of those circumstances. We connect the dots in a way that’s meaningful. As the world continues to evolve in complexity, so too does the demand for our products. Given the significance of our work and the increasing global reliance on our insights, we are looking for a Senior Data Engineer to join us as we work to shape the way businesses perceive and navigate global risks.

Company Benefits

• Fully-sponsored private health insurance
• Pension plan with 3% employer contribution
• Annual leave plus bank holidays

DISCLOSURES

Kharon is committed to cultivating and maintaining a workplace that is free from harassment and discrimination. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, ethnicity, gender, gender identity or expression, sexual orientation or identity, neurodiversity, appearances, age, protected veteran status, or status as a qualified individual with disability.

We are committed to making reasonable adjustments to support disabled applicants and employees. If you require any adjustment to participate in the recruitment process, please contact [e-mail].

You must have the right to work in the UK. Kharon is unable to offer visa sponsorship for this role.

UNITED KINGDOM Candidate Privacy Notice

Kharon is committed to protecting your personal data in accordance with the UK General Data Protection Regulation (UK GDPR) and the Data Protection Act 2018. We collect the personal data you submit as part of your application - including your name, contact details, employment history, and qualifications - to assess your suitability for the role. Our lawful basis for processing is legitimate interests (Article 6(1)(f) UK GDPR).

If your application is unsuccessful, your data will be retained for up to 12 months before being securely deleted. If you accept a role, your data will transfer to your employee record.

You have the right to access, correct, or request deletion of your data, to object to or restrict its processing, and to lodge a complaint with the UK data protection authority, the ICO, at www.ico.org.uk. To exercise your rights, contact us at [e-mail].

#LI-Hybrid #LI-AG1