Senior Data Engineer - Scalable Data Lakes & Pipelines

Kharon; Greater London; On-site; GBP 95,000 - 115,000; Full time

Benefits offered by this job

Private health insurance

Pension plan (3% employer contribution

Annual leave + bank holidays

Job summary

Kharon is seeking a Senior Data Engineer for a London-based, full-time role. You will help build large-scale data processing systems on AWS Databricks and contribute to the Kharon Data Lake.

The role requires 5+ years in data engineering, strong Python, SQL, and ETL skills, plus experience with Airflow, Spark, Docker and Kubernetes. The position includes a competitive salary of £95,000–£115,000 and a discretionary annual bonus.

Qualifications

• 5+ years of experience in data engineering or related field.
• BS/MS in Computer Science or equivalent.
• Experience with Python, Pandas, PySpark and Notebooks.
• Strong SQL and relational database design/optimisation.
• Experience with data pipeline tech like AWS Glue, Airflow, Kafka.
• ETL/data warehousing with Databricks, Snowflake or equivalent.
• Container-based deployment with Docker and Kubernetes.
• Strong verbal and written communication skills.

Responsibilities

• Build large-scale distributed data processing systems and data lakes on AWS Databricks.
• Create data pipelines and orchestration to ingest data into the Kharon Data Lake.
• Monitor and validate data quality across data flows.
• Collaborate with engineers, architects and data scientists on scalable solutions.
• Integrate internal and external APIs.
• Define business metrics with product and business teams.
• Follow engineering best practices: docs, diagrams, tests.
• Own end-to-end development, deployment and maintenance of data systems.

Skills

Python

SQL

Pandas

PySpark

Notebooks

Communication

Education

BS/MS in Computer Science or related field

Tools

AWS Glue

Airflow

Kafka

Databricks

Snowflake

Docker

Kubernetes

Job description

Kharon is seeking a Senior Data Engineer for a London-based, full-time role. You will help build large-scale data processing systems on AWS Databricks and contribute to the Kharon Data Lake.

The role requires 5+ years in data engineering, strong Python, SQL, and ETL skills, plus experience with Airflow, Spark, Docker and Kubernetes. The position includes a competitive salary of £95,000–£115,000 and a discretionary annual bonus.