ETL Data Engineer: Ingestion + Databricks & Flink

Confidential; England; On-site; GBP 45,000 - 90,000; Full time

Job summary

Confidential is seeking a Developer with ETL experience who can design and implement end-to-end data ingestion pipelines using modern tools. The role emphasizes hands-on coding and data processing.

You will work with Java and/or Python, handling multiple file formats (CSV, JSON, XML, Parquet, Avro) and use Databricks and Apache Flink to transform and move data across source systems. This position also offers collaboration with data engineers on challenging projects.

Qualifications

• Hands-on ETL experience with end-to-end data ingestion.
• Strong programming skills in Java and/or Python.
• Experience with multiple file formats (CSV, JSON, XML, Parquet, Avro) and ingesting data from several source systems.
• Hands-on experience with Databricks for data processing and transformation.
• Experience with the Apache Flink framework for stream and batch data processing.

Skills

ETL

Java

Python

Data ingestion

File formats

Tools

Databricks

Apache Flink

Job description

Confidential is seeking a Developer with ETL experience who can design and implement end-to-end data ingestion pipelines using modern tools. The role emphasizes hands-on coding and data processing.

You will work with Java and/or Python, handling multiple file formats (CSV, JSON, XML, Parquet, Avro) and use Databricks and Apache Flink to transform and move data across source systems. This position also offers collaboration with data engineers on challenging projects.