Data Engineer: ETL Pipelines, Python & Databricks

i-Jobs; Gloucester; On-site; GBP 60,000 - 80,000; Full time

Job summary

A recruitment agency is seeking a Data Engineer for a contract role in Gloucester, UK. The successful candidate will analyze data pipelines and automate ETL processes using Python. Experience with Databricks and strong SQL skills are essential. This role offers a pay rate of £200.00 per day for a duration of 3+ months. The candidate will design, optimize, and debug ETL pipelines, and contribute to the Lakehouse environment.

Qualifications

• Advanced skills in Python for ETL pipeline development.
• Strong experience with Databricks and related tools.
• Proven ability to design and optimize ETL pipelines.
• Strong SQL skills.

Responsibilities

• Analyze and document existing data pipelines, including diagrams and data-flow mapping.
• Develop and automate ETL pipelines using Python.
• Work with Databricks notebooks, Delta Lake, and Databricks Genie bots.
• Design, optimize, and debug ETL pipelines.
• Use SQL for querying, validation, and optimization in the Lakehouse environment.

Skills

Advanced skills in Python

Strong experience with Databricks

Strong SQL skills

Job description

A recruitment agency is seeking a Data Engineer for a contract role in Gloucester, UK. The successful candidate will analyze data pipelines and automate ETL processes using Python. Experience with Databricks and strong SQL skills are essential. This role offers a pay rate of £200.00 per day for a duration of 3+ months. The candidate will design, optimize, and debug ETL pipelines, and contribute to the Lakehouse environment.