Data Engineer

i-Jobs; Gloucester; On-site; GBP 60,000 - 80,000; Full time

Job summary

A recruitment agency is seeking a Data Engineer for a contract role in Gloucester, UK. The successful candidate will analyze data pipelines and automate ETL processes using Python. Experience with Databricks and strong SQL skills are essential. This role offers a pay rate of £200.00 per day for a duration of 3+ months. The candidate will design, optimize, and debug ETL pipelines, and contribute to the Lakehouse environment.

Qualifications

• Advanced skills in Python for ETL pipeline development.
• Strong experience with Databricks and related tools.
• Proven ability to design and optimize ETL pipelines.
• Strong SQL skills.

Responsibilities

• Analyze and document existing data pipelines, including diagrams and data-flow mapping.
• Develop and automate ETL pipelines using Python.
• Work with Databricks notebooks, Delta Lake, and Databricks Genie bots.
• Design, optimize, and debug ETL pipelines.
• Use SQL for querying, validation, and optimization in the Lakehouse environment.

Skills

Advanced skills in Python

Strong experience with Databricks

Strong SQL skills

Job description

Data Engineer

Location: 70 Redcliff Street, BS1 6AL
Start Date: ASAP
Contract Duration: 3+ months
Working Hours: Mon Fri, 09 00, 37 Hours per week
Pay Rate: £ 200.00 per day
Job Ref: (phone number removed)

Job Responsibilities

• Analyze and document existing data pipelines, including diagrams and data-flow mapping.
• Develop and automate ETL pipelines using Python.
• Work with Databricks notebooks, Delta Lake, and Databricks Genie bots.
• Design, optimize, and debug ETL pipelines.
• Use SQL for querying, validation, and optimization in the Lakehouse environment.

Person Specifications

Must Have

• Advanced skills in Python for ETL pipeline development.
• Strong experience with Databricks and related tools.
• Proven ability to design and optimize ETL pipelines.
• Strong SQL skills.

Nice to Have

• Experience with the West of England Combined Authority (WECA).

DISCLAIMER: By applying for this vacancy, you consent to your personal information being shared with our client and any relevant third parties we engage with, for the purpose of assessing your suitability specific organizations or hirers to whom you do not wish your details to be disclosed.