Data Engineer – Databricks & Azure Pipelines (Hybrid)

Harvey Nash Group; Glasgow; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading technology firm is looking for a contract Data Engineer in Glasgow. This hybrid role involves designing and optimizing data pipelines for Data Scientists and Traders, focusing on Python development on Databricks and Streamlit. The ideal candidate will have extensive data engineering experience and programming skills in Python and SQL, along with strong stakeholder management and communication skills. This position offers a day rate of up to £675 for a duration of 6 months.

Qualifications

• Extensive experience programming in Python/PySpark and SQL.
• Experience in data engineering for rapid processing of system data.
• Understanding of data streaming concepts and ELT design patterns.

Responsibilities

• Design, build, manage, and optimize data pipelines.
• Deliver commercial value through collaboration with business stakeholders.
• Promote understanding of data and analytics across stakeholders.

Skills

Python/PySpark

SQL

Data Engineering

Stakeholder Management

Communication Skills

Tools

Databricks

Azure

ADF

Streamlit

Job description

A leading technology firm is looking for a contract Data Engineer in Glasgow. This hybrid role involves designing and optimizing data pipelines for Data Scientists and Traders, focusing on Python development on Databricks and Streamlit. The ideal candidate will have extensive data engineering experience and programming skills in Python and SQL, along with strong stakeholder management and communication skills. This position offers a day rate of up to £675 for a duration of 6 months.