Remote Azure Data Engineer — Scalable Data Pipelines

Livestock Information Ltd; United Kingdom; Remote; GBP 48,000 - 52,000; Full time

Benefits offered by this job

Fully remote working setup

25 days annual leave (plus bank hols)

Learning and career development

Job summary

Livestock Information Ltd is seeking an experienced Azure Data Engineer to design and build scalable data solutions within a modern Azure data stack. The role focuses on developing data services, migrating existing solutions, and ensuring live data platforms perform efficiently.

You will work with Databricks, Synapse, Data Factory and Data Lake technologies, collaborating with cross-functional teams to deliver impactful data products. This is a 12-month fixed-term contract with a £50,000 salary.

Qualifications

• Proven experience in Python programming for data engineering and analytics.
• Strong proficiency in SQL, including the Microsoft T-SQL dialect.
• Hands-on experience with Azure data storage solutions.
• Practical knowledge of data integration and processing frameworks (Azure Databricks, Azure Data Factory).
• Solid understanding of data modelling concepts and schema design.

Responsibilities

• Designing & Implementing Data Storage Solutions on Azure: select appropriate services and design scalable schemas.
• Building and maintaining data pipelines for data movement and processing using Azure Data Factory and Databricks.
• Ensuring data quality and accuracy through testing and validation across data pipelines.
• Optimising data processing performance by tuning pipelines and monitoring bottlenecks.
• Developing and maintaining data models and schemas for scalable use cases.
• Collaborating with cross-functional teams to provide data for analytics and reporting.
• Ensuring data security and privacy requirements (GDPR) are followed.
• Working with large datasets and performing data analysis.

Skills

Python

SQL

Azure Databricks

Azure Data Factory

T-SQL

Data modelling

Communication

Tools

Azure Databricks

Azure Data Factory

Job description

Livestock Information Ltd is seeking an experienced Azure Data Engineer to design and build scalable data solutions within a modern Azure data stack. The role focuses on developing data services, migrating existing solutions, and ensuring live data platforms perform efficiently.

You will work with Databricks, Synapse, Data Factory and Data Lake technologies, collaborating with cross-functional teams to deliver impactful data products. This is a 12-month fixed-term contract with a £50,000 salary.