Azure Data Engineer: Scalable Pipelines & Insights

Livestock Information Limited; United Kingdom; Remote; GBP 45.000 - 50.000; Vollzeit

Benefits dieser Stelle

Fully remote working

Flexible working hours

25 days annual leave

Life Assurance

Pension

Zusammenfassung

Livestock Information Ltd is seeking an experienced Azure Data Engineer to design scalable data pipelines using Databricks, Synapse and Data Factory in a fully remote UK role. You will build data services, optimize pipelines and collaborate with cross-functional teams to deliver business insights.

Key requirements include strong Python and SQL (T-SQL), hands-on Azure data storage experience, data modelling expertise, and a proactive, detail-oriented approach to ensure data security and GDPR

Qualifikationen

• Proven experience with Python for data engineering and analytics.
• Strong SQL skills including T-SQL.
• Hands-on experience with Azure data storage solutions.
• Practical knowledge of data integration and processing frameworks (Azure Databricks, Azure Data Factory).
• Solid understanding of data modelling concepts and schema design best practices.
• Strong analytical and problem-solving skills with attention to detail.
• Effective communication and collaboration within cross-functional teams.

Aufgaben

• Designing and implementing data storage solutions on Azure, selecting appropriate services and schemas.
• Building and maintaining data pipelines for data integration and processing using Azure Data Factory and Databricks.
• Testing and validating data quality throughout the pipeline.
• Optimising data processing performance through tuning and monitoring.
• Developing and maintaining data models and schemas for scalable use cases.
• Collaborating with analytics and reporting teams to provide required data.
• Ensuring data security and GDPR compliance for data streams on Azure.
• Working with large datasets and performing data analysis.
• Staying updated on Azure features and best practices to drive adoption.

Kenntnisse

Python programming

SQL (T-SQL)

Cross-functional collaboration

Analytical thinking

Attention to detail

Tools

Azure Databricks

Azure Data Factory

Azure Synapse

Azure Data Lake

Jobbeschreibung

Livestock Information Ltd is seeking an experienced Azure Data Engineer to design scalable data pipelines using Databricks, Synapse and Data Factory in a fully remote UK role. You will build data services, optimize pipelines and collaborate with cross-functional teams to deliver business insights.

Key requirements include strong Python and SQL (T-SQL), hands-on Azure data storage experience, data modelling expertise, and a proactive, detail-oriented approach to ensure data security and GDPR