Azure Data Engineer: Build Scalable Pipelines & APIs (Hybrid)

Harnham; West Midlands; Hybrid; GBP 40,000 - 50,000; Full time

Job summary

A healthcare product manufacturer in the West Midlands is looking for a Data Engineer to own data engineering within a rapidly scaling analytics function. The role involves developing data pipelines in Azure, managing data integration, and employing web scraping techniques to gather critical insights. Applicants should have strong skills in Azure, Python, and SQL, and experience working with APIs. Benefits include a salary range of £40,000 to £50,000 and a hybrid working model, emphasizing collaboration and autonomy.

Qualifications

• Strong commercial experience with Azure, Python, and SQL.
• Proven ability to build and maintain data pipelines.
• Experience working with APIs and integrating multiple data sources.
• Confidence in using legacy systems and non-modernised environments.
• Knowledge of web scraping techniques.

Responsibilities

• Maintain and develop core data pipelines across Azure.
• Manage nightly data transfers from a legacy system into Azure SQL.
• Build and support integrations for CRM data and NHS datasets.
• Carry out web scraping using Python and Selenium.
• Improve data architecture and remove duplicated datasets.
• Create and maintain APIs and new pipelines.

Skills

Azure

Python

SQL

APIs

Web scraping

Tableau

Digital analytics tools

Job description

A healthcare product manufacturer in the West Midlands is looking for a Data Engineer to own data engineering within a rapidly scaling analytics function. The role involves developing data pipelines in Azure, managing data integration, and employing web scraping techniques to gather critical insights. Applicants should have strong skills in Azure, Python, and SQL, and experience working with APIs. Benefits include a salary range of £40,000 to £50,000 and a hybrid working model, emphasizing collaboration and autonomy.