Senior Python Data Engineer - Azure Data Pipelines

Profectus Recruitment; Reading; On-site; GBP 60,000 - 90,000; Full time

Job summary

Profectus Recruitment is seeking a Senior Data Engineer/Developer with strong Python experience to join our Enterprise Data team in Reading. You will build and maintain Python-based data pipelines, ETL/ELT processes and cloud integrations to support BI, research and business analytics.

You will design scalable data solutions on Azure, work with APIs and diverse data sources, and implement automated pipelines across batch and real-time processing.

Qualifications

• Strong commercial Python development experience, ideally within Data Engineering.
• Strong SQL and experience building data pipelines / ETL / integrations.
• Good experience with Microsoft Azure.
• Experience working with APIs, JSON/XML and multiple data sources.
• Understanding of batch, scheduled and/or real-time data processing.
• Experience with Git and DevOps practices.
• Strong problem-solving and communication skills.

Responsibilities

• Build and maintain Python-based data pipelines, ETL/ELT and integrations.
• Design scalable data solutions using Azure and cloud technologies.
• Develop integrations using APIs and structured/semi-structured data.
• Build automated pipelines and orchestration workflows across batch and real-time processes.
• Transform, cleanse and enrich data from multiple sources.
• Maintain and troubleshoot production data pipelines.
• Use Git, DevOps and modern development practices.
• Work with architects, analysts and other technical teams to deliver data solutions.
• Ensure solutions meet security, governance and compliance requirements.

Skills

Python

SQL

Data pipelines

Git/DevOps

Azure

APIs/JSON/XML

Problem-solving

Communication

Tools

Azure Data Factory

Databricks

Azure Functions

Logic Apps

Azure Synapse

Azure SQL

Service Bus

Job description

Profectus Recruitment is seeking a Senior Data Engineer/Developer with strong Python experience to join our Enterprise Data team in Reading. You will build and maintain Python-based data pipelines, ETL/ELT processes and cloud integrations to support BI, research and business analytics.

You will design scalable data solutions on Azure, work with APIs and diverse data sources, and implement automated pipelines across batch and real-time processing.