Data Engineer-Python

JR United Kingdom; Birmingham; On-site; GBP 45,000 - 65,000; Full time

Job summary

A leading company in the UK is seeking a Python Data Engineer to design and optimize data pipelines. The role involves integrating diverse data sources and ensuring smooth data flow for audit and risk analytics. The ideal candidate will have strong Python skills and experience with cloud platforms.

Qualifications

• Strong hands-on experience in Python (Pandas, NumPy, PySpark).
• Experience building ETL/ELT processes.

Responsibilities

• Develop scalable and efficient data pipelines to support audit processes.
• Implement data quality checks and validation processes.

Skills

Python

Data Governance

Data Wrangling

Tools

AWS

Azure

GCP

Snowflake

Databricks

Job description

Social network you want to login/join with:

The Python Data Engineer will focus on designing and optimizing data pipelines, integrating data from diverse sources, and ensuring the smooth flow of structured and unstructured data for audit and risk analytics. This role requires strong Python programming skills, expertise in data wrangling, and experience working with cloud platforms.

Key Responsibilities:

• Develop scalable and efficient data pipelines to support audit processes.
• Use Python for data extraction, transformation, and loading (ETL) from various data sources.
• Implement data quality checks and validation processes.
• Collaborate with business stakeholders and auditors to understand data requirements.
• Leverage cloud platforms (AWS, Azure, GCP) to store and process data.
• Document workflows, pipelines, and transformation logic for transparency.

Key Skills & Experience:

• Strong hands-on experience in Python (Pandas, NumPy, PySpark).
• Experience building ETL/ELT processes.
• Familiarity with cloud platforms (AWS, Azure, GCP) and big data technologies (e.g., Snowflake, Databricks).
• Understanding of data governance and regulatory compliance.
• Ability to work in a fast-paced, regulated environment.