Data Engineer (Python)

TESTQ Technologies Limited; Birmingham; On-site; GBP 40,000 - 55,000; Full time

Job summary

A leading company in IT services is looking for a Python Data Engineer to enhance their audit and risk analytics capabilities. In this role, you will design and optimize data pipelines, work with diverse data sources, and ensure data quality. A strong command of Python and cloud platforms like AWS, Azure, and GCP is essential for success in this fast-paced environment.

Qualifications

• Strong hands-on experience in Python (Pandas, NumPy, PySpark).
• Experience building ETL/ELT processes.
• Familiarity with cloud platforms (AWS, Azure, GCP).

Responsibilities

• Develop scalable data pipelines for audit processes.
• Implement data quality checks and validation processes.
• Collaborate with stakeholders to understand data requirements.

Skills

Python

Data wrangling

ETL

Cloud platforms

Data governance

Tools

Pandas

NumPy

PySpark

Snowflake

Databricks

Job description

2 days ago Be among the first 25 applicants

The Python Data Engineer will focus on designing and optimizing data pipelines, integrating data from diverse sources, and ensuring the smooth flow of structured and unstructured data for audit and risk analytics. This role requires strong Python programming skills, expertise in data wrangling, and experience working with cloud platforms.

Key Responsibilities:

• Develop scalable and efficient data pipelines to support audit processes.
• Use Python for data extraction, transformation, and loading (ETL) from various data sources.
• Implement data quality checks and validation processes.
• Collaborate with business stakeholders and auditors to understand data requirements.
• Leverage cloud platforms (AWS, Azure, GCP) to store and process data.
• Document workflows, pipelines, and transformation logic for transparency.

Key Skills & Experience:

• Strong hands-on experience in Python (Pandas, NumPy, PySpark).
• Experience building ETL/ELT processes.
• Familiarity with cloud platforms (AWS, Azure, GCP) and big data technologies (e.g., Snowflake, Databricks).
• Understanding of data governance and regulatory compliance.
• Ability to work in a fast-paced, regulated environment.

Seniority level

• Seniority level

  Associate

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at TESTQ Technologies Limited by 2x

Get notified about new Data Engineer jobs in Birmingham, England, United Kingdom.

Birmingham, England, United Kingdom 1 week ago

Birmingham, England, United Kingdom 1 week ago

Worcester, England, United Kingdom 5 days ago

Coventry, England, United Kingdom 1 week ago

Coventry, England, United Kingdom 4 days ago

Birmingham, England, United Kingdom 2 weeks ago

Coventry, England, United Kingdom 1 day ago

Software Engineer - Analyst/Associate - Birmingham

West Midlands, England, United Kingdom 1 day ago

West Midlands, England, United Kingdom 1 month ago

Walsall, England, United Kingdom 4 days ago

Birmingham, England, United Kingdom 2 days ago

West Midlands, England, United Kingdom 1 week ago

West Midlands, England, United Kingdom 4 weeks ago

Birmingham, England, United Kingdom 1 week ago

Atherstone, England, United Kingdom £53,780.00-£61,950.00 6 days ago

Coventry, England, United Kingdom 2 days ago

Birmingham, England, United Kingdom 1 week ago

Freelance GenAI Developer - Prompt Engineering & Data Workflows

Birmingham, England, United Kingdom 1 week ago

Birmingham, England, United Kingdom 3 days ago

Data Engineer – Grid Innovation Applications (Energy Sector Experience Required)

Stafford, England, United Kingdom 2 weeks ago

Freelance Data Analyst (Python) - AI Trainer

Birmingham, England, United Kingdom 5 days ago

Birmingham, England, United Kingdom 1 day ago

Birmingham, England, United Kingdom 3 hours ago

Birmingham, England, United Kingdom 3 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.