Data Engineer , Python, PySpark, and SQL, AWS

JR United Kingdom; Hounslow; On-site; GBP 40,000 - 70,000; Full time

Job summary

A leading company is seeking a Data Engineer based in South West London. In this role, you will design and implement robust data pipelines, ensuring data integrity across platforms. Proficiency in Python, PySpark, and AWS is essential, along with experience in ETL and cloud-native services.

Qualifications

• Proficient in PySpark and AWS.
• Strong experience in designing, implementing, and debugging ETL pipelines.
• Expertise in Python, PySpark, and SQL required.

Responsibilities

• Design and implement robust data pipelines.
• Ensure integrity and accessibility of data across various platforms.

Skills

PySpark

AWS

Python

SQL

ETL pipelines

Spark

Airflow

Terraform

CI/CD workflows

Job description

Social network you want to login/join with:

Data Engineer , Python, PySpark, and SQL, AWS, south west london

col-narrow-left

Client:

Athsai

Location:

south west london, United Kingdom

Job Category:

Other

-

EU work permit required:

Yes

col-narrow-right

Job Views:

3

Posted:

06.06.2025

Expiry Date:

21.07.2025

col-wide

Job Description:

About the Role

The Data Engineer will play a crucial role in designing and implementing robust data pipelines, ensuring the integrity and accessibility of data across various platforms.

Required Skills

• Proficient in PySpark and AWS
• Strong experience in designing, implementing, and debugging ETL pipelines
• Expertise in Python, PySpark, and SQL
• In-depth knowledge of Spark and Airflow
• Experience in designing data pipelines using cloud-native services on AWS
• Extensive knowledge of AWS services
• Experience in deploying AWS resources using Terraform
• Hands-on experience in setting up CI/CD workflows using GitHub Actions

Preferred Skills

• Experience with additional cloud platforms
• Familiarity with data governance and compliance standards