Senior Data Engineer_London_Hybrid(6+ Years)

ZipRecruiter; London; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

A leading company is seeking a Sr Data Engineer to develop and maintain data architecture and infrastructure. The role involves building data pipelines, managing ETL processes, and collaborating closely with data scientists and analysts. Candidates should have a strong background in Python, Pyspark, and SQL with extensive experience in cloud environments.

Qualifications

• Minimum 6+ years of total experience.
• At least 4+ years hands-on experience using Python, Pyspark, SQL.

Responsibilities

• Design, build, maintain data pipelines using Python, Pyspark, and SQL.
• Develop and maintain ETL processes and data models.
• Collaborate with data scientists and business analysts to fulfill data needs.

Skills

Python

Pyspark

SQL

Tools

AWS

AZURE

GCP

Job description

Job Description

About Role:

As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data architecture and infrastructure. The successful candidate should possess a strong foundation in Python, Pyspark, SQL, and ETL processes, with a demonstrated ability to implement solutions in a cloud environment.

Position - Sr Data Engineer

Experience - 6-9 Years

Location - London

Job Type - Hybrid, Permanent

Mandatory Skills:

• Design, build, maintain data pipelines using Python, Pyspark and SQL
• Develop and maintain ETL processes to move data from various data sources to our data warehouse on AWS/AZURE/GCP .
• Collaborate with data scientists, business analysts to understand their data needs & develop solutions that meet their requirements.
• Develop & maintain data models and data dictionaries for our data warehouse.
• Develop & maintain documentation for our data pipelines and data warehouse.
• Continuously improve the performance and scalability of our data solutions.

Qualifications:

• Minimum 6+ years of Total experience.
• At least 4+ years of Hands on Experience using The Mandatory skills - Python, Pyspark, SQL.