Principal Data Engineer

JR United Kingdom; Leeds; On-site; GBP 60,000 - 100,000; Full time

Job summary

An established industry player is seeking a Principal Data Engineer to lead the design and implementation of innovative cloud-based data solutions. This role offers the opportunity to work closely with clients, transforming their data needs into scalable, effective solutions using cutting-edge AWS services. Ideal candidates will thrive in a collaborative environment, leveraging their expertise in ETL processes and cloud data warehousing. If you're passionate about problem-solving and eager to make a significant impact in a dynamic setting, this position is perfect for you. Join a forward-thinking team dedicated to excellence in data engineering.

Qualifications

• Strong experience in ETL processes and cloud data warehouse patterns.
• Hands-on expertise with AWS services (S3, Glue, Redshift).
• Experience with big data technologies such as Hadoop or Spark.

Responsibilities

• Design and implement cloud-based data solutions using AWS services.
• Build and maintain data dictionaries and metadata management systems.
• Support CI/CD processes and adopt infrastructure-as-code principles.

Skills

ETL processes

AWS services

Matillion

data visualization tools

big data technologies

Machine Learning

Education

AWS certifications

Tools

AWS S3

AWS Glue

AWS Redshift

QuickSight

Tableau

Looker

QlikSense

Job description

Social network you want to login/join with:

Principal Data Engineer, leeds, west yorkshire

col-narrow-left

Client:

Anson McCade

Location:

leeds, west yorkshire, United Kingdom

Job Category:

Other

-

EU work permit required:

Yes

col-narrow-right

Job Views:

2

Posted:

02.05.2025

Expiry Date:

16.06.2025

col-wide

Job Description:

Principal Data Engineer, Consulting

Leeds Based

You must be eligible for SC Clearance

Role Overview

The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build custom solutions, and transfer knowledge to client technical teams. The ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively.

Key Responsibilities as a Principal Data Engineer

• Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion.
• Work directly with clients to define requirements, refine solutions, and ensure successful handover to internal teams.
• Design and implement ETL/ELT pipelines for cloud data warehouse solutions.
• Build and maintain data dictionaries and metadata management systems.
• Analyze and cleanse data using a range of tools and techniques.
• Manage and process structured and semi-structured data formats such as JSON, XML, CSV, and Parquet.
• Operate effectively in Linux and cloud-based environments.
• Support CI/CD processes and adopt infrastructure-as-code principles.
• Contribute to a collaborative, knowledge-sharing team culture.

Required Qualifications & Skills

• Strong experience in ETL processes and cloud data warehouse patterns.
• Hands-on expertise with AWS services (S3, Glue, Redshift).
• Proficiency with Matillion for data transformation.
• Experience working with various relational databases.
• Familiarity with data visualization tools such as QuickSight, Tableau, Looker, or QlikSense.
• Ability to create well-documented, scalable, and reusable data solutions.
• Experience with big data technologies such as Hadoop, MapReduce, or Spark.
• Exposure to microservice-based data APIs.
• Familiarity with data solutions in other public cloud platforms.
• AWS certifications (e.g., Solutions Architect Associate, Big Data Specialty).
• Experience or interest in Machine Learning and AI-driven data solutions.
• Public sector experience is preferential