AWS Data Engineer — Data Pipelines & Lakehouse

Consultancy.uk; Belfast City District; Hybrid; GBP 55,000 - 85,000; Full time

Benefits offered by this job

Health and lifestyle perks

25 days annual leave (plus half day on

Generous pension scheme

Annual performance-based bonus

PA share ownership

Community involvement

Job summary

PA Consulting in Belfast, United Kingdom, is seeking a Data Engineer to join our Digital & Data community. You will work on production data pipelines, using Java, Python, Scala, Spark and AWS services, delivering scalable data solutions for diverse client projects.

You will collaborate with product, design and engineering teams in a hybrid model, participate in agile ceremonies, and contribute to building and deploying data engineering solutions across sectors.

Qualifications

• You thrive in problem-solving and analytical thinking.
• You enjoy collaborating with multiple stakeholders in a fast-paced environment.
• Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL.
• Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc.
• Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming.

Responsibilities

• Work to agile best practices and cross-functionally with multiple teams and stakeholders.
• Live in-person whiteboarding sessions to problem solve as a team, alongside asynchronous communication on Teams.
• Hybrid working with the team on client site or in our office a minimum of two days per week.
• You’ll be designing and building for the AWS cloud.
• You’ll be delivering transformative digital solutions to today’s most complex business challenges.

Skills

Problem solving

Collaboration

Data pipelines

Java Python Scala

Spark SQL

APIs

AWS data services

Tools

AWS

EMR

Glue

Redshift

Kinesis

Lambda

DynamoDB

Job description

PA Consulting in Belfast, United Kingdom, is seeking a Data Engineer to join our Digital & Data community. You will work on production data pipelines, using Java, Python, Scala, Spark and AWS services, delivering scalable data solutions for diverse client projects.

You will collaborate with product, design and engineering teams in a hybrid model, participate in agile ceremonies, and contribute to building and deploying data engineering solutions across sectors.