Data Engineer - AWS Data Pipelines & Data Lake

Astro Studios, Inc.; Belfast City District; Hybrid; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Health and lifestyle perks

25 days annual leave

Generous pension scheme

Community and charity initiatives

Annual performance-based bonus

PA share ownership

Cycle to work

Job summary

PA Consulting seeks a Data Engineer to join its Digital & Data team in the UK, focusing on building scalable data pipelines and AWS-based data platforms. You will collaborate across product, design, and client teams to deliver analytics-driven solutions.

You’ll apply Java, Python, Scala, Spark, and SQL to ingest, transform, and move data, while working in an agile, hybrid environment with ongoing learning opportunities and a culture of excellence.

Qualifications

• Problem-solving and analytical thinking.
• Collaborating with multiple stakeholders in a fast-paced environment.
• Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL.
• Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc.
• Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming.

Responsibilities

• Work to agile best practices and cross-functionally with multiple teams and stakeholders.
• Live in-person whiteboarding sessions to problem solve as a team, alongside asynchronous communication on Teams.
• Hybrid working with the team on client site or in our office a minimum of two days per week.
• You’ll work alongside colleagues from across PA – delivering transformative digital solutions to today’s most complex business challenges.
• You’ll be designing and building for the AWS cloud.

Skills

Problem solving

Collaboration

Data pipelines

Java

Python

Scala

Spark

SQL

APIs

AWS

Tools

AWS

EMR

Glue

RedShift

Kinesis

Lambda

DynamoDB

Job description

PA Consulting seeks a Data Engineer to join its Digital & Data team in the UK, focusing on building scalable data pipelines and AWS-based data platforms. You will collaborate across product, design, and client teams to deliver analytics-driven solutions.

You’ll apply Java, Python, Scala, Spark, and SQL to ingest, transform, and move data, while working in an agile, hybrid environment with ongoing learning opportunities and a culture of excellence.