Senior Data Engineer: Scalable Pipelines & Cloud Analytics

PGIM Ireland; Letterkenny; On-site; EUR 90,000 - 120,000; Full time

Job summary

PGIM Ireland is seeking a Senior Data Engineer to design, develop, test and maintain high quality data pipelines that support platform delivery. You will code against MS Fabric, Spark and modern storage systems, while ensuring data reliability and governance across sources.

You will collaborate with data analysts, scientists and architects to enable prescriptive and predictive insights, while adhering to Prudential standards and DevOps practices.

Qualifications

• BS/BE in computer science or engineering, or related field.
• Proficient in Python, SQL, Scala and Spark stack.
• Experience with data pipelines and SDLC practices.

Responsibilities

• Build and optimize data pipelines using modern frameworks.
• Write tests and ensure code quality and reliability.
• Collaborate with analysts, scientists and architects on data projects.
• Leverage emerging technologies and coach teammates as needed.

Skills

Python

SQL

Scala

Pyspark/Apache Spark

Shell scripting

DevOps practices

SDLC knowledge

Problem solving

Communication

Team collaboration

Education

Bachelor of Computer Science or Engineering

Tools

Microsoft Fabric

Kinesis Data Streams

Kafka

Airflow

AppFlow

CloudWatch

Splunk

Tableau

Power BI

MS Excel

AWS CloudFormation

Ansible

Job description

PGIM Ireland is seeking a Senior Data Engineer to design, develop, test and maintain high quality data pipelines that support platform delivery. You will code against MS Fabric, Spark and modern storage systems, while ensuring data reliability and governance across sources.

You will collaborate with data analysts, scientists and architects to enable prescriptive and predictive insights, while adhering to Prudential standards and DevOps practices.