Senior Data Engineer: Build Scalable Data Pipelines

PGIM; Letterkenny; On-site; EUR 110,000 - 140,000; Full time

Job summary

PGIM Ireland is seeking a Senior Data Engineer to design, build, and optimize end-to-end data pipelines and analytics solutions. You will collaborate with architects, data scientists and analysts to deliver scalable platforms and insights that drive business value.

You will work with Python, SQL, Spark and cloud-based data services, applying best practices in testing, documentation, and DevOps routines. A proactive, collaborative mindset is essential for success.

Qualifications

• Bachelor of Computer Science or Engineering or related field.
• Experience with DevOps automation tools and SDLC.
• Ability to learn new skills and collaborate with others.
• Excellent problem solving, communication and teamwork.
• Experience with data ingestion, transformation, and data warehousing concepts.

Responsibilities

• Build and optimize data pipelines, logic and storage systems.
• Develop high quality, well documented and efficient code.
• Collaborate with data analysts, scientists and architects on data projects.
• Write unit, integration tests and functional automation.
• Apply emerging technologies and coach others to embed learning and innovation.
• Tackle complex problems requiring in-depth analysis of data scenarios.

Skills

Python

SQL

Apache Spark

Data pipelines

Cloud computing

Airflow

Scala

Team collaboration

Education

Bachelor's degree in Computer Science or Engineering

Tools

AWS Redshift

Snowflake

Kinesis Data Streams

Kafka

Airflow

Tableau

Power BI

Job description

PGIM Ireland is seeking a Senior Data Engineer to design, build, and optimize end-to-end data pipelines and analytics solutions. You will collaborate with architects, data scientists and analysts to deliver scalable platforms and insights that drive business value.

You will work with Python, SQL, Spark and cloud-based data services, applying best practices in testing, documentation, and DevOps routines. A proactive, collaborative mindset is essential for success.