Data Engineer: Scalable Pipelines & ML Infrastructure

Pru Life UK; Metro Manila; On-site; PHP 700,000 - 1,300,000; Full time

Job summary

Pru Life UK in the Philippines is seeking a data engineer to design, build, and maintain our data infrastructure that underpins analytics and machine learning initiatives. You will develop and optimize data pipelines, data warehouses and data lakes, while ensuring data quality and security.

You will collaborate with Business partners, Data and Design teams to deliver scalable data solutions and uphold Prudential compliance standards.

Qualifications

• Bachelor’s degree in Engineering, IT, Computer Science or equivalent.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow tools: Qlik Replicate, FiveTran, Azure Data Factory etc.
• Experience with Azure cloud services.
• Experience with stream-processing systems: Qlik Replicate, FiveTran.
• Experience with object-oriented languages: Python, Java, C++, Scala, etc.

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional/non-functional requirements.
• Identify and implement internal process improvements for automation and scalability.
• Build infrastructure for ETL using SQL and AWS big data technologies.
• Build analytics tools that provide insights into customer acquisition and operational performance.
• Collaborate with Business, Data and Design teams to support data infrastructure needs.
• Ensure compliance with company policies and Prudential standards.
• Perform other functions as assigned.

Skills

Hadoop

Spark

Kafka

SQL

NoSQL databases

Python

Java

C++

Scala

Data pipelines

Education

Bachelor's degree in engineering/IT/CS

Tools

Qlik Replicate

FiveTran

Azure Data Factory

Azure cloud services

Job description

Pru Life UK in the Philippines is seeking a data engineer to design, build, and maintain our data infrastructure that underpins analytics and machine learning initiatives. You will develop and optimize data pipelines, data warehouses and data lakes, while ensuring data quality and security.

You will collaborate with Business partners, Data and Design teams to deliver scalable data solutions and uphold Prudential compliance standards.