PLUK Data Engineer

Prudential; Manila; On-site; PHP 900,000 - 1,500,000; Full time

Job summary

Prudential is seeking a data infrastructure professional in Manila to design, build, and maintain scalable data pipelines and data lakes that power analytics and ML initiatives.

You will assemble large, complex datasets, optimize ETL processes, and collaborate with Business partners and Data teams to deliver reliable data infrastructure while ensuring compliance with internal standards.

Qualifications

• Bachelor’s degree in Engineering/IT/CS or equivalent.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases like Postgres and Cassandra.
• Experience with data pipeline/workflow tools: Qlik Replicate, FiveTran, Azure Data Factory.
• Experience with Azure cloud services.
• Experience with stream-processing systems: Kafka, Spark Streaming.

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets meeting business requirements.
• Identify and implement internal process improvements for data delivery.
• Build infrastructure for ETL of data from various sources using SQL and big data technologies.
• Develop analytics tools to provide insights on customer acquisition and operations.
• Collaborate with Business, Data, and Design teams to support data infrastructure needs.
• Ensure compliance with company policies and standards.

Skills

Python

Java

C++

Scala

SQL/NoSQL

Big data concepts

Education

Bachelor’s degree in Engineering/IT/CS

Tools

Hadoop

Spark

Kafka

Qlik Replicate

FiveTran

Azure Data Factory

Postgres

Cassandra

Job description

Prudential’s purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our people to do their best work and make an impact to the business, and we support our people’s career ambitions. We pledge to make Prudential a place where you can Connect, Grow, and Succeed.Responsible for managing, designing, building, and maintaining the data infrastructure that supports the organization's data analytics and machine learning initiatives. This includes developing and managing data pipelines, building and optimizing data warehouses and data lakes, and ensuring the quality and security of data. Job Accountabilities* Create and maintain optimal data pipeline architecture* Assemble large, complex data sets that meet functional / non-functional business requirements* Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc* Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS ‘big data’ technologies, etc* Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics* Work with various stakeholders e.g., Business partners, Data and Design teams, etc. to assist with data-related technical issues and support their data infrastructure needs* Ensure that all company policies, procedures, programs and instruction are carried out* Be familiar and understand Pru Life UK Compliance Standards. Must be fully aware of his/her responsibilities and competent to carry them out to the required standards. Must report all compliance matters openly and honestly to their Compliance Officer in accordance with the reporting requirements operated by the Compliance Officer. Must operate a process within his/her department to ensure that all relevant compliance matters are identified and reported* undefined* Perform other functions as may be assigned Job Qualifications* Bachelor’s degree in Engineering, IT, Computer Science, or other equivalent courses* Experience with big data tools: Hadoop, Spark, Kafka, etc.* Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.* Experience with data pipeline and workflow management tools: Qlik Replicate, FiveTran, Azure Data Factory etc* Experience with Azure cloud services* Experience with stream-processing systems: Qlik Replicate, FiveTran* Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.