Data Engineer

Philippine Long Distance; Philippines; On-site; PHP 600,000 - 1,200,000; Full time

Job summary

Philippine Long Distance is seeking a Data Engineer to join our data platform team in the Philippines. You will develop, test, and optimize end-to-end data processing workflows, from ingestion to publication, and work with big data technologies.

You will collaborate with data owners, IT hardware and data source teams to ensure data quality, security, and timely delivery, creating solutions for dashboards and analytics.

Qualifications

• Degree in CS/IS/Engineering or related field.
• Experience in software development and data processing.
• Knowledge of Linux/Unix and big data tools.

Responsibilities

• Develop, test, monitor and optimize end-to-end data processing jobs.
• Build applications consuming data from data lake/warehouse for dashboards.
• Maintain big data architectures and open source databases.
• Ensure data quality, accuracy, timeliness, and compliance with standards.
• Coordinate with business users and IT teams to clarify requirements and issues.

Skills

Experience in software development

Education

Bachelor's degree

Tools

Phyton

Perl

C/C++

PL/SQL

NoSQL

Java

Linux

Unix

HDFS

Hadoop

Apache Spark

Job description

Data Engineer

Company : Philippine Long Distance Job Type : Full Time Philippines

Job Description - Data Engineer

Education

Graduate of any bachelor’s degree in Computer Science, Information Systems / Technology, Engineering or a related study (or equivalent project-related experience).

Qualifications

• Experience in software development.

• Working knowledge in Phyton, Perl, C/C++, PL/SQL,NoSQL and Java

• Linux and Unix is required

• Knowledge and experience in Big Data technologies like HDFS, Hadoop, Apache Spark is a plus

• End to End software development lifecycle

Duties and Responsibilities

• Develop, test, monitor and optimize of end-to-end data processing jobs and workflows from data acquisition, transformation to data exposure / publishing.

• Develop and enhance applications / solutions / software consuming data from the data lake / data warehouse for the purpose of data visualization or advanced data analytics (i.e. reports and dashboards)

• Develop, test and maintain big data architecture, open source databases (e.g., HADOOP, HIVE, HBASE, PRESTO etc.), including duties to support development and deployment of innovative big data platforms

• Establish controls on the data being collected, processed and/or transformed and presented. Perform regular Audit on Data Quality (Accuracy, Completeness and Timeliness) and Ensure Completeness, Accuracy and Timeliness of Data; Ensure compliance to PLDT Group standards.

• Regularly communicate and engage with business users, data owners and stewards, IT hardware support and infrastructure teams, IT data source teams, database administrators and other stakeholders for the purpose of clarifying requirements, communicating status, issues or presenting solutions.

• Manage the day-to-day running of scheduled jobs or program, including enforcing policies, maintaining systems and responding to user requests and ensure that the system delivers consistently on the operational-level agreement (OLA). In case of issues, will also be responsible for the prompt resolution of issues in relation to the end to end data platform components.

• Ensure delivery commitment of 3rd party vendor partners within service-level agreement SLA on the required support from troubleshooting, applying patches, dealing with exceptions and escalating problems.

• Ensure compliance to PLDT Group standards

• Perform other related duties of similar nature or level that may be assigned from time to time

• Support the execution of upgrades or migrations in keeping the technology up to date

• Perform diagnosis of issues as required and synthesize the conclusions into recommendations that drive improvements to the overall delivery

• Create Solutions Design and Technical Architecture documentation

About the Company

Philippine Long Distance

Philippine Long Distance Telephone Company (PLDT) is the leading telecommunications provider in the Philippines with approximately 41 wireless subscribers and nearly 2 million fixed lines. PLDT offers primarily prepaid mobile services under the Smart, Talk 'N Text, and CURE brands; it also offers mo...