645171BR Data Engineer - Big Data

half the sky; Quezon City; On-site; PHP 600,000 - 800,000; Full time

Job summary

A technology company in Quezon City seeks a Data Engineer to develop big data applications leveraging technologies like Python, Spark, and Hadoop. The role requires strong programming skills in Unix/Linux and SQL, as well as the ability to identify and solve data-related issues. This is a great opportunity for someone passionate about working with big data in a dynamic environment.

Qualifications

• Development experience in Big Data software development technologies such as Hadoop, Hive or Spark.
• Proficient background in Unix or Linux programming language.
• Good understanding in SQL and RDBMS.
• Ability to identify data problems and guide resolution.

Responsibilities

• Develop applications on Big Data and Cognitive technologies.
• Support deployed data applications by identifying data problems.
• Collaborate with partner Data Engineers and data providers.

Skills

Python

Spark

Kafka

Hadoop

NoSQL

HBase

HIVE

PIG

C++

SQL

Linux

Java

Job description

About the job 645171BR Data Engineer - Big Data

At IBM, work is more than a job its a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things youve never thought possible. Are you ready to lead in this new era of technology and solve some of the worlds most challenging problems? If so, lets talk.

Your Role and Responsibilities develops applications on Big Data and Cognitive technologies including API development. Expected to have traditional Application Development background along with knowledge of Analytics libraries, open-source Natural Language Processing, statistical and big data computing libraries. Strong technical abilities to understand, design, write and debug complex code. Skills include Python, Spark, Kafka, IBM BigInsights, Hadoop, NoSQL, HBase, HIVE, PIG, C++, SQL, Linux, Java, EAI, SOA, CEP, HDFS, ETL.

Required Technical and Professional Expertise

• Development experience in Big Data software development technologies such as Hadoop, Hive or Spark.
• Proficient background in Unix or Linux programming language.
• Good understanding in SQL and RDBMS. Good at modeling data for relational, analytical and big data workload.
• Provide support for deployed data applications and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers.

Preferred Technical and Professional Expertise

• Must Have skill in Big Data tools such as Hadoop, Hive or Spark.
• Proven background in SQL, Unix/Linux and ETL process.