BigData Tester

JonDavidson Pte Ltd; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

JonDavidson Pte Ltd is looking for a QA Engineer specializing in Big Data testing in Singapore. The ideal candidate has 2+ years of hands-on experience with Hadoop platforms and tools like Spark and Hive.

Your responsibilities will include building test methodologies, executing test cases, and conducting performance testing. You will be part of a dynamic team, contributing to high volume data projects and ensuring the quality of data flows in Hadoop environments.

Qualifications

• 2+ years of hands-on live project QA experience with Big Data Hadoop platforms.
• 1+ years testing Big Data programs written in Spark, Hive, or similar.
• Experience testing on Data warehouse & BI applications.

Responsibilities

• Build Hadoop/Big Data test methodologies.
• Automate testing efforts using Hadoop tools.
• Conduct Hadoop performance testing and identify QA risks.

Skills

Distributed high volume big data testing

Hadoop ecosystem knowledge

ETL testing

SQL

Apache Spark

Agile methodologies

Tools

Informatica

Talend

Hive

Spark

Job description

Our client is one of the world's leading professional services companies, listed on NASDAQ. Headquartered in the U.S., is consistently listed among the most admired companies in the world.

Job Description

Job Summary:

Experience: 4 – 8 years

Job Description:

Build Hadoop/Big Data test methodologies (functional/non-functional) in high volume/frequency data testing, prepare Hadoop Test Plan, design Hadoop Test Cases, test Scenarios & test scripts

• Prepare test data for test cases, execute Hadoop Test Cases.
• Test workflow processes, detect bugs through the queries, finding bad data.
• Automate testing efforts by using Hadoop tools like Spark/Hive/HBase/Oozie and share test results
• Conduct Hadoop (Spark) performance testing by using standard tools
• Traditional and Agile software development and Testing environments
• Proactively identify risks and issues across the QA work streams, advise on increasing process maturity, help develop testing standards, best practices and processes
• Working experience in customer facing onsite role coordinating with QA test engineers and Dev team leads.

Qualifications

Job Requirement s

We are seeking highly motivated candidates with a strong QA background in distributed high volume big data testing using data warehouse, MPP (DW) appliance, Hadoop and its ecosystem technologies.

The ideal person for this will understand all technical aspect of Data flow into Hadoop cluster, distributed computing using Data warehouse, MPP-DW, ETL, ELT, SQL, Apache Spark ecosystem, DevOps and continuous testing, business intelligence and advanced analytics testing and reporting processes.

The Ideal Candidate Will Have:

• Must have 2 + years of hands-on live project QA experience with on one or more Big Data Hadoop platforms like Hortonworks or Cloudera
• Must have 1 + years testing Big Data programs written in Spark (Scala / Python), Storage (Hive / Impala / Kudu / HBase), consumption (BI Spotfire) in pre--production cluster environment
• 1+ years testing on Data warehouse & BI applications build on SQ Server, Oracle, Teradata
• 1+ years of ETL testing using one or more platform such as Informatica or Talend or SSIS