Data Engineer - Big Data

PERSOL SINGAPORE PTE. LTD.; Singapore; On-site; SGD 80,000 - 110,000; Full time

Job summary

An employment solutions provider in Singapore is seeking an experienced Hadoop Developer to design and implement Hadoop solutions and troubleshoot Spark jobs. Candidates should have 7-10 years of relevant experience, with strong proficiency in Java and Scala. This role involves developing data ingestion pipelines and automating reporting processes. Interested applicants are encouraged to apply by sending their resumes via email.

Qualifications

• 7-10 years of experience as a Hadoop Developer.
• Strong technical knowledge in Hadoop solutions and data processing frameworks.
• Ability to automate code/scripts for reporting requirements.

Responsibilities

• Design, implement, and validate Hadoop solutions.
• Troubleshoot MapReduce/Spark jobs and do performance tuning.
• Analyze data requirements and develop ingestion pipelines.

Skills

Proficient with Java

Proficient with Scala

Hands-on experience on Spark framework

Proficient in ETL tools like Talend

Proficient in DataStage

Education

BS/MS in Computer Science, Engineering, or similar relevant field

Job description

Responsibilities

• Design implement and validate Hadoop solutions.
• TroubleshootMapReduce/Spark Jobs and do performance tuning in production environments.
• Independentlydevelop and sustain technical knowledge, certifications, and skills.
• Effectivelyhandling day-to-day assignments given moderate directions and supervision.
• Analysingthe data requirements across various entities, develop and maintain dataingestion pipelines.
• Automatingdata validation steps and report generation.
• Automating codes/ scriptsthat can be repeatedly used across similar analytics and reportingrequirements.

Skills/Requirement

• BS/MS in Computer Science, Engineering, or similarrelevant field.
• Previous working experience as a Hadoop Developerfor 7-10 years.
• Proficient with Java and Scala.
• Hands-on experience on Spark framework and otherdistributed data processing frameworks like Hadoop Map-Reduce, Hive etc.
• Proficient in ETL tools like Talend,DataStage.

Interested candidates, who wish to apply for the above position, please send in your resume to: [e-mail]

PERSOL Singapore Pte Ltd

EA License No. 01C4394 EA Reg No: R23118975 (ABDUL RAHMAN ANSARI RAJA)

We regret to inform you that only shortlisted candidates will be contacted.

**********************************

This is in partnership with Employment and Employability Institute Pte Ltd (“e2i”). e2i is the empowering network for workers and employers seeking employment and employability solutions. e2i serves as a bridge between workers and employers, connecting with workers to offer job security through job-matching, career guidance and skills upgrading services, and partnering employers to address their manpower needs through recruitment, training, and job redesign solutions. e2i is a tripartite initiative of the National Trades Union Congress set up to support nation-wide manpower and skills upgrading initiatives. By applying for this role, you consent to e2i’s PDPA.

By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOL Singapore Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.persol.com.sg/policies. You acknowledge that you have read, understood, and agree with the Privacy Policy.

**********************************