Senior Software Development Engineer

QUESS SINGAPORE; Singapore; On-site; SGD 80,000 - 130,000; Full time

Job summary

A leading company in Singapore is seeking a Senior Big Data Developer to join their team. The successful candidate will have over 10 years of experience in software design, particularly in Big Data technologies such as Scala and Spark. This role involves mentoring team members, promoting development standards, and ensuring effective production support. The ideal candidate will also collaborate with business analysts for requirement interpretation and actively participate in Agile ceremonies.

Qualifications

• 10 years of experience in Big Data development.
• Proficient in Scala 2.10+ and Apache Spark.
• Hands-on experience with Hadoop, Hive, Kafka, and performance optimization.

Responsibilities

• Design and develop software in a Big Data environment.
• Promote coding standards and conduct peer code reviews.
• Provide production support and troubleshoot issues.

Skills

Big Data

Scala

Apache Spark

SQL

Python

ETL frameworks

Apache Hadoop

DevOps

Education

Bachelor's degree

Tools

Git

JIRA

Ansible

Jenkins

Job description

Roles & Responsibilities

Job Description:

Software design, Big Data, Scala & Spark development, automated testing of new and existing components in an Agile, DevOps, and dynamic environment.

Promoting development standards, code reviews, mentoring, and knowledge sharing.

Production support & troubleshooting.

Implement tools and processes, handling performance, scale, availability, accuracy, and monitoring.

Liaison with BAs to ensure requirements are correctly interpreted and implemented.

Participation in regular planning and status meetings. Input to the development process through Sprint reviews and retrospectives. Input into system architecture and design.

Peer code reviews.

Requirements:

• 10 years of experience in Big Data development with a Bachelor's degree.
• Big Data, Scala development and design using Scala 2.10+
• Experience with technologies such as Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services.
• Sound knowledge of Unix/Linux platforms.
• Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL.
• Experience with version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins), and requirement management in JIRA.
• Understanding of big data modeling techniques using relational and non-relational techniques.
• Experience debugging code issues and communicating findings to development teams/architects.
• Experience with time-series/analytics databases such as Elasticsearch.
• Experience with scheduling tools like Airflow, Control-M.
• Understanding or experience of Cloud design patterns.
• Exposure to DevOps & Agile methodologies such as Scrum and Kanban.
• Experience developing Hive QL, UDFs for analyzing semi-structured/structured datasets.

This job posting is active.