Java Spark Engineer

CONSULGURU PTE. LTD.; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

A technology solutions company in Singapore is seeking a candidate proficient in Java and Apache Spark to design, develop, and maintain applications. The role involves coding, systems analysis, and collaboration with global teams in a supportive work environment. Ideal candidates will hold a Bachelor's degree in a related field and have experience with cloud computing and data analysis.

Benefits

Opportunity to work on cutting-edge projects.

Collaborative and supportive work environment

Qualifications

• Experience with Apache Spark streaming and batch framework.
• Experience with data modeling, data wrangling, and data analysis.
• Ability to work independently and as part of a team.

Responsibilities

• Help write analytics code, services and components.
• Responsible for systems analysis and coding.
• Work proactively with global teams.

Skills

Java

Apache Spark

Kafka

Data analysis

Problem-solving

Agile/Scrum

Communication skills

Education

Bachelor's degree in computer science, data science, or related field

Tools

AWS

Azure

GCP

Job description

Job Description & Requirements

This role will be responsible for designing, developing, and maintaining Applications using Apache Spark open-source framework. They work with different aspects of the Spark ecosystem, including Spark SQL, Data Frames, Datasets, and streaming.

Role:

• Help write analytics code, services and components in Java, Apache Spark and Kafka
• Responsible for systems analysis - Design, Coding, Unit Testing and other SDLC activities
• Creating Technical design diagrams for business modules, code review with the peers.
• Requirement gathering and understanding, Analyze and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates
• Work proactively, independently and with global teams to address project requirements, and articulate issues/challenges with enough lead time to address project delivery risks
• Providing expertise in technical analysis and solving technical issues during project delivery
• Code reviews, test case reviews and ensure code developed meets the requirements

Responsibilities

• Experience with Java essential.
• Experience with Apache Spark streaming and batch framework
• Experience with Kafka, Storm, Zookeeper
• Agile/Scrum methodology experience is required.
• Service oriented architecture, and data standards like JSON, Avro, Protobuf
• Strong communication skills, should be able to communicate effectively with business and other stake holders
• Demonstrate ownership and initiative taking

Qualifications

• Bachelor's degree in computer science, data science, or a related field
• Experience with Apache Spark, Java, SAS, Hive, Hadoop, and the Hadoop ecosystem
• Experience with data modeling, data wrangling, and data analysis
• Experience with cloud computing platforms (e.g., AWS, Azure, GCP)
• Strong problem-solving and analytical skills
• Excellent communication and teamwork skills
• Strong programming skills
• Experience with data migration
• Ability to work independently and as part of a team.

Benefits

• Opportunity to work on cutting-edge projects.
• Collaborative and supportive work environment