Senior Data Engineer

People Search Consultants; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

People Search Consultants is seeking a senior Data Engineer to design, develop, and operate the Enterprise Data Platform for ongoing and future projects. You will review data architectures, implement best practices for data management, and optimize data retrieval for dashboards and analytics.

The role requires 6+ years in data engineering, experience with big data frameworks like Hadoop/Spark, NoSQL databases, and querying tools such as Hive, Spark SQL, and Impala.

Qualifications

• Proven expertise in data engineering and building scalable data pipelines.
• Strong analytical mindset with ability to solve complex data challenges.
• Excellent written and verbal communication for collaboration and documentation.

Responsibilities

• Design, develop, and test the deployment and operation phases of the Enterprise Data Platform for current and future projects.
• Review, build, or restructure data architecture and ensure its ongoing maintenance and testing.
• Establish and implement best practices for data management, reporting, and security.
• Enhance foundational data procedures, guidelines, and standards.
• Evaluate datasets to identify opportunities for improving data reliability, efficiency, and quality.
• Understand, design, acquire, and manage organizational datasets that support analytics to meet business objectives.
• Optimize data retrieval processes to aid in the creation of dashboards and other visualizations for stakeholders.
• Prepare core data for use in preive and predictive modelling.

Skills

Data engineering

Analytical thinking

Communication skills

Education

Degree in Computer Science or related

Tools

Hive

Spark SQL

Impala

Hadoop

Spark

NoSQL databases

Job description

• Design, develop, and test the deployment and operation phases of the Enterprise Data Platform for both current and future projects.
• Review, build, or restructure data architecture and ensure its ongoing maintenance and testing.
• Establish and implement best practices for data management, reporting, and security.
• Enhance foundational data procedures, guidelines, and standards.
• Evaluate datasets to identify opportunities for improving data reliability, efficiency, and quality.
• Understand, design, acquire, and manage organizational datasets that support analytics to meet business objectives.
• Optimize data retrieval processes to aid in the creation of dashboards and other visualizations for stakeholders.
• Prepare core data for use in preive and predictive modelling.

Requirements

• Degree in Computer Science, Computer Engineering or a related field
• Over 6 years expertise of Data Engineering
• Experience with big data frameworks (e.g. Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR)
• Experience with NoSQL databases (e.g. Cassandra, MongoDB, Neo4J, ElasticSearch)
• Experience with querying tools (e.g Hive, Spark SQL, Impala)
• Strong analytical prowess, problem-solving abilities, and decision-making capabilities.
• Excellent written and verbal communication skills for effective collaboration and documentation
• 2 Positions Available