Reporting and Analytics Developer

User Experience Researchers Pte.Ltd; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

A technology firm in Singapore is seeking a highly skilled Big Data Engineer with at least 4 years of experience in big data environments. The ideal candidate will possess strong SQL and data analysis skills and be experienced in Python, ETL tools, and visualization tools such as Tableau. Responsibilities include analyzing data needs, implementing data engineering jobs, and ensuring smooth deployment and operations of IT solutions. The role offers opportunities to work on high-performance, secure systems in hybrid cloud environments.

Qualifications

• Minimum of 4 years of experience in big data environment.
• Experience with waterfall/Agile methodology.
• Strong SQL, data modelling, and data analysis skills.

Responsibilities

• Analyze client data needs and document requirements.
• Plan, design and implement data engineering jobs.
• Develop test plans and scripts for system testing.

Skills

SQL

Data modelling

Data analysis

Python

Pyspark

Linux

ETL tools

SAP BO

Tableau

DevOps deployment

Data virtualization

Hive

Impala

Cloudera Data Platform

Tools

Informatica

Denodo

Job description

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs. Candidate will also be integrating data sets to provide seamless data access to users.

Responsibilities

• Analyze the clientsdata needs and document the requirements.
• Refine data collection/consumption by migrating data collection to more efficient channels.
• Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
• Develop test plan and scripts for system testing, support user acceptance testing.
• Build reports and dashboards according to user requirements
• Work with the clients technical teams to ensure smooth deployment and adoption of new solution.
• Ensure the smooth operations and service level of IT solutions.
• Support production issues

What we are looking for

• Good understanding and completion of projects using waterfall/Agile methodology.
• Strong SQL, data modelling and data analysis skills are a must.
• Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica.
• Hands-on experience in a reporting or visualization tool like SAP BO and Tableau is must.
• Hands-on experience in DevOps deployment and data virtualization tools like Denodo will be an advantage.
• Track record in implementing systems using Hive, Impala and Cloudera Data Platform will be preferred.
• Good understanding of analytics and data warehouse implementations.
• Ability to troubleshoot complex issues ranging from system resource to application stack traces.
• Track record in implementing systems with high availability, high performance, high security hosted at various data centres or hybrid cloud environments will be an added advantage.
• Passion for automation, standardization, and best practices