Data Engineer

AvePoint; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

AvePoint is seeking a highly skilled Big Data Engineer in Singapore to design, develop, and maintain data ingestion and processing jobs for business requirements. You will integrate data sets to provide seamless access and support analytics across environments.

The ideal candidate has 4+ years in data engineering, hands-on experience with PySpark, Python, Hive/Impala, and CDP-like platforms, with strong SQL and data modelling skills to drive scalable solutions.

Qualifications

• 4+ years of experience in data engineering in big data environments.
• Experience with Cloudera Data Platform or similar.
• Strong SQL, data modelling and data analysis skills.
• Hands-on with Python, PySpark, Linux and ETL tools.

Responsibilities

• Analyze the Authority’s data needs and document the requirements.
• Refine data collection/consumption by migrating data collection to more efficient channels.
• Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
• Develop test plan and scripts for system testing, support user acceptance testing.
• Work with IT teams to ensure smooth deployment and adoption of new solution.
• Ensure the smooth operations and service level of IT solutions.
• Support production issues - Track record in implementing systems with high availability, high performance, high security.

Skills

SQL

Data modelling

Data analysis

Communication

Tools

Python

PySpark

Linux

Informatica

Hive

Impala

Denodo

Tableau

SAP BO

Job description

About AvePoint:

Securing the Future. AvePoint is a global leader in data management and data governance, and over 21,000 customers worldwide rely on our solutions to modernize the digital workplace across Microsoft, Google, Salesforce and other collaboration environments. AvePoint’s global channel partner program includes over 3,500 managed service providers, value added resellers and systems integrators, with our solutions available in more than 100 cloud marketplaces. To learn more, visit www.avepoint.com.

At AvePoint, we are committed to investing in our people. Agility, passion and teamwork set us up to do our best work and foster a culture where you are empowered to craft your career, make an impact, and own (y)our future. Unleash the power of you!

About the role:

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/ Senior Consultant preferably. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as per business requirements. Candidate will also be integrating data sets to provide seamless data access to users.

Key responsibilities:

• Analyze the Authority’s data needs and document the requirements.
• Refine data collection/consumption by migrating data collection to more efficient channels.
• Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
• Develop test plan and scripts for system testing, support user acceptance testing.
• Work with the Authority’s technical teams to ensure smooth deployment and adoption of new solution.
• Ensure the smooth operations and service level of IT solutions.
• Support production issues - Track record in implementing systems with high availability, high performance, high security.

The ideal candidate has:

• Good understanding and completion of projects using waterfall/Agile methodology.
• Good understanding of analytics and data warehouse implementations.
• Ability to troubleshoot complex issues ranging from system resource to application stack traces.
• Strong SQL, data modelling and data analysis skills are a must.
• Hands-on experience in big data engineering jobs using Python, PySpark, Linux, and ETL tools like Informatica.
• Track record in implementing systems using Hive, Impala and Cloudera Data Platform will be preferred.
• Hands-on experience in DevOps deployment and data virtualization tools like Denodo will be preferred.
• Understanding/ Hands on experience of reporting or visualization tool like SAP BO and Tableau will be beneficial but not required.
• Passion for automation, standardization, and best practices.
• Good written and verbal communication and interpersonal skills, ability to understand the business requirement, communicate confidently with stakeholders.

AvePoint is proud to employ talent from many different backgrounds, experiences, and identities. We believe that diversity and inclusion drives our success and is at the core of how we hire, communicate, and collaborate to deliver value and excellence. We are committed to fostering an environment where people can bring their whole selves to work and feel a sense of belonging, and we continue to work toward creating a workforce that represents the diversity of our customers and communities.

Any personal data you share with us during the application process will be processed strictly in compliance with applicable data protection laws and our Privacy Notice.