Big Data Engineer

Sapientia Technologies Limited; Hong Kong; On-site; HKD 400,000 - 600,000; Full time

Benefits offered by this job

Competitive compensation package

Mentorship opportunities

Flat structure for promotion

Job summary

Sapientia Technologies Limited is looking for a Data Engineer based in Hong Kong. The role involves developing technical architecture for analytics and data science, designing data pipelines, and monitoring data quality.

The candidate should have a Bachelor’s degree and 2-6 years of experience in Data Engineering, with proficiency in Python, SQL, and experience with cloud platforms such as AWS. A competitive salary and mentorship are offered.

Qualifications

• 2-6 years of intensive experience in Data Engineering.
• Proficient in data pipeline development including batch and streaming processing.
• Familiar with the concepts and techniques of crawling.

Responsibilities

• Develop technical architecture for Analytics and Data Science.
• Design and implement data pipelines for batch and streaming solutions.
• Monitor data quality across the data processing lifecycle.

Skills

Python

SQL

R

Linux

Education

Bachelor’s degree

Tools

AWS

Job description

About Your Role

• Develop technical architecture to enable Analytics and Data Science using industry best practices for large scale processing;
• Design, develop and implement data pipelines for batch and streaming solutions;
• Research and develop distributed crawler and data acquisition system; optimize the crawling strategy and improve the crawling effect;
• Monitor data quality across data processing lifecycle;
• Cloud-based data infrastructure administration and database administration when necessary.

About Your Background

• Bachelor’s degree with 2-6 years’ intensive experience in Data Engineering;
• Proficient with Python, R, Julia (at least one), SQL and Linux;
• Proficient in data pipeline development including batch and streaming processing;
• Familiar with concepts and techniques of crawling; Able to design and develop crawler system an advantage;
• Experience with cloud platforms, in particular, AWS a plus;

Your Opportunities

• Stay ahead of market with latest technology & knowledge sharing
• Senior Partner one-on-one mentorship
• Highly competitive compensation package
• Work in a flat structure where your talent gets noticed and promoted quickly
• Work with like-mind people who share common value of being highly motivated, meticulous in details, and systematic thinking.

Privacy Statement: Data collected will be used for recruitment purposes only. Personal data provided will be used strictly in accordance with the relevant data protection law of Hong Kong Special Administrative Region.

Location: Hong Kong – Employment: Full Time – Level: Middle

Email us at [e-mail] if you have any questions regarding this opportunity.