Engineer - Distributed Data Processing System

Social network you want to login/join with:

Location:

Markham, Canada

Job Category:

Information Technology

Job Reference:

a4pt4a5d

Job Views:

Posted:

Expiry Date:

06.05.2025

Job Description:

HuaweiCanada has an immediate 12-month contract opening for an Engineer.

About the team:

Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada. The lab focuses on researching and developing advanced cloud technologies, supporting the productization and iterative optimization of its technical achievements. Current research areas include cloud native databases, infrastructure resource scheduling and prediction, cloud-native middleware, media engines, and user experience studies. The lab fosters a robust technical environment, allowing collaboration with industry experts to create a highly competitive cloud platform.

About the job:

• Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components
• Investigate and design data processing system focusing on extra-large volume data for real-time streaming, based distributed system with the latest and state of the art hardware technology
• Continuous enhancements on the AI-native data analysis system to fulfill customer requirements utilizing AI techniques for public cloud capacity management and scheduling

About the ideal candidate:

• Master's or Ph.D. in Computer Science, Computer Engineering, Applied Mathematics
• High proficiency with Java and Golang, must be able to write strong/clean, brand-new code
• Deep understanding of fundamental concepts such as distributed data processing, distributed database/storage system/file system/memory allocation/cache system, like Kafka and Flink
• Ability to clearly articulate technical concepts and challenges
• Highly analytical with strong problem-solving skills
• Self-motivated with a proven ability to learn and take initiative
• Experience with Linux system level development, distributed system, or scheduling algorithm is an asset