Data Engineer

Bybit; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Job summary

Bybit is seeking a hands-on Big Data Engineer in Kuala Lumpur to design, build, and optimize data pipelines and warehouses from diverse sources. You will leverage Hive, Spark and Presto to process large data sets and develop robust ETL processes, while collaborating with analysts and business units to meet data needs.

Qualifications include a Bachelor's in CS/IT/DS and 3+ years in big data, with strong Python skills; Docker/Kubernetes and BI tools like Tableau/Power BI are a plus.

Qualifications

• Bachelor's degree or higher in CS/IT/DS
• 3+ years of big data engineering experience; business analysis experience is a plus
• Proficient in Hive, Spark, and Presto for data processing and analysis
• Strong ETL development experience and familiar with common data transformation tools
• Proficient in data visualization tools such as Tableau, Power BI, or similar
• Strong programming skills in Python (Required)； Java, or Scala is a plus
• Knowledge of Docker, Kubernetes, and Bash scripting is a plus
• Crypto or Web3 related working experience is a plus

Responsibilities

• Design, Construct, and Maintain efficient and reliable data Pipeline and Warehouse from diverse data .
• Utilize Hive, Spark, and Presto for big data processing and analysis
• Develop and maintain ETL (Extract, Transform, Load) processes to ensure data integrity and consistency
• Collaborate with data analysts and business units to understand data requirements and provide technical support .
• Build a resilient data architecture from complex data sources, ensuring alignment and accuracy in data calculations
• Optimize data processing workflows to improve efficiency and performance
• Support business-related data push and dashboard development requirements
• Support the collection of competitor-related data and build the infrastructure for competitive analysis
• Write and maintain technical documentation to ensure code maintainability and scalability

Skills

Python

Hive

Spark

Presto

ETL development

Data visualization

Tableau

Power BI

Docker

Kubernetes

Education

Bachelor's degree in CS/IT/DS

Tools

Tableau

Power BI

Docker

Kubernetes

Job description

Established in March 2018, Bybit is one of the fastest growing cryptocurrency derivatives exchanges, with more than 40 million registered users. We aim to continue revolutionizing the industry by fusing the best of cryptocurrency and traditional finance. Our innovative, highly advanced, user-friendly platform has been designed from the ground-up using best-in-class infrastructure to provide our users with the industry's safest, fastest, fairest, and most transparent trading experience. Built on customer-centric values, we endeavour to provide a professional, 24/7 multi-language customer support to help in a timely manner.

Responsibility:

• Design , Construct, and Maintain efficient and reliable data Pipeline and Warehouse from diverse data .


• Utilize Hive, Spark, and Presto for big data processing and analysis


• Develop and maintain ETL (Extract, Transform, Load) processes to ensure data integrity and consistency


• Collaborate with data analysts and business units to understand data requirements and provide technical support .


• Build a resilient data architecture from complex data sources, ensuring alignment and accuracy in data calculations


• Optimize data processing workflows to improve efficiency and performance


• Support business-related data push and dashboard development requirements


• Support the collection of competitor-related data and build the infrastructure for competitive analysis


• Write and maintain technical documentation to ensure code maintainability and scalability

Requirement:

• Bachelor's degree or higher in Computer Science, Information Technology, Data Science, or a related field


• At least 3 years of experience in big data engineering . Business analysis experience is a plus.


• Proficient in Hive, Spark, and Presto for data processing and analysis


• Strong ETL development experience and familiar with common data transformation tools


• Proficient in data visualization tools such as Tableau, Power BI, or similar


• Strong programming skills in Python (Required)； Java, or Scala is a plus


• Knowledge of Docker, Kubernetes, and Bash scripting is a plus


• Crypto or Web3 related working experience is a plus