Data Engineer

Bybit; United Arab Emirates; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading cryptocurrency derivatives exchange is seeking a Big Data Engineer to design and maintain data pipelines and architectures. The ideal candidate will have a degree in Computer Science and at least three years of experience in big data engineering. Proficiency in Hive, Spark, and Python is essential, alongside strong skills in ETL and data visualization tools like Tableau and Power BI. This role offers an innovative work environment aimed at revolutionizing the finance industry.

Qualifications

• Bachelor’s degree or higher in Computer Science or related field.
• 3+ years of experience in big data engineering.
• Proficient in Hive, Spark, and Presto for data processing.

Responsibilities

• Design, construct, and maintain efficient data pipelines.
• Develop and maintain ETL processes for data integrity.
• Collaborate with data analysts to understand requirements.

Skills

Hive

Spark

Presto

Python

Java

Scala

Docker

Kubernetes

Bash scripting

Tableau

Power BI

Education

Bachelor’s degree in Computer Science, Information Technology, Data Science

Job description

Job description

Responsibility:

1. Design , Construct, and Maintain efficient and reliable data Pipeline and Warehouse from diverse data .
2. Utilize Hive, Spark, and Presto for big data processing and analysis
3. Develop and maintain ETL (Extract, Transform, Load) processes to ensure data integrity and consistency
4. Collaborate with data analysts and business units to understand data requirements and provide technical support .
5. Build a resilient data architecture from complex data sources, ensuring alignment and accuracy in data calculations
6. Optimize data processing workflows to improve efficiency and performance
7. Support business-related data push and dashboard development requirements
8. Support the collection of competitor-related data and build the infrastructure for competitive analysis
9. Write and maintain technical documentation to ensure code maintainability and scalability

Requirement:

1. Bachelor’s degree or higher in Computer Science, Information Technology, Data Science, or a related field
2. At least 3 years of experience in big data engineering . Business analysis experience is a plus.
3. Proficient in Hive, Spark, and Presto for data processing and analysis
4. Strong ETL development experience and familiar with common data transformation tools
5. Proficient in data visualization tools such as Tableau, Power BI, or similar
6. Strong programming skills in Python (Required)； Java, or Scala is a plus
7. Knowledge of Docker, Kubernetes, and Bash scripting is a plus
8. Crypto or Web3 related working experience is a plus

About Bybit:

Established in March 2018, Bybit is one of the fastest growing cryptocurrency derivatives exchanges, with more than 40 million registered users. We aim to continue revolutionizing the industry by fusing the best of cryptocurrency and traditional finance. Our innovative, highly advanced, user-friendly platform has been designed from the ground-up using best-in-class infrastructure to provide our users with the industry's safest, fastest, fairest, and most transparent trading experience. Built on customer-centric values, we endeavour to provide a professional, 24/7 multi-language customer support to help in a timely manner.

Responsibility:

1. Design , Construct, and Maintain efficient and reliable data Pipeline and Warehouse from diverse data .
2. Utilize Hive, Spark, and Presto for big data processing and analysis
3. Develop and maintain ETL (Extract, Transform, Load) processes to ensure data integrity and consistency
4. Collaborate with data analysts and business units to understand data requirements and provide technical support .
5. Build a resilient data architecture from complex data sources, ensuring alignment and accuracy in data calculations
6. Optimize data processing workflows to improve efficiency and performance
7. Support business-related data push and dashboard development requirements
8. Support the collection of competitor-related data and build the infrastructure for competitive analysis
9. Write and maintain technical documentation to ensure code maintainability and scalability

Requirement:

1. Bachelor’s degree or higher in Computer Science, Information Technology, Data Science, or a related field
2. At least 3 years of experience in big data engineering . Business analysis experience is a plus.
3. Proficient in Hive, Spark, and Presto for data processing and analysis
4. Strong ETL development experience and familiar with common data transformation tools
5. Proficient in data visualization tools such as Tableau, Power BI, or similar
6. Strong programming skills in Python (Required)； Java, or Scala is a plus
7. Knowledge of Docker, Kubernetes, and Bash scripting is a plus
8. Crypto or Web3 related working experience is a plus

About Bybit:

Established in March 2018, Bybit is one of the fastest growing cryptocurrency derivatives exchanges, with more than 40 million registered users. We aim to continue revolutionizing the industry by fusing the best of cryptocurrency and traditional finance. Our innovative, highly advanced, user-friendly platform has been designed from the ground-up using best-in-class infrastructure to provide our users with the industry's safest, fastest, fairest, and most transparent trading experience. Built on customer-centric values, we endeavour to provide a professional, 24/7 multi-language customer support to help in a timely manner.