Data Engineer

Bybit; United Arab Emirates; On-site; AED 120,000 - 180,000; Full time

Job summary

A leading cryptocurrency exchange is seeking a Data Engineer responsible for designing and maintaining data pipelines and warehouses using technologies like Hive, Spark, and Presto. The candidate will collaborate with business units to tailor data solutions, ensuring the integrity of ETL processes while optimizing data workflows. A degree in a relevant field and at least 3 years of experience in data engineering are essential, alongside strong programming skills in Python. This role offers an exciting opportunity in the rapidly evolving crypto industry.

Qualifications

• Bachelor’s degree or higher in Computer Science, IT, Data Science, or related.
• At least 3 years of experience in big data engineering.
• Proficient in Hive, Spark, and Presto for data processing and analysis.
• Strong ETL development experience.
• Proficiency in data visualization tools such as Tableau or Power BI.

Responsibilities

• Design, construct, and maintain data pipelines and warehouses.
• Utilize Hive, Spark, and Presto for big data processing.
• Develop and ensure integrity of ETL processes.
• Collaborate to understand data requirements.
• Build resilient data architecture.
• Optimize data processing workflows.
• Support dashboard development requirements.

Skills

Data Pipeline Management

Big Data Processing

ETL Development

Data Visualization (Tableau, Power BI)

Python Programming

Education

Bachelor’s degree in Computer Science, IT, Data Science or related

Tools

Hive

Spark

Presto

Docker

Kubernetes

Bash scripting

Tableau

Power BI

Job description

Responsibility

1. Design , Construct, and Maintain efficient and reliable data Pipeline and Warehouse from diverse data .
2. Utilize Hive, Spark, and Presto for big data processing and analysis
3. Develop and maintain ETL (Extract, Transform, Load) processes to ensure data integrity and consistency
4. Collaborate with data analysts and business units to understand data requirements and provide technical support .
5. Build a resilient data architecture from complex data sources, ensuring alignment and accuracy in data calculations
6. Optimize data processing workflows to improve efficiency and performance
7. Support business-related data push and dashboard development requirements
8. Support the collection of competitor-related data and build the infrastructure for competitive analysis
9. Write and maintain technical documentation to ensure code maintainability and scalability

Requirement

1. Bachelor’s degree or higher in Computer Science, Information Technology, Data Science, or a related field
2. At least 3 years of experience in big data engineering . Business analysis experience is a plus.
3. Proficient in Hive, Spark, and Presto for data processing and analysis
4. Strong ETL development experience and familiar with common data transformation tools
5. Proficient in data visualization tools such as Tableau, Power BI, or similar
6. Strong programming skills in Python (Required)； Java, or Scala is a plus
7. Knowledge of Docker, Kubernetes, and Bash scripting is a plus
8. Crypto or Web3 related working experience is a plus

About Bybit

Established in March 2018, Bybit is one of the fastest growing cryptocurrency derivatives exchanges, with more than 40 million registered users. We aim to continue revolutionizing the industry by fusing the best of cryptocurrency and traditional finance. Our innovative, highly advanced, user-friendly platform has been designed from the ground-up using best-in-class infrastructure to provide our users with the industry's safest, fastest, fairest, and most transparent trading experience. Built on customer-centric values, we endeavour to provide a professional, 24/7 multi-language customer support to help in a timely manner.