Senior Staff Data Engineer Product Data Development

Unchain Data; Singapore; On-site; SGD 100,000 - 170,000; Full time

Benefits offered by this job

Competitive total compensation package

L&D programs and Education subsidy

Team events and wellness support

Healthcare schemes for employees and 


Job summary

OKX data team seeks a data engineer to own end-to-end data pipelines, from ingestion to data products, in a fast-moving crypto ecosystem.

You will work on real-time and batch data processing, design and optimize the online product data pipeline, and collaborate across teams to empower evidence-based decision-making.

Qualifications

• Bachelor's degree or higher in Computer Science or a related field.
• 3+ years of experience handling end-to-end business requirements with strong communication and teamwork skills.
• Proficiency in English and Chinese (listening, speaking, reading, writing).
• Familiar with data warehouse modeling and designing/refactoring large-scale data warehouses.
• Mastery of big data architectures: Alibaba Cloud DataWorks/MaxCompute, AWS Spark, Databricks, StarRocks/Doris.
• In-depth understanding of real-time processing; Flink performance tuning and stress testing preferred.

Responsibilities

• Proficient in cloud computing and big data tech such as Hadoop, Hive, Flink, YARN, Elasticsearch, Kafka.
• Lead real-time big data processing with Flink and Flink SQL development.
• Build and optimize offline and real-time data pipelines for timeliness and accuracy.
• Independently manage end-to-end business requirements and design the online product data pipeline, including performance optimization.

Skills

Hadoop

Hive

Flink

YARN

Elasticsearch

Kafka

Real-time processing

Flink SQL

Data pipelines

Data warehousing

Alibaba Cloud DataWorks

MaxCompute

Databricks

StarRocks

Doris

Education

Bachelor's degree in Computer Science

Tools

Alibaba Cloud DataWorks

MaxCompute

AWS Spark

Databricks

StarRocks/Doris

Job description

About Us

At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.

About the Team

OKX data team is responsible for the whole data scope of OKG, from technical selection, architecture design, data ingestion, data storage, ETL, data visualization to business intelligence and data science. We are data engineers, data analysts and data scientists. The team has end-to-end ownership of most of the data at OKX throughout the whole data lifecycle including data ingestion, data ETL, data warehouse and data services. As a data engineer of the team, you will work with the team to leverage data technologies to empower evidence-based decision-making and improve the quality of the company's products and services.

The Role

OKX will be prioritizing applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa.

Responsibilities

• Proficient in mainstream cloud computing and big data technologies such as Hadoop, Hive, Flink, YARN, Elasticsearch (ES), Kafka, etc.
• Expert in real-time big data processing using Flink, with solid experience in Flink SQL development.
• Build and optimize offline and real-time data pipelines to ensure data timeliness and accuracy.
• Independently manage end-to-end business requirements, responsible for the R&D design and construction of the online (customer-facing) product data pipeline, including performance optimization, and empower business growth through data products and services.

Requirements

• Bachelor's degree or higher from an accredited university in Computer Science or a related field.
• 3+ years of experience independently handling end-to-end business requirements, with strong self-motivation, a high sense of responsibility, excellent communication and teamwork skills, and a passion for continuous learning and self-challenge.
• Proficiency in both English and Chinese (listening, speaking, reading, and writing).
• Familiar with data warehouse modeling, with successful experience in designing and refactoring large-scale data warehouses.
• Mastery of multiple big data architectures, especially Alibaba Cloud DataWorks/MaxCompute, AWS Spark, Databricks, and StarRocks/Doris.
• In-depth understanding of real-time processing, expert in Flink performance tuning and stress testing, and Flink source code reading experience is preferred.

Preferred Qualifications

• IELTS score of 7 or above in all four components.
• 3+ years of work experience in English-speaking regions.
• Experience in cross border e-commerce, and familiarity with multi-country, multi-language architectural design is a plus.
• Solid foundation in Java, with backend development experience.

Perks & Benefits

• Competitive total compensation package
• L&D programs and Education subsidy for employees' growth and development
• Various team building programs and company events
• Wellness and meal allowances
• Comprehensive healthcare schemes for employees and dependants
• More that we love to tell you along the process!