Big Data Engineer - Ecommerce Recommendation Infrastructure (ByteDance Singapore) Technology - Big data Singapore Regular

Bytedance; Singapore; Hybrid; SGD 150,000 - 190,000; Full time

Job summary

ByteDance Singapore is seeking a Big Data Engineer to join the Ecommerce Recommendation Infrastructure team. You will help design and optimize the data architecture for large-scale recommendations, collaborating with ML engineers and data scientists to build scalable storage and compute systems.

You will apply data mining, ML, and data analytics to transform raw data into actionable insights, with emphasis on stability, performance, and cost efficiency in a fast-growing environment.

Qualifications

• Bachelor's degree or higher in computer science, software engineering or related field.
• Familiar with Hadoop, Hive, Flink, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.
• Proficiency in Java, C++ and other programming languages.
• Strong coding and troubleshooting ability.
• Willingness to learn new technologies and tackle hard questions.
• At least 3 years of relevant experience; large-scale data experience preferred.

Responsibilities

• Design and implement offline data architecture for large-scale recommender systems.
• Build flexible, scalable, high-performance storage and computing systems.
• Troubleshoot production systems and ensure overall stability.
• Develop distributed storage/compute infra for massive data and services.
• Develop analytics applications to transform raw data into insights.
• Apply data mining, modeling, NLP, and machine learning to extract value.
• Visualize, interpret data findings and create dynamic reports.

Skills

Open source frameworks

Java

C++

Troubleshooting

Learning new tech

3+ years experience

Education

Bachelor's degree in CS/SE or related

Tools

Hadoop

Hive

Flink

Spark

Kafka

HBase

Redis

RocksDB

ElasticSearch

Job description

Big Data Engineer - Ecommerce Recommendation Infrastructure (ByteDance Singapore)

Location:

Team:

Employment Type:

Regular

Job Code:

A233938A

Share this listing:

Responsibilities

About the TeamE-commerce is a new and fast growing business that aims at connecting all customers to excellent sellers and quality products, through E-commerce live-streaming, E-commerce short videos, and commodity recommendation. Our E-ecommerce Recommendation Infra team is responsible for building up and optimizing the infrastructure for such recommendation systems, so as to provide the most stable and best experience for our users. We work closely with applied machine learning engineers and build scalable systems to support all kinds of innovative algorithms and techniques.The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-performance storage and computing systems.

• Design and implement a reasonable offline data architecture for large-scale recommendation systems
• Design and implement flexible, scalable, stable and high-performance storage and computing systems
• Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
• Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems
• Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
• Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
• Visualise, interpret, and report data findings and may create dynamic data reports as well

Qualifications

• Minimum Qualifications- Bachelor's degree or above in computer science, software engineering, or a related field
• Familiar with many open source frameworks in the field of big data, e.g.Hadoop, Hive,Flink, FlinkSQL,Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.
• Familiar with Java, C ++ and other programming languages
• Strong coding and trouble shooting ability
• Willing to challenge questions that have no obvious answers, and have a strong enthusiasm for learning new technologies
• At least 3 years of relevant experiencePreferred Qualifications- Experience of Peta Byte level data processing is a plus

Job Information

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.