Big Data Engineer

BYTEDANCE PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ByteDance in Singapore is seeking a senior data platform engineer to empower the business with data. You will help build a data warehouse capable of batch and streaming data, and develop data products with useful metrics and dashboards to guide smarter business decisions.

You will collaborate with the business to translate requirements into scalable ETL, data modeling, and analytics solutions; apply NLP/ML where applicable and contribute to rollouts and releases of data system changes.

Qualifications

• 5+ years in software engineering and 2+ years in data engineering.
• Proficient in creating and maintaining complex ETL pipelines end-to-end with reliability and security.
• Familiar with data warehouse concepts and modeling.
• Familiar with at least 1 distributed computing engine (e.g. Hive, Spark, Flink).
• Familiar with at least 1 NoSQL database (e.g. HBase) is a plus.

Responsibilities

• Translate business requirements & end-to-end designs into technical implementations and build batch and real-time data warehouse.
• Manage data modeling design, writing, and optimizing ETL jobs.
• Collaborate with the business team to build data metrics based on data warehouse.
• Responsible for building and maintaining data products.
• Involvement in rollouts, upgrades, implementation, and release of data system changes.
• Develop analytics applications to transform raw data into meaningful information using data-oriented languages and visualization software.
• Apply data mining, data modelling, NLP, and ML to extract and analyze information from large datasets.
• Visualize, interpret, and report data findings; create dynamic data reports.

Job description

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Job highlights

Positive team atmosphere, Career growth opportunity, Flat organization

Responsibilities

Team Introduction

The mission of the Data Platform Singapore Business Partnering (DPSG BP) team is to empower the business with data. Our goal is to build a Data Warehouse that can cater to batch and streaming data, Data Products that provide useful information to build efficient data metrics & dashboards which will be used to make smarter business decisions to support business growth. If you're looking for a challenging ground to push your limits, this is the team for you!

• - Translate business requirements & end to end designs into technical implementations and responsible for building batch and real-time data warehouse
• - Manage data modeling design, writing, and optimizing ETL jobs
• - Collaborate with the business team to building data metrics based on data warehouse
• - Responsible for building and maintaining data products
• - Involvement in rollouts, upgrades, implementation, and release of data system changes as required for streamlining of internal practices
• - Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software.
• - Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets.
• - Visualise, interpret, and report data findings and may create dynamic data reports as well.

Qualifications

Minimum Qualifications:

• - At least 5 years in software engineering and 2 years of relevant experience in data engineering
• - Proficient in creating and maintaining complex ETL pipelines end-to-end while maintaining high reliability and security
• - Familiar with data warehouse concept and have production experience in modeling design
• - Familiar with at least 1 distributed computing engine (e.g. Hive, Spark, Flink)
• - Familiar with at least 1 NoSQL database is a plus (e.g. HBase)

Preferred Qualifications:

• - Excellent interpersonal and communication skills with the ability to engage and manage internal and external stakeholders across all levels of seniority
• - Strong collaboration skills with the ability to build rapport across teams and stakeholders