Senior Data Platform Reliability Engineer

TikTok USDS Joint Venture; Sydney; On-site; AUD 120,000 - 170,000; Full time

Job summary

TikTok USDS Joint Venture LLC is seeking a Site Reliability Engineer to improve reliability of the video data platform. You will manage data pipelines, monitor performance, and build tools to automate operations across a large-scale distributed system.

Join a team focused on scalable data processing, real-time and batch workflows, and cross-functional collaboration across data engineering and platform teams. On-site work is emphasized as the team moves toward full in-person operations.

Qualifications

• Bachelor's in Computer Science or a related technical background involving software/system engineering, or equivalent working experience
• Good programming experience with SQL and at least one of the following languages: Java, Python, Go, or Scala
• Experience in data engineering, with a focus on data systems reliability, scalability, performance and capacity management
• Solid experience with big data technologies (e.g., Hadoop, Spark, Flink, YARN) and databases (SQL, NoSQL)
• Knowledge of data pipeline and workflow management tools (e.g., Airflow, Luigi)
• Experience in building data solutions with AWS, Google, Azure and other cloud services is a plus

Responsibilities

• Manage day-to-day operations of data service, realtime/batch data pipelines, such as Service Level Agreement management, pipeline deployment, performance tuning and troubleshooting
• Proactively monitor and troubleshoot data pipelines and systems for performance issues, errors, or anomalies
• Create tools, build alarms and dashboards, drive internal process improvements, and automation to monitor and improve data engineering operations
• Improve systems reliability, efficiency, and velocity through scaling, optimization of both resources and data processing workflows, potentially refactoring code or implementing new solutions
• Develop and deploy new reliable and scalable data pipelines and infrastructure components as required by business needs
• Work closely with data engineering and various vertical teams within the Video Architecture platform

Skills

SQL

Java

Python

Go

Scala

Education

Bachelor's degree in Computer Science

Tools

Hadoop

Spark

Flink

YARN

Airflow

Luigi

Job description

TikTok USDS Joint Venture LLC is seeking a Site Reliability Engineer to improve reliability of the video data platform. You will manage data pipelines, monitor performance, and build tools to automate operations across a large-scale distributed system.

Join a team focused on scalable data processing, real-time and batch workflows, and cross-functional collaboration across data engineering and platform teams. On-site work is emphasized as the team moves toward full in-person operations.