Lead Data Platform Manager – Scalable Pipelines

TikTok USDS Joint Venture; San Jose (CA); On-site; USD 209,000 - 438,000; Full time

Job summary

TikTok USDS Joint Venture LLC is seeking an experienced data tech lead manager for the Video Platform Data team. You will lead engineers, analysts, and SREs to build scalable realtime and batch data pipelines across the data lakehouse ecosystem.

Responsibilities include guiding architecture standards, optimizing performance and cost, and ensuring data governance and security. The role emphasizes cross-functional collaboration and data-driven decision making in a fast-paced environment.

Qualifications

• Bachelor's degree or equivalent in a technical field.
• 5+ years building and scaling enterprise data platforms; 3+ years in leadership.
• Hands-on with large-scale data systems and distributed storage.
• Strong SQL and Python for data processing and analytics.
• Experience with Airflow or Luigi and modern data architectures.

Responsibilities

• Lead and manage data engineers, analysts, and data SREs.
• Oversee cross-functional project delivery across the lifecycle.
• Design scalable realtime and batch data pipelines.
• Optimize data processing for performance and cost efficiency.
• Define data architecture standards and data quality frameworks.
• Own end-to-end delivery from design to deployment and optimization.
• Provide data services to product teams and video SRE groups.
• Define metrics to measure performance and guide decisions.
• Ensure data governance, privacy, and security compliance.

Skills

Data leadership

SQL & Python

Large-scale data pipelines

Data architectures

Cross-functional collaboration

Education

Bachelor's degree in Computer Science/Engineering or related

Tools

Hadoop

HDFS

YARN

Spark

Flink

Hive

ClickHouse

Job description

TikTok USDS Joint Venture LLC is seeking an experienced data tech lead manager for the Video Platform Data team. You will lead engineers, analysts, and SREs to build scalable realtime and batch data pipelines across the data lakehouse ecosystem.

Responsibilities include guiding architecture standards, optimizing performance and cost, and ensuring data governance and security. The role emphasizes cross-functional collaboration and data-driven decision making in a fast-paced environment.