Senior Data Platform Engineer - AI-Driven Spark & OLAP

TikTok USDS Joint Venture; San Jose (CA); On-site; USD 187,000 - 438,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Paid parental leave

Disability coverage

Life insurance

Wellbeing benefits

Paid holidays

Paid sick days

Paid personal time

Restricted stock units

Job summary

TikTok USDS Joint Venture LLC is seeking a Senior Engineer to lead efficiency, stability, and AI-driven innovation for data infrastructure. You will optimize engines like Spark, Kafka, ClickHouse, and Doris at petabyte scale while pioneering AI-powered solutions that reduce costs and boost platform intelligence.

You will design and implement automated diagnosis, self-healing pipelines, and intelligent monitoring, while mentoring engineers and driving a forward-looking technical roadmap at the

Qualifications

• BS/MS in Computer Science or Engineering or related field.
• 3+ years building and maintaining large-scale distributed systems.
• In-depth knowledge of Apache Spark, ClickHouse or Doris.

Responsibilities

• Optimize Spark performance at petabyte scale.
• Enhance ClickHouse and Doris OLAP with storage-compute separation and query optimizations.
• Implement AI-driven resource allocation and cost optimization strategies.
• Develop automated job diagnosis and failure analysis systems using AI/ML.
• Build intelligent monitoring and self-healing capabilities for data pipelines.
• Create AI-powered tools for query optimization and data discovery.
• Design robust disaster recovery and data integrity mechanisms.
• Integrate AI/ML capabilities to enhance platform efficiency and developer productivity.
• Drive technical roadmap and mentor junior engineers.
• Explore new technologies at the intersection of distributed systems and AI.

Skills

Distributed systems

Spark performance

AI/ML systems

Education

BS/MS in CS or Engineering

Tools

Kafka

Flink

Kubernetes

ClickHouse

Doris

Job description

TikTok USDS Joint Venture LLC is seeking a Senior Engineer to lead efficiency, stability, and AI-driven innovation for data infrastructure. You will optimize engines like Spark, Kafka, ClickHouse, and Doris at petabyte scale while pioneering AI-powered solutions that reduce costs and boost platform intelligence.

You will design and implement automated diagnosis, self-healing pipelines, and intelligent monitoring, while mentoring engineers and driving a forward-looking technical roadmap at the