Senior Data Platform Engineer - AI-Driven, Spark & OLAP

TikTok USDS Joint Venture

San Jose (CA)

On-site

USD 187,000 - 438,000

Full time

48 hours ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

TikTok USDS Joint Venture in San Jose, CA is seeking a Senior Engineer to lead efficiency, stability, and AI-driven innovation of its data platform. You will optimize Spark, ClickHouse, and Doris workloads at petabyte scale, driving cost savings and performance.

The role includes building AI-powered automation for data pipelines, mentoring engineers, and shaping the technical roadmap while staying aligned with security and reliability priorities for our U.S. data ecosystem.

Qualifications

BS/MS in Computer Science, Engineering, or a related technical field.
3+ years of experience building and maintaining large-scale distributed systems.
In-depth knowledge of Apache Spark, ClickHouse or Doris.

Responsibilities

Optimize Apache Spark performance and resource utilization at petabyte scale.
Enhance ClickHouse and Doris OLAP systems with storage-compute separation and query optimizations.
Implement AI-driven resource allocation and cost optimization strategies.
Develop automated job diagnosis and failure analysis systems using AI/ML techniques.
Build intelligent monitoring and self-healing capabilities for data pipelines.
Create AI-powered tools for query optimization and data discovery.
Design robust disaster recovery and data integrity mechanisms.
Integrate AI/ML capabilities to enhance platform efficiency and developer productivity.
Drive technical roadmap and mentor junior engineers.
Explore new technologies at the intersection of distributed systems and AI.