Data Platform Engineer: AI-Driven Spark & OLAP

TikTok USDS Joint Venture

San Jose (CA)

On-site

USD 137,000 - 360,000

Full time

2 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

TikTok USDS Joint Venture invites a Software Engineer to join the Platform Team, focusing on efficiency, stability, and AI-driven innovation for the data platform. You will optimize Spark, ClickHouse, and Doris, while contributing to AI-powered features and cost optimization at petabyte scale.

You will collaborate with senior engineers, review code, and document designs as you help build scalable, self-healing data pipelines in a fast-paced security-focused environment.

Qualifications

BS or MS in Computer Science, Engineering, or a related technical field.
1+ years of hands-on experience building or maintaining distributed systems.
Proficiency in Java, Scala, C++, or Python.

Responsibilities

Assist in optimizing Apache Spark performance and resource utilization for large-scale data processing.
Enhance ClickHouse and Doris OLAP systems through query tuning and storage-compute optimization.
Contribute to automated job diagnosis and failure analysis systems using AI/ML techniques.
Build and maintain monitoring and self-healing capabilities for data pipelines.
Develop features for intelligent tools.
Collaborate with senior engineers to deliver high-quality, maintainable code and system designs.
Engage in code reviews and write technical documentation.

Skills

Java

Scala

C++

Python

Education

BS/MS in Computer Science or related

Tools

Apache Spark

ClickHouse

Doris

Job description

You will collaborate with senior engineers, review code, and document designs as you help build scalable, self-healing data pipelines in a fast-paced security-focused environment.

Get your free, confidential resume review.

or drag and drop your file here.