Automation Specialist, AI Data Service Operations

TikTok; Singapore; On-site; SGD 90,000 - 120,000; Full time

Job summary

TikTok is seeking an Automation Specialist for AI Data Service Operations in Singapore. You will design and deploy advanced prompting strategies, integrate AI tools, and diagnose model outputs with a data-driven mindset.

The role requires a Bachelor’s degree and experience with LLMs, prompt engineering, and AI data operations. You will work in a fast-paced environment, iterating on prompt strategies, and collaborating across teams to improve diagnostics and tooling.

Qualifications

• Bachelor’s degree or above in a STEM, linguistics, philosophy, or related field.
• Experience with LLMs, Prompt Engineering, AI Data Operations or related areas.
• Strong data analysis, logical thinking, and ability to follow standardized workflows.
• Ability to switch between project contexts with high attention to logic and quality.

Responsibilities

• Design and deploy prompting strategies, including CoT, Meta-Prompting, and Least-to-Most prompting.
• Maintain automated data tools like Auto-RCA and Prompt Agents for quick root-cause analysis.
• Investigate model hallucinations and classification errors to identify causes.
• Conduct rapid A/B testing across prompt variants and optimize approaches.
• Provide feedback to internal tools and prompts to keep diagnostics up to date.

Skills

Data Analysis

Logical Thinking

Structured Thinking

Operational Agility

Attention to Detail

Education

Bachelor’s degree or above

Tools

Python

SQL

Job description

Automation Specialist, AI Data Service Operations

Location:

Employment Type:

Regular

Job Code:

A137094A

Share this listing:

Responsibilities

• Prompt Engineering: Design and deploy advanced prompting strategies, including Chain-of-Thought (CoT), Meta-Prompting, and Least-to-Most Prompting, to precisely guide model behavior.
• AI Tool Integration: Maintain and leverage automated Root Cause Analysis (Auto-RCA) tools and automated Prompt Agents to quickly identify the causes of model failures and generate potential solutions within minutes.
• Logic Diagnosis: Conduct deep-dive analysis into model hallucinations and classification errors. You will identify whether failures are caused by tokenization issues, logical gaps, or variance driven by temperature settings.
• High-Frequency Experimentation: Conduct rapid A/B testing across prompt variants. You should be able to quickly adjust your approach based on performance data, decisively move away from overly complex or ineffective solutions, and prioritize strategies that are robust and efficient.
• Tool Maintenance: Provide feedback and prompt updates for internal Agent tools, such as Auto-RCA, to ensure the team’s diagnostic toolchain remains at the forefront of industry practices.

Qualifications

• Education: Bachelor’s degree or above. Candidates with backgrounds in STEM, Linguistics, Philosophy, or related disciplines are preferred.
• Relevant Experience: Work or internship experience related to Large Language Models (LLMs), such as Prompt Engineering, AI Data Operations, AI Product Operations, or related areas.
• Data Analysis & Logical Thinking: Strong analytical skills with the ability to identify patterns in data and clearly define problems. Demonstrates structured thinking, attention to detail, and the ability to follow standardized workflows.
• Operational Agility: Ability to quickly switch between different project contexts within a dynamic workflow queue while maintaining a high level of attention to logic and quality.

Preferred Qualifications

• Domain Experience: Experience in Trust & Safety, content moderation, content review, or classification and annotation.
• Technical Understanding: Familiarity with fundamental NLP and LLM concepts, such as Attention mechanisms, context windows, and tokenization, with a good understanding of model capabilities and limitations.
• Technical Skills: Basic proficiency in Python or SQL, with the ability to write simple scripts for prompt testing or supporting data analysis.

Job Information

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Ready for a career

at TikTok?

Discover a career that energizes and excites you every day.