LLM Expert

Crescendo Staffing and Business Consulting Inc.; Quezon City; On-site; PHP 600,000 - 1,200,000; Full time

Benefits offered by this job

Equity Incentive Plan

Commission

Performance Bonus

13th Month Pay

Employee Loan

Pag-Ibig Fund

Paid Holidays

Job Training

Job summary

A staffing and consulting firm is seeking an LLM Expert to handle the application, support, and optimization of Large Language Model solutions. This role involves designing prompts, evaluating outputs, and ensuring compliance with company AI policies. Candidates should have a Master's degree and 1-5 years of experience with AI tools. Strong analytical skills and the ability to explain technical concepts to non-technical users are essential. This is a full-time, on-site position in Quezon City.

Qualifications

• 1-5 years of relevant industry experience in working with LLMs or AI tools.
• Hands-on experience using platforms such as OpenAI, Azure OpenAI, Anthropic, Google, or similar LLM providers.
• Experience with prompt engineering or AI-assisted workflows.
• Experience with prompt engineering or AI-assisted workflows.
• Strong understanding of LLM limitations, token usage, and cost awareness.
• Familiarity with APIs and JSON / structured outputs.

Responsibilities

• Design, test, and refine prompts for accuracy, consistency, and safety.
• Monitor LLM outputs for quality, bias, and hallucinations.
• Conduct manual and automated evaluations of LLM responses.
• Ensure outputs comply with company AI use policies, data privacy and responsible AI standards.

Skills

Analytical and detail-oriented

Ability to explain AI outputs to non-technical users

Strong judgment and accountability

JSON outputs

Education

Master's Degree and above

Tools

Prompt management tools

Basic scripting or automation tools

Anthropic

Google Cloud AI

Job description

Crescendo Staffing and Business Consulting Inc.

On-site - Quezon City 1-3 Yrs Exp Master Full-time

Job Description

Employee Recognition and Rewards

Equity Incentive Plan, Commission, Performance Bonus

Government Mandated Benefits

13th Month Pay, Employee Loan, Pag-Ibig Fund, Paid Holidays

Professional Development

Job Training

Job Title: LLM Expert

Department: AI / Technology / Operations

Reports To: AI Lead / ML Manager / Product Manager

Employment Type: Full-time

Job Summary

The LLM Expert is responsible for the day-to-day application, support, and optimization of Large Language Model (LLM) solutions. This role focuses on prompt design, evaluation, troubleshooting, and safe deployment of LLM‑powered workflows to support business operations, customer interactions, and internal tools.

Tier 1 LLM Experts handle standard use cases, initial triage, and operational improvements, escalating complex model or system issues to higher‑tier experts.

Key Responsibilities

• Design, test, and refine prompts for accuracy, consistency, and safety.
• Apply LLMs to use cases such as:
• Content drafting and summarization
• Data extraction and classification
• Maintain prompt libraries and usage guidelines.

B. LLM Operations & Support

• Monitor LLM outputs for quality, bias, and hallucinations.
• Perform first-level troubleshooting for LLM‑related issues.
• Identify failure patterns and elevate to Tier 2 / Engineering.
• Support rollout of LLM features and workflows.

C. Evaluation & Quality Control

• Conduct manual and automated evaluations of LLM responses.
• Compare outputs against defined success criteria.
• Document issues, improvements, and performance trends.

D. Safety, Policy & Compliance

• Ensure outputs comply with:
• Company AI use policies
• Data privacy and confidentiality requirements
• Responsible AI standards
• Flag potential safety, ethical, or compliance risks.
• Work with product, engineering, and operations teams.
• Translate business requirements into LLM‑ready instructions.
• Create user guides, prompt documentation, and FAQs.

Qualifications

Education

• Master's Degree and above.
• Equivalent experience may be considered.

Experience

• 1–5 years of relevant industry experience in working with LLMs or AI tools.
• Hands‑on experience using platforms such as OpenAI, Azure OpenAI, Anthropic, Google, or similar LLM providers.
• Experience with prompt engineering or AI‑assisted workflows.

Technical Skills

• Strong understanding of:
• LLM limitations (hallucinations, bias, context windows)
• Token usage and cost awareness
• Familiarity with:
• APIs (basic level)
• JSON / structured outputs

Soft Skills

• Analytical and detail‑oriented
• Ability to explain AI outputs to non‑technical users
• Strong judgment and accountability

Tools & Technologies

• Prompt management tools
• Internal knowledge bases and datasets
• Basic scripting or automation tools (optional)

Working Location

Work location and conditions to be discussed during interview.