Applied LLM Engineer

Ninja Management Limited; Hong Kong; Remote; HKD 900,000 - 1,500,000; Full time

Benefits offered by this job

Equity 2%

Job summary

Ninja Management Limited's Buddy.ninja is seeking an Applied LLM Engineer to join our founding team. This ground‑floor opportunity lets you shape data strategy, analytics frameworks, and the product roadmap while influencing company culture.

You will design and deploy a production-grade LLM chatbot on AWS Bedrock, build a RAG pipeline, integrate contextual insights in the app, and optimize prompts, guardrails, and costs for health-tech use cases in the APAC market.

Qualifications

• Proven experience building production LLM applications.
• Strong understanding of RAG architecture.
• Proficiency with AWS Bedrock.
• Familiarity with health-tech AI and regulated domains.

Responsibilities

• Production Deployment: Design and implement a production-ready LLM chatbot using AWS Bedrock.
• Pipeline Development: Develop a RAG pipeline to query data.
• App Integration: Build an API layer and contextual insights in the app.
• Engineering Safety: Design structured prompting with guardrails and escalation logic.
• Optimization: Reduce token usage and LLM costs.
• Reporting: Implement structured report generation for veterinary use.
• Strategy: Collaborate on data strategy and the product roadmap.

Skills

LLM engineering

RAG architecture

AWS Bedrock

Prompt design

Cost optimization

Job description

Buddy.ninja is seeking a passionate and skilled Applied LLM Engineer to join our founding team. This is a ground-floor opportunity to shape our data strategy, analytical frameworks, and company culture. As an early team member, you'll have significant input into key decisions and the chance to grow with the company.

Key Responsibilities

Production Deployment: Design and implement a production-ready LLM chatbot using AWS Bedrock.

Pipeline Development: Develop a RAG pipeline to query pet biometric and behavioral data.

App Integration: Implement contextual insights within the app interface and build an API layer for secure metric queries.

Engineering Safety: Design structured prompting frameworks for health-safe responses, including guardrails, uncertainty handling, and escalation logic.

Optimization: Optimize token usage and LLM cost efficiency.

Reporting: Implement structured report generation for veterinary use.

Strategy: Collaborate with the founding team on data strategy and the product roadmap.

Qualifications

Proven experience building production LLM applications and a strong understanding of RAG architecture.

Proficiency with AWS, specifically Bedrock.

Expertise in token optimization, inference cost modeling, and designing prompt systems with guardrails.

Preferred: Familiarity with health-tech AI, regulated AI domains, and integrating AI into mobile or web platforms.

Equity: 2%, commensurate with experience and role scope.

Flexibility: Remote position with the option to work as a side commitment or part-time until formal employment is established.

Impact: Direct input into company direction and the opportunity to build products that make a real difference for pet owners in the APAC market.

Culture & Work Arrangements

We value innovation, work-life balance, and a genuine passion for animal welfare.

Meetings: Weekly online meetings during weekday evenings.

Events: Occasional in-person weekend events and business trips.

Initiatives: Opportunities to participate in animal welfare initiatives and regular feedback sessions to shape our future.