AI Engineer - LLM & Production Chatbot Systems

Pantheon Lab Limited; Hong Kong; On-site; HKD 900,000 - 1,300,000; Full time

Job summary

Pantheon Lab Limited in Hong Kong is seeking an experienced AI Engineer to design, deploy, and optimize production-grade language model systems. You will build applications using both commercial LLM APIs and self-hosted open-source models, implement RAG pipelines, and create end-to-end LLM workflows.

The role blends practical API integration with expert deployment of local models to deliver scalable AI solutions.

Qualifications

• Solid 2+ years focused on LLM applications or chatbot development.
• Proven track record of building production LLM applications.
• Experience integrating and optimizing commercial LLM APIs.
• Hands-on experience deploying local models in production environments.

Responsibilities

• Design and implement high-throughput, low-latency serving architectures for LLM applications
• Build and maintain RAG pipelines and end-to-end LLM workflows
• Integrate and optimize commercial LLM APIs into production systems
• Develop prompt engineering techniques and prompt management systems
• Deploy and serve local open-source language models for specific use cases
• Optimize local model inference performance through efficient serving frameworks
• Fine-tune models to improve performance on domain-specific tasks
• Monitor and troubleshoot production LLM systems to ensure reliability
• Research and experiment with emerging models and techniques to improve system capabilities
• Document architectures, best practices, and technical decisions
• Collaborate with engineering teams to integrate LLM capabilities into products
• Communicate technical terms and recommendations to stakeholders
• Build evaluation frameworks to measure model quality, latency, cost, and user satisfaction
• Design intelligent routing and fallback strategies across multiple LLM providers
• Scale LLM services to handle production workloads efficiently
• Implement caching, batching, and request optimization strategies for both APIs and local models

Skills

Python programming

Async/await

Transformer basics

LLM APIs integration

Local model deployment

Docker

FastAPI

Vector databases

MongoDB

Git/GitHub

Hugging Face

Cloud platforms

Kubernetes

LLM fine-tuning

LangChain/LlamaIndex

Tools

LlamaIndex

LangChain

vLLM

MLflow

Phoenix

Langfuse

Weaviate

Chroma

Milvus

Pinecone

TGI

Hugging Face

Job description

Pantheon Lab Limited in Hong Kong is seeking an experienced AI Engineer to design, deploy, and optimize production-grade language model systems. You will build applications using both commercial LLM APIs and self-hosted open-source models, implement RAG pipelines, and create end-to-end LLM workflows.

The role blends practical API integration with expert deployment of local models to deliver scalable AI solutions.