Senior AI/ML Engineer - LLM & CV/OCR Platform Lead

Dr. Kudos Lab Limited; Hong Kong; On-site; HKD 900,000 - 1,500,000; Full time

Job summary

Dr. Kudos Lab Limited in Hong Kong is building a foundational AI platform centered around locally or cloud-hosted LLMs and CV/OCR models.

The Senior AI/ML Engineer will own the full lifecycle from evaluation to deployment, integrating with MLOps and Backend teams to deliver production-ready AI foundations. The role is deeply technical, hands-on, and requires autonomy, strong coding depth, and cross-functional collaboration.

Qualifications

• Strong proficiency in Python and PyTorch.
• Hands-on experience with HuggingFace Transformers, PEFT, TRL, and related tooling.
• Practical experience fine-tuning LLMs (7B–70B parameters).
• Experience using Unsloth for efficient LLM fine-tuning and experimentation.
• Solid understanding of NLP fundamentals: tokenization, embeddings, attention mechanisms, model alignment.
• Experience with training optimization frameworks (DeepSpeed, Accelerate, FSDP).
• Familiarity with inference frameworks (vLLM, TGI, TensorRT-LLM).
• Experience with vector databases (FAISS, Milvus, Pinecone).
• Experience with CV/OCR frameworks (OpenCV, YOLO, PaddleOCR, Azure Vision, Google Vision).
• Strong engineering fundamentals: clean code, reproducibility, experiment tracking.
• Strong analytical and problem-solving ability.
• Ability to work independently and take ownership of complex tasks.
• Clear communication skills and the ability to explain technical concepts to non-technical stakeholders.
• Curiosity and passion for staying at the forefront of LLM and CV research.
• Comfortable working in a fast-moving, evolving technical environment.
• Proficiency in English is required. Cantonese or Mandarin is an advantage.

Responsibilities

• Evaluate open-source LLMs (Llama, Mistral, Qwen, DeepSeek) and recommend suitable architectures.
• Perform supervised fine-tuning (SFT), LoRA/QLoRA, and parameter-efficient training.
• Use Unsloth to accelerate and optimize LLM fine-tuning (QLoRA, 4-bit training).
• Build and maintain training pipelines with dataset prep, cleaning, augmentation and synthetic data.
• Develop evaluation frameworks to measure accuracy, hallucination rate, safety and performance.
• Optimize inference through quantization, batching, GPU memory tuning and model compression.
• Collaborate with MLOps to deploy models on local GPU servers or cloud.
• Implement embedding pipelines and retrieval-augmented generation components.
• Work with vector databases such as FAISS, Milvus, or Pinecone.
• Support document ingestion, chunking, indexing and retrieval workflows.
• Build LLM workflows using LangChain, LangGraph or similar frameworks.
• Design prompt templates, chains and multi-step reasoning flows.
• Develop and integrate CV/OCR models with production APIs and platforms.
• Partner with MLOps to ensure reproducibility, reliability and scalability.
• Stay up to date with the latest research and apply relevant advancements.

Skills

Python & PyTorch

Transformers

PEFT / TRL

LLM fine-tuning

Unsloth

NLP fundamentals

DeepSpeed / Accelerate

Inference frameworks

Vector databases

CV/OCR frameworks

English proficiency

Communication skills

Tools

OpenCV

YOLO

PaddleOCR

Azure Vision

Google Vision

Job description

Dr. Kudos Lab Limited in Hong Kong is building a foundational AI platform centered around locally or cloud-hosted LLMs and CV/OCR models.

The Senior AI/ML Engineer will own the full lifecycle from evaluation to deployment, integrating with MLOps and Backend teams to deliver production-ready AI foundations. The role is deeply technical, hands-on, and requires autonomy, strong coding depth, and cross-functional collaboration.