AI Harness Engineer — Self-Hosted LLMs & Tooling

Horizontal Talent; Kuala Lumpur; On-site; MYR 180,000 - 260,000; Full time

Job summary

Horizontal Talent is seeking a senior AI/ML engineering professional to lead and advance our AI development workflows in a fast-paced environment. You will monitor frontier models, evaluate vendors, and shape practical AI strategies with a focus on security, governance, and efficiency.

Responsibilities include building internal evaluation benchmarks, defining robust prompt and context engineering standards, and implementing scalable tooling to empower engineering teams across the organization.

Qualifications

• Extensive hands-on experience with agentic coding tools such as Claude Code, Codex, Cursor.
• Strong understanding of prompt engineering, context engineering, and model evaluation methodologies.

Responsibilities

• Continuously monitor and evaluate leading AI vendors, frontier models, and emerging AI technologies, assessing their capabilities, cost, context handling, and agentic performance.
• Develop and implement a vendor diversification and resilience strategy by evaluating alternative AI vendors, model routing solutions, and self-hosted LLM options.
• Build and maintain internal AI evaluation benchmarks based on real-world codebases and business scenarios to objectively measure and compare model performance.
• Take ownership of and continuously improve company-wide AI development workflows and best practices, including prompt and context engineering standards, agent configurations, code review and validation processes, and safety guardrails.
• Define and enforce AI security and compliance standards to prevent source code and sensitive data leakage, mitigate prompt injection risks, establish security review requirements for AI-generated code, and implement appropriate data masking and access controls.
• Build and maintain internal AI harnesses and developer tooling, including shared configurations, skills and plugins, evaluation scripts, and CI integrations, enabling engineering teams to adopt AI tools efficiently.
• Document AI development best practices, conduct technical training and knowledge-sharing sessions, and track AI adoption and developer productivity metrics across engineering teams.

Skills

Prompt engineering

Model evaluation

Cross-functional collaboration

Tools

Claude Code

Codex

Cursor

Job description

Horizontal Talent is seeking a senior AI/ML engineering professional to lead and advance our AI development workflows in a fast-paced environment. You will monitor frontier models, evaluate vendors, and shape practical AI strategies with a focus on security, governance, and efficiency.

Responsibilities include building internal evaluation benchmarks, defining robust prompt and context engineering standards, and implementing scalable tooling to empower engineering teams across the organization.