Senior AI Architect & Production ML Engineer

ARRK Engineering GmbH; Kuala Lumpur; On-site; MYR 240,000 - 360,000; Full time

Job summary

ARRK Engineering GmbH in Kuala Lumpur invites experienced backend engineers to join our AI initiative. You will act as a technical sparring partner, shaping architecture, designing, coding, and deploying a suite of intelligent AI tools across our growing product portfolio.

This peer-level role emphasizes technical proactiveness, measurable retrieval quality, and secure multi-tenant architectures, with open-source LLMs, embeddings, and hybrid retrieval as core focus areas.

Qualifications

• 5+ years in software engineering with substantial AI/ML product delivery.
• Strong grasp of transformers, tokens, embeddings, and context window limits.

Responsibilities

• Act as a primary technical counterpart and architecture partner - designing, coding, and deploying a suite of custom, intelligent AI tools, and critically reviewing design decisions.
• Enhance our system's ability to manage context windows, optimize token usage, and reduce attention noise when connecting LLMs to large codebase repositories.
• Design and extend graph based code and document representations (property graphs, AST derived structures) and hybrid retrieval pipelines (dense + sparse + reranking/fusion) over vector databases.
• Translate complex algorithmic ideas - syntax parsing, semantic chunking, custom routing - into reliable, production ready software components.
• Build and rigorously evaluate prototypes for future AI initiatives, including open source small language models (SLMs), custom embeddings, and multi agent / cross validation patterns, backed by measurable retrieval and quality metrics.
• Architect multi tenant data, identity, and authorization layers that meet enterprise security and compliance requirements.
• Ensure our AI applications integrate securely into existing codebase ecosystems and developer toolchains, with both self hosted and cloud managed model serving in mind

Skills

AI/ML backend

Python

System design

Transformer basics

English comms

Tools

Tree-sitter

NetworkX

Vector databases

vLLM

Ollama

Job description

ARRK Engineering GmbH in Kuala Lumpur invites experienced backend engineers to join our AI initiative. You will act as a technical sparring partner, shaping architecture, designing, coding, and deploying a suite of intelligent AI tools across our growing product portfolio.

This peer-level role emphasizes technical proactiveness, measurable retrieval quality, and secure multi-tenant architectures, with open-source LLMs, embeddings, and hybrid retrieval as core focus areas.