AI Software Engineer (m/f/d)

Arrk Asia; Kuala Lumpur; On-site; MYR 90,000 - 150,000; Full time

Job summary

ARRK Engineering in Malaysia seeks a software engineer to develop AI-powered tools for engineers, integrating LLMs and AI APIs into practical applications.

You will build retrieval-based systems, manage code/document processing, and integrate AI into developer ecosystems. Collaboration across international teams, strong Python skills, and an interest in AI innovation are essential.

Qualifications

• 2–5 years of Software Engineer experience.
• Strong Python programming skills and testing practices.
• Experience with Generative AI, LLMs, AI APIs, or AI-assisted development.
• Familiarity with vector databases and semantic search.

Responsibilities

• Design, develop and maintain AI-powered software tools for engineers.
• Integrate LLMs and AI services into practical software solutions.
• Develop context management, embeddings and token optimization for AI models.
• Build retrieval-based solutions with embeddings and vector search.
• Create components to process code and technical docs with parsing and metadata extraction.
• Prototype and evaluate new AI approaches and frameworks.
• Build integrations between AI tools and developer ecosystems.
• Develop backend services and APIs with maintainability and observability.
• Collaborate with engineers to translate requirements into AI-enabled solutions.
• Contribute to documentation and best practices for AI-assisted software development.
• Explore new AI technologies to improve productivity.

Skills

Python

AI/LLMs

API development

Testing & CI/CD

English communication

German language (plus)

Tools

Git

GitHub/GitLab

REST APIs

CI/CD

PostgreSQL/pgvector/OpenSearch

Job description

ARRK Engineering is part of the international ARRK group of companies and specialized in product development. Within the ARRK group of companies we implement product developments from virtual development to prototypes and small series production.

ARRK Engineering is part of the international ARRK group of companies and specializes in product development - from virtual development to prototypes and small-series production. Within our AI initiative, you will become the technical sparring partner who not only builds but also challenges architectural decisions across our growing AI product portfolio.

You will join a highly collaborative, multi-country team where technical proactiveness, outcome-oriented delivery, sound systems architecture, and the willingness to question assumptions are valued. This is a peer level role: we expect you to push back, propose alternatives, and raise the bar.

YOUR TASKS

• Design, develop and maintain AI-powered software tools that support engineers in their daily development workflows, from coding and code analysis to testing, documentation and technical problem solving
• Integrate Large Language Models (LLMs), AI APIs and AI services into practical software solutions, working with both cloud-based and self-hosted models
• Develop and improve mechanisms for providing relevant context to AI models, including codebase analysis, context management, semantic chunking and token optimization
• Build retrieval-based solutions that allow AI applications to efficiently work with large codebases and engineering documentation, using techniques such as embeddings, vector search and hybrid retrieval
• Develop software components for processing and understanding source code and technical documentation, including syntax parsing, metadata extraction and structured representations
• Prototype and evaluate new AI approaches, tools and frameworks, measuring their usefulness, quality, performance and cost
• Build integrations between AI tools and existing developer ecosystems, such as source code repositories, CI/CD pipelines, development environments and internal engineering platforms
• Develop reliable backend services and APIs that support AI-powered applications, with a focus on maintainability, scalability, testing and observability
• Work with engineers and technical stakeholders to understand requirements and turn them into practical AI-enabled solutions
• Contribute to technical discussions, documentation and knowledge sharing within the engineering team, helping to establish good practices for AI-assisted software development
• Continuously explore emerging AI technologies and identify opportunities to improve developer productivity and engineering processes

YOUR PROFILE

• 2–5 years of experience as a Software Engineer, Software Developer or in a comparable technical role
• Strong programming skills in Python and good experience with software development practices such as testing, version control, code reviews and API development
• Practical experience with Generative AI, Large Language Models (LLMs), AI APIs or AI-assisted software development
• Understanding of how LLMs work in practice, including concepts such as tokens, context windows, embeddings, prompting and model limitations
• Experience building applications that integrate LLMs or AI services, for example through APIs such as OpenAI, Azure OpenAI, AWS Bedrock, Google Vertex AI or similar platforms
• Familiarity with vector databases and semantic search, such as PostgreSQL/pgvector, OpenSearch, Elasticsearch, Qdrant, Weaviate or similar technologies
• Understanding of RAG (Retrieval-Augmented Generation) and experience building or integrating retrieval pipelines is an advantage
• Experience working with software development tools and ecosystems such as Git, GitHub/GitLab, CI/CD and REST APIs
• Familiarity with cloud platforms such as AWS, Azure or Google Cloud, particularly their managed AI services, is an advantage
• Interest in code analysis and developer tooling; experience with technologies such as ASTs, Tree-sitter, code indexing or static analysis is a plus
• Understanding of AI optimization techniques such as prompt optimization, context management, token reduction, model selection and caching is a plus
• Experience with AI evaluation, fine-tuning, LoRA, AI agents or self-hosted models such as Ollama or vLLM is a plus
• Strong analytical and problem-solving skills, with the ability to turn technical challenges into practical software solutions
• Comfortable working in a collaborative, international and customer-facing environment
• Excellent communication skills in English; German is a plus
• Passionate about software engineering, AI technologies and continuously improving how engineers build software

CONTACT

[e-mail]

+ 49 (0)89 / 31857-0

Privacy Policy

For reasons of simplification, only the masculine form is used in this job advertisement. However, persons of any gender and any orientation are always meant equally. Our job offer is equally directed at severely disabled persons and persons of equal status.