LLM Engineer

Vyro; Batu Pahat; On-site; MYR 325,000 - 408,000; Full time

Job summary

A leading generative AI company is seeking an LLM Engineer for a full-time, on-site position in Islamabad. The role involves designing and developing large language models with a focus on advanced machine learning techniques. Candidates should have over 4 years of experience in Machine Learning or NLP, along with a Bachelor's degree in a related field. You'll be part of an innovative team working on cutting-edge AI products that transform user interaction and creativity.

Benefits

Competitive salary and benefits package

Growth-driven culture

Innovative AI products to work on

Qualifications

• 4+ years of industry experience in Machine Learning or NLP.
• Deep experience leveraging closed-source SOTA models.
• Expert grasp of transformer variants and Mixture-of-Experts architectures.

Responsibilities

• Designing, developing, and fine-tuning LLMs.
• Building agentic AI workloads and implementing data-driven algorithms.
• Collaborating with teams to integrate machine learning capabilities.

Skills

Machine Learning

Natural Language Processing (NLP)

Multi-agent orchestration

Data-driven algorithms

High-throughput model deployment

Education

Bachelor’s degree in Computer Science or a related field

Tools

TensorRT-LLM

vLLM

Semantic caching

GraphRAG

Job description

Company Description

Vyro is at the forefront of innovation, transforming content creation through advanced AI and Machine Learning technologies. As a rapidly growing Gen-AI and SaaS-focused company, we empower creativity across industries with state-of-the-art tools. Our flagship products include ImagineArt, an AI-powered design studio that turns text into stunning visuals, and Chatly, an intelligent multi-modal assistant leveraging frontier AI models for seamless task management and idea generation.

With 15+ products, over 2.5 billion images processed, and 800,000+ daily active users, Vyro is actively shaping the future of creative tools. Join our passionate team of Vyronauts to make an impact and innovate with us!

Role Description

This is a full-time, on-site role for an LLM Engineer based in Islamabad. The role involves designing, developing, and fine‑tuning LLMs, building agentic AI workloads, implementing data‑driven algorithms, and deploying scalable solutions. You will collaborate closely with cross‑functional teams to integrate cutting‑edge machine learning capabilities into Vyro’s products, while exploring new methods to enhance performance, reliability, and efficiency.

Qualifications

Experience & Education

• 4+ years of industry experience in Machine Learning or NLP
• Bachelor’s degree in Computer Science (BSCS) or a related field

Frontier Model Orchestration

• Deep experience leveraging closed‑source SOTA models from OpenAI, Anthropic, Google, and xAI
• Strong understanding of complex reasoning, tool‑use, and multi‑step AI pipelines

Advanced Architectures

• Expert grasp of transformer variants and Mixture‑of‑Experts (MoE) architectures
• Proven hands‑on experience with open‑weight SOTA models such as Llama 3.x, Mistral Large, Qwen 2.5, Phi‑4, etc.

Agentic Frameworks

• Mastery of multi‑agent orchestration using frameworks like LangGraph (stateful agents), AutoGen, or CrewAI
• Experience implementing DSPy for declarative, self‑optimizing prompt pipelines

Production RAG & Memory Systems

• Implementation experience with GraphRAG and hybrid retrieval strategies
• Expertise with vector stores (Qdrant, Milvus, Weaviate) and semantic caching for long‑term agent memory

Inference Optimization

• Experience deploying high‑throughput models using vLLM, TensorRT‑LLM, or SGLang
• Familiarity with FlashAttention‑2, KV caching, and quantization techniques (AWQ, EXL2)

Why Join Us?

• Work on innovative AI products like Chatly and ImagineArt that are shaping the future of user interaction and creativity
• Collaborate with a passionate, talented team that values experimentation, innovation, and data‑driven decision‑making
• Competitive salary and benefits package
• A growth‑driven culture that encourages learning, ownership, and continuous improvement

Note

This is an onsite position at our office in H12, Islamabad, for residents of Pakistan. Candidates residing outside of Pakistan may be considered for remote work opportunities.