Senior AI Systems Architect: LLM, Vectors & Orchestration

Starmarkets; Riyadh; On-site; SAR 300,000 - 520,000; Full time

Job summary

Starmarkets seeks a senior AI Systems Architect to design AI-native cores for web and mobile apps, leveraging LLMs, vector databases, and agent frameworks. You will shape scalable AI pipelines, RAG systems, memory architectures, and orchestration workflows that power our product stack.

You will drive production-grade AI engineering, ensure security, and build observable, cost-efficient systems with Docker, Kubernetes, and GPU optimization.

Qualifications

• 5+ years software engineering experience.
• 2+ years building production AI systems.
• Deep knowledge of vector embeddings and similarity search.
• Experience with RAG architectures and tokenization/context window optimization.
• Experience with Python, FastAPI, and backend services; API design.

Responsibilities

• Design AI-first architecture for web and mobile apps.
• Build RAG pipelines using vector databases.
• Integrate with LLMs (OpenAI, Anthropic, LLaMA) and optimize cost/performance.
• Develop autonomous AI agents and orchestration flows (n8n, LangGraph/LangChain).
• Ensure security, monitoring, and guardrails for AI pipelines.

Skills

Software engineering

Production AI systems

RAG architectures

Vector embeddings

Context window optimization

Prompt evaluation frameworks

Distributed systems

Microservices

Tools

Python

FastAPI

PostgreSQL

pgvector

Docker

Kubernetes

GPU optimization

OpenAI APIs

Anthropic

LLaMA

Job description

Starmarkets seeks a senior AI Systems Architect to design AI-native cores for web and mobile apps, leveraging LLMs, vector databases, and agent frameworks. You will shape scalable AI pipelines, RAG systems, memory architectures, and orchestration workflows that power our product stack.

You will drive production-grade AI engineering, ensure security, and build observable, cost-efficient systems with Docker, Kubernetes, and GPU optimization.