AI Software Architect

Client of Discovered MENA; Dubai; On-site; AED 350,000 - 600,000; Full time

Job summary

Client of Discovered MENA seeks an experienced Senior AI Software Architect to own end-to-end software and AI architecture. You will balance hands-on development with strategic technical leadership, shaping secure, scalable cloud-native applications, LLM integrations, and RAG pipelines.

Expect extensive work on AWS, Kubernetes (EKS), and multi-tenant SaaS deployments, with a strong emphasis on security, observability, and DevOps/MLOps practices in a fast-moving startup setting.

Qualifications

• Minimum 5–7 years of experience in software architecture and hands-on engineering.
• Strong hands-on development in Python with AI integrations.
• Proven commercial experience with LLMs, RAG, AI agents, or agentic AI.
• Experience building SaaS products sold to customers.
• Deep AWS and Kubernetes knowledge with EKS experience.
• Competent in DevOps and MLOps, IaC, CI/CD, and cloud-native tooling.
• Solid understanding of zero-trust security, data encryption and residency.

Responsibilities

• Take complete ownership of software, AI and platform architecture from design to production.
• Hands-on coding ~50% time building and integrating AI solutions using Python, LLMs, RAG, agents.
• Design and manage multi-tenant microservices on AWS and EKS Kubernetes clusters.
• Build and integrate production-grade LLM apps including RAG pipelines and agents.
• Embed zero-trust security and privacy-by-design across platforms.
• Develop pipelines, tests, IaC, observability, and full-stack deployment practices.
• Collaborate with DevOps/MLOps tooling and production operations for scale.

Skills

Python

LLMs

RAG

AI agents

Kubernetes

AWS

EKS

DevOps

MLOps

Security

Tools

Terraform

CI/CD

Amazon EKS

Job description

Discover the Opportunity

We are seeking a AI Software Architect to join a unique tech venture The company focuses on cutting edge applications centered around security data privacy and AI This role offers exceptional long term stability alongside the fast paced innovation of an agile startup environment You will work alongside a lean tech team reporting directly to the Tech Product Manager while taking ownership of core software architecture AI architecture and hands on development.

Discover the Role

As a Senior AI Software Architect you will balance technical strategy with active development in a roughly equal split You will take end to end architectural ownership of user centric applications AI solutions and cloud infrastructure supporting a modular platform You will lead the integration of LLMs RAG pipelines and agentic AI systems into reliable scalable production applications while ensuring cloud native services remain secure compliant and observable This is an individual contributor position designed for a skilled builder who thrives in a fast moving environment.

Discover the Responsibilities

• Take complete ownership of software AI and platform architecture from initial design through production deployment
• Spend half your time writing hands on code specifically building and integrating AI solutions using Python LLMs RAG and agentic AI
• Design deploy and manage multi tenant microservices infrastructure across AWS cloud environments and Amazon EKS Kubernetes clusters
• Build and integrate production grade LLM applications including RAG pipelines AI agents and model integrations
• Embed zero trust networking privacy by design and strict security controls across platforms
• Build and optimize continuous deployment pipelines automated testing infrastructure as code and full stack observability layers
• Work extensively with DevOps and MLOps tooling including Terraform Kubernetes EKS CI CD and cloud native deployment practices
• Work on production grade software and AI products built directly for external commercial users
• Identify and resolve system performance bottlenecks technical debt and scalability limitations
• Minimum 5 to 7 years of relevant experience in software architecture and hands on engineering.
• Strong hands on development skills in Python, with proven experience building and integrating AI solutions.
• Proven commercial experience working with LLMs, RAG, AI agents, or agentic AI architectures.
• Proven experience building commercial SaaS products sold directly to customers.
• Deep technical knowledge of AWS and Kubernetes, with hands on experience using Amazon EKS.
• Solid grasp of DevOps and MLOps practices, Terraform/infrastructure as code, CI/CD, and cloud native tooling.
• Strong understanding of zero trust security, data encryption, and data residency standards.
• Experience designing scalable microservices and production grade AI applications.
• Experience in fast paced startup or scaleup environments is strongly preferred.
• Strong understanding of how to take AI/ML solutions from development through to reliable production deployment.