Senior AI Engineer (Agentic Systems & Inference) - Onsite

COGNNA; Remote; SAR 90,000 - 130,000; Full time

Job summary

A cutting-edge tech firm in Saudi Arabia seeks a Senior AI Engineer to architect and enhance its autonomous agent reasoning engine. Responsibilities include designing multi-agent systems, optimizing reasoning processes, and managing high-scale inference services. Ideal candidates will have 5-7 years in AI/ML engineering, a strong background in building AI applications, and proficiency in Google Cloud and Kubernetes. This position offers a competitive salary, equity options, and the flexibility to work remotely.

Benefits

Competitive salary

Equity options

Performance incentives

Flexible working culture

Growth opportunities

Global impact projects

Qualifications

• 5-7+ years in AI/ML Engineering or Backend Systems.
• Experience in large-scale AI/ML inference service in production.
• Hands-on building AI applications with MCP and A2A protocols.

Responsibilities

• Design stateful, multi-agent systems using frameworks like Google ADK.
• Lead architectural strategy for fine-tuning open-source models.
• Maintain high-concurrency inference services using engines like vLLM.

Skills

Autonomous systems development

AI/ML Engineering

Cloud AI proficiency

Programming in Python

Kubernetes

Education

M.S. or B.S. in Computer Science/AI

Tools

Google Cloud (Vertex AI)

Google ADK

TensorRT-LLM

Job description

As a Senior AI Engineer, you will be the primary architect of Cognna’s autonomous agent reasoning engine and the high-scale inference infrastructure that powers it. You are responsible for building production‑grade reasoning systems that proactively plan, use tools, and collaborate. You will own the full lifecycle of our specialized security models, from domain‑specific fine‑tuning to architecting distributed, high‑throughput inference services that serve as Security‑core intelligence in our platform.

Key Responsibilities

1. • Agentic Architecture & Multi‑Agent Coordination & Autonomous Orchestration: Design stateful, multi‑agent systems using frameworks like Google ADK.
   • Protocol‑First Integration: Architect and scale MCP servers and A2A interfaces, ensuring a decoupled and extensible agent ecosystem.
   • Cognitive Optimization: Develop lean, high‑reasoning microservices for deep reasoning, optimizing context token usage to maintain high planning accuracy with minimal latency.
2. • Model Adaptation & Performance Engineering & Specialized Fine‑Tuning: Lead the architectural strategy for fine‑tuning open‑source and proprietary models on massive cybersecurity‑specific telemetry.
   • Advanced Training Regimes: Implement Quantization‑Aware Training (QAT) and manage Adapter‑based architectures to enable the dynamic loading of task‑specific specialists without the overhead of full‑model swaps.
   • Evaluation Frameworks: Engineer rigorous, automated evaluation harnesses (including Human annotations and AI‑judge patterns) to measure agent groundedness and resilience against the Security Engineer’s adversarial attack trees.
3. • Production Inference & MLOps at Scale & Distributed Inference Systems: Architect and maintain high‑concurrency inference services using engines like vLLM, TGI, or TensorRT‑LLM.
   • Infrastructure Orchestration: Own the GPU/TPU resource management strategy.
   • Observability & Debugging: Implement deep‑trace observability for non‑deterministic agentic workflows, providing the visibility needed to debug complex multi‑step reasoning failures in production.
4. • Advanced RAG & Semantic Intelligence & Hybrid Retrieval Architectures: Design and optimize RAG pipelines involving graph‑like data structures, agent‑based knowledge retrieval and semantic searches.
   • Memory Management: Architect episodic and persistent memory systems for agents, allowing for long‑running security investigations that persist context across sessions.

💰 Competitive Package – Salary + equity options + performance incentives 🧘 Flexible & Remote – Work from anywhere with an outcomes‑first culture 🤝 Team of Experts – Work with designers, engineers, and security pros solving real‑world problems 🚀 Growth‑Focused – Your ideas ship, your voice counts, your growth matters 🌍 Global Impact – Build products that protect critical systems and data

Experience & Education

• 5-7+ years in AI/ML Engineering or Backend Systems.
• Must have contributed to large‑scale AI/ML inference service in production.
• M.S. or B.S. in Computer Science/AI is preferred.
• Inference Orchestration: KV‑cache management, quantization formats like AWQ/FP8, and distributed serving across multi‑node GPU clusters).
• Agentic Development: Expert in building autonomous systems using Google ADK/Langgraph/Langchain and experienced with AI Observervability frameworks like LangSmith or Langfuse.
• Hands‑on experience building AI applications with MCP and A2A protocols.
• Cloud AI Native: Proficiency in Google Cloud (Vertex AI), including custom training pipelines, high‑performance prediction endpoints, and the broader MLOps suite.
• Programming: Python and experience with high‑performance backends (Go/C++) for inference optimization.
• You are comfortable working in a Kubernetes‑native environment.
• CI/CD: You are comfortable working in a Kubernetes‑native environment.