AI Architect

Creative Chaos; Pakistan; On-site; PKR 4,000,000 - 7,500,000; Full time

Job summary

Creative Chaos is seeking an AI Architect to build AI-native products, lead cross-functional squads, and own outcomes end-to-end across web, mobile, AI agents, and streaming backends.

You will scope, architect, staff, and ship while running the product safely at scale, with a focus on safe evals, guardrails, and observability. Expect client-facing discovery, roadmap alignment, and leadership of Tech Leads and PMs.

Qualifications

• 8–12+ years engineering experience.
• 4+ years leading multi-team delivery.
• Shipped production web/mobile systems at scale.
• Produced AI apps using Claude/GPT/Gemini/Llama/Mistral with retrieval.
• Built orchestration and durable workflows.
• Implemented guardrails, evals, and observability pipelines.

Responsibilities

• Stand up and run squads for product platform & SRE.
• Design and ship RAG/agent systems with model selection and retrieval.
• Ensure safe AI operations with evals, guardrails, redaction, and cost controls.
• Own delivery outcomes: SLOs, cost, velocity, and release with flags and canaries.
• Be client-facing for discovery, scoping, and roadmap.
• Hire and coach senior engineers and PMs; raise engineering practices.

Skills

Engineering experience

Multi-team leadership

Production web/mobile systems

AI apps with Claude/GPT

Orchestration tools

Retrieval vector DBs

Observability/telemetry

Cloud/Kubernetes

Tools

LangGraph/DSPy

Temporal

Weaviate

Qdrant

Pinecone

OpenTelemetry

Postgres/pgvector

OpenSearch/Typesense

Job description

Job Summary:

As an AI Architect you will build AI-native products. You’ll lead cross-functional Innovation Delivery Squads—owning outcomes end-to-end across web, mobile, AI agents, and streaming backends. You’re a hands-on technical leader who can scope, architect, staff, and ship; then run the product safely at scale.

Job Responsibilities:

• Stand up and run squads (Discovery Prototype Product Platform & SRE).
• Design and ship RAG/agent systems: pick models (e.g., Anthropic Claude, OpenAI, Google, or open-weights like Llama/Mistral), define tools/functions, and choose retrieval (default Postgres + pgvector, scale to Weaviate/Qdrant/Pinecone when needed).
• Operate AI safely: evals & guardrails, structured outputs (JSON/Schema), PII redaction, refusal policies, cost/latency budgets, and LLM observability.
• Own delivery outcomes: SLOs, quality, cost, velocity; release with feature flags and canaries.
• Be client-facing: discovery, scoping, SoW, roadmap, QBRs.
• Hire/coach Tech Leads, EMs, and PMs; level up practices.

Requirements

• 8–12+ yrs engineering; 4+ yrs leading multi-team delivery; shipped production web/mobile systems at scale.
• Shipped at least one production AI app using Claude/GPT/Gemini/Llama/Mistral, backed by retrieval (pgvector or a vector DB) and a basic eval/guardrail pipeline.
• Implemented orchestration (LangGraph/DSPy or Temporal for durable workflows), rerankers (e.g., Cohere/Jina/Voyage), and prompt/tool versioning.
• Built with modern cloud + data: serverless/K8s, Terraform, OpenTelemetry, feature flags/experimentation.
• Excellent client communication and commercial sense (SoWs, staffing, utilization).

Tech stack (you have hands on experience)

• Models: Anthropic Claude; OpenAI; Google; open-weights (Llama, Mistral).
• Orchestration & agents: LangGraph (or DSPy) for graphs; Temporal for durable, long-running tasks and SLAs.
• Retrieval: Postgres + pgvector (default); Weaviate/Qdrant/Pinecone when scale/ops require; hybrid search with OpenSearch/Typesense.
• Embeddings / rerankers: OpenAI/Voyage/E5/BGE; Cohere/Jina/Voyage rerank.
• Guardrails & evals: JSON/Pydantic schemas, red-team sets, promptfoo/Ragas/DeepEval; content/PII filters.
• Observability: OpenTelemetry traces incl. prompt/tool spans; Langfuse/Arize Phoenix (or equivalent) + Sentry/Grafana.
• App & data: Next.js 15 (RSC), TypeScript/Go/Python; Postgres; Kafka/Redpanda/NATS; dbt/lakehouse optional.
• Ops: Cloud Run/ECS/K8s; Terraform/OpenTofu; GitHub Actions; LaunchDarkly/Unleash; Statsig/GrowthBook.