AI Platform Architect

CLOUDSUFI; Dadri; On-site; INR 4,200,000 - 7,000,000; Full time

Job summary

CLOUDSUFI is seeking a senior AI Platform Architect to design and build production-grade platforms for generative AI, agentic systems, and data-intensive applications. You will define architecture, make technology decisions, develop reference implementations, and guide engineering teams from prototypes to secure, scalable production systems.

The role requires deep hands-on experience with LLMs, tool calling, RAG, memory, and agent orchestration, along with strong cloud, security, and

Qualifications

• 10+ years of software architecture, platform engineering, distributed systems, data platforms, or AI systems.
• Hands-on experience designing and building production-grade AI or data-intensive platforms.
• Deep understanding of LLM applications, tool calling, structured outputs, RAG, embeddings, memory, and agent orchestration.
• Experience with cloud platforms, Kubernetes, containers, microservices, APIs, event-driven architecture, CI/CD, and Infrastructure as Code.
• Experience with relational, document, graph, vector, and distributed data systems.
• Practical experience implementing AI evaluation, experimentation, tracing, monitoring, guardrails, and lifecycle management.
• Strong understanding of security, identity, access control, secrets management, data protection, and production reliability.
• Ability to move between architecture, code, infrastructure, debugging, and technical delivery.

Responsibilities

• Design platforms for single-agent and multi-agent systems with planning, reasoning, tool use, memory, delegation, validation, and human approval.
• Define orchestration patterns for deterministic, dynamic, event-driven, and long-running AI workflows.
• Establish data lineage, provenance, metadata, access controls, freshness, and quality standards.
• Build evaluation frameworks for accuracy, relevance, groundedness, task completion, tool use, safety, latency, and cost.
• Enable experimentation across models, prompts, agents, tools, and retrieval strategies.
• Implement versioning and lifecycle management for prompts, agents, workflows, datasets, and model configurations.

Skills

AI platform architecture

Cloud platforms

Kubernetes

CI/CD

Data platforms

Security & IAM

Mentoring engineers

API design

Job description

What We Are Looking For

CLOUDSUFI is seeking a senior, hands-on AI Platform Architect to design and build production-grade platforms for generative AI, agentic systems, data-intensive applications, and analytical workflows. This is a builder-architect role. The successful candidate will define architecture, make technology decisions, develop reference implementations, review critical code and designs, and guide engineering teams from prototypes to secure, scalable production systems. We are looking for a builder-architect with strong engineering judgement and practical delivery experience. The right candidate can define platform direction, evaluate trade-offs, validate ideas through implementation, and guide systems into production. They should be equally comfortable discussing distributed architecture, reviewing code, diagnosing workflow failures, designing evaluation systems, and mentoring engineering teams.

Key Responsibilities-

AI and Agentic Platform Architecture

• Design platforms for single-agent and multi-agent systems supporting planning, reasoning, tool use, memory, delegation, validation, and human approval.
• Define orchestration patterns for deterministic, dynamic, event-driven, and long-running AI workflows.
• Establish clear boundaries between LLM reasoning, application logic, quantitative computation, rules, and human decision-making.
• Evaluate and adopt agent frameworks, model providers, tools, and orchestration technologies based on reliability, flexibility, performance, and cost. Knowledge and Data Systems
• Architect RAG pipelines, document-processing systems, vector search, hybrid retrieval, knowledge graphs, and semantic data layers.
• Integrate structured and unstructured enterprise data from APIs, databases, files, streams, and external platforms.
• Design reusable workflows for research, data collection, transformation, analysis, modelling, validation, and reporting.
• Establish data lineage, provenance, metadata, access controls, freshness, and quality standards. Evaluation, Observability and Governance
• Build evaluation frameworks for accuracy, relevance, groundedness, task completion, tool use, safety, latency, and cost.
• Enable systematic experimentation across models, prompts, agents, tools, retrieval strategies, and orchestration patterns.
• Implement versioning and lifecycle management for prompts, agents, workflows, datasets, knowledge bases, evaluations, and model configurations.
• Establish tracing, monitoring, auditability, guardrails, approval workflows, and production quality diagnostics.

Cloud and Platform Engineering

• Define cloud-native architectures using microservices, APIs, event-driven systems, queues, schedulers, and distributed processing.
• Lead Kubernetes-based deployment, containerisation, CI/CD, Infrastructure as Code, environment management, and release automation.
• Design for horizontal scalability, fault tolerance, resilience, security, data privacy, and high availability.
• Optimise model usage, infrastructure, storage, retrieval, and compute for performance, latency, and cost.

Technical Leadership

• Translate product and business requirements into clear technical designs and implementation plans.
• Build prototypes and reference implementations for high-risk or foundational platform capabilities.
• Review architecture, code, interfaces, data models, infrastructure, and operational readiness.
• Define engineering standards and reusable patterns across AI, backend, data, and platform teams.
• Mentor senior engineers and support teams in resolving complex technical and production issues.

Required Skills And Experience

• 10+ years of experience in software architecture, platform engineering, distributed systems, data platforms, or AI systems.
• Strong hands-on experience designing and building production-grade AI or data-intensive platforms.
• Deep understanding of LLM applications, tool calling, structured outputs, RAG, embeddings, memory, and agent orchestration.
• Strong experience with cloud platforms, Kubernetes, containers, microservices, APIs, event driven architecture, CI/CD, and Infrastructure as Code.
• Experience with relational, document, graph, vector, and distributed data systems.
• Practical experience implementing AI evaluation, experimentation, tracing, monitoring, guardrails, and lifecycle management.
• Strong understanding of security, identity, access control, secrets management, data protection, and production reliability.
• Ability to move effectively between architecture, code, infrastructure, debugging, and technical delivery.

Good to Have

• Experience building enterprise AI copilots, autonomous workflows, research platforms, or analytical systems.
• Experience with knowledge graphs, hybrid search, model gateways, tool gateways, or agent marketplaces.
• Familiarity with LLMOps, MLOps, model serving, feature stores, model registries, and distributed compute.
• Experience supporting real-time and batch data processing at scale.
• Experience comparing and operating multiple commercial and open-source models.
• Prior experience in consulting, client-facing architecture, or complex enterprise platform delivery.

Skills:- Retrieval Augmented Generation (RAG), Large Language Models (LLM) tuning, MLOps, Architecture, Product development, Agentic AI, Python, Solution architecture, Effective communication and Data integration