AI/Gen AI Architect

ShepHertz Technologies; Gurugram District; Sur place; INR 3 500 000 - 7 000 000; Plein temps

Résumé du poste

ShepHertz Technologies is seeking an AI / GenAI Architect to design secure, scalable enterprise AI solutions across on-premises, cloud, and hybrid environments. You will cover secure architectures for web, API, mobile and AI services with a focus on data protection, governance and risk mitigation.

The role requires 10+ years of software/architecture/AI engineering experience and expertise in MLOps, model governance, and responsible AI, working in high-security domains.

Qualifications

• Security-focused design across web, mobile, APIs, AI services, data stores and integrations.
• Experience mitigating AI-specific risks: prompt injection, data leakage, RAG poisoning, model misuse.
• Proven ability to design secure RAG pipelines with access control and validation.
• Experience evaluating LLMs, embeddings, vector databases, and related platforms for security and scale.
• Knowledge of production deployment, MLOps/LLMOps, monitoring, drift detection, and governance.
• Strong emphasis on Responsible AI, explainability, auditability, and compliance.
• Familiarity with Kubernetes/OpenShift, containers, GPUs, and enterprise observability.

Responsabilités

• Define secure architectures for web, mobile, APIs, AI services, data stores and integrations.
• Identify and mitigate traditional and AI-specific security risks in systems.
• Design secure RAG pipelines with document validation, access control, and retrieval security.
• Evaluate LLMs, embedding models, rerankers, and vector databases for security/scale/cost.
• Compare platforms (Neo4j, Pinecone, Weaviate, Milvus, Azure AI Search, Chroma, pgvector).
• Define production deployment, MLOps/LLMOps, monitoring, drift detection, and rollback strategies.
• Establish Responsible AI, governance, explainability, and human oversight.
• Stay updated on AI security threats and translate into practical architecture controls.

Connaissances

Application security

API security

Mobile security

On-premises security

AI security

Threat modelling

Prompt-injection protection

Secure AI design

LLMs

RAG

Embeddings

Semantic search

Hybrid search

GraphRAG

AI agents

Vector databases

Graph databases

Data governance

Privacy & PII protection

Access control

MLOps/LLMOps

Model deployment

Model registry

Monitoring & drift detection

Evaluation

Versioning & rollback

Responsible AI & governance

Explainability & auditability

Compliance & human oversight

Kubernetes/OpenShift

Containers & GPUs

Model serving & observability

Communication & leadership

Architecture decision-making

Outils

Neo4j

Pinecone

Weaviate

Milvus

Azure AI Search

Chroma

pgvector

Description du poste

Title- AI / GenAI Architect

Experience- 10+years

Location- NCR

Employment Type- full time

Job Description:

Security Architect with AI skills

We are looking for an experienced AI / GenAI Architect to design secure, scalable, and production-ready enterprise AI solutions across on-premises, cloud, and hybrid environments.

Responsibilities

• Define secure application architectures covering web, mobile, APIs, AI services, data stores, models, and enterprise integrations.
• Identify and mitigate traditional application vulnerabilities as well as AI-specific risks such as prompt injection, data leakage, RAG poisoning, model misuse, and excessive agent privileges.
• Design secure RAG pipelines with proper document validation, access control, retrieval security, vector-store protection, and response validation.
• Evaluate and select LLMs, embedding models, rerankers, vector databases, and graph technologies based on security, quality, scale, latency, and cost.
• Compare and design solutions using platforms such as Neo4j, Pinecone, Weaviate, Milvus, Azure AI Search, Chroma, pgvector, or similar technologies.
• Define production deployment, MLOps/LLMOps, model monitoring, evaluation, drift detection, retraining, versioning, and rollback strategies.
• Establish Responsible AI, model governance, explainability, auditability, compliance, and human oversight.
• Stay aware of emerging AI security threats and industry incidents and translate those learnings into practical architecture and security controls.

Key Skills

• Application, API, mobile, and on-premises security.
• AI security, threat modelling, prompt-injection protection, and secure AI design.
• LLMs, RAG, embeddings, semantic search, hybrid search, GraphRAG, and AI agents.
• Vector and graph databases, including selection and architecture trade-offs.
• Data architecture, data governance, privacy, PII protection, lineage, and access control.
• MLOps/LLMOps, model deployment, model registry, monitoring, drift detection, and evaluation.
• Model selection, benchmarking, hallucination/groundedness evaluation, and production quality controls.
• IAM, RBAC/ABAC, encryption, secrets management, network isolation, and secure SDLC.
• Responsible AI, model governance, bias, explainability, compliance, and auditability.
• Kubernetes/OpenShift, containers, GPUs, model serving, and enterprise observability.
• Strong communication, technical leadership, and architecture decision-making.

Experience

• 10+ years of software, architecture, data, or AI engineering experience.
• Experience designing enterprise-grade AI solutions, preferably in regulated, government, banking, telecom, or other high-security environments.
• Experience taking AI solutions from data ingestion and model selection through deployment, monitoring, governance, and production operations.