Cab facility provided for commute.
Job Summary
We are looking for a skilled Kong Administrator / AI Gateway Engineer to join Recro's technology team in Bangalore. The ideal candidate will bring strong hands-on experience in API Gateway management, Kong administration, and AI/LLM proxy development, along with solid foundations in cloud infrastructure (Azure), Infrastructure as Code (Terraform), and CI/CD automation. This role will support enterprise-grade API and AI Gateway solutions, enabling secure, scalable and governed access to multiple LLM providers.
Key Responsibilities
- Configure, administer, and support Kong Gateway environments (OSS/Enterprise) including setup, maintenance and upgrades.
- Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway.
- Configure AI-specific policies including prompt logging, content filtering, token controls and guardrails.
- Enable secure access to multiple LLM providers (OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Mistral, Llama) through a unified gateway architecture.
- Develop routing strategies across multiple AI models based on latency, cost and availability, including load balancing and failover management.
- Implement AI observability, token analytics, usage tracking and cost governance.
- Integrate RAG-based AI services through secure API management frameworks.
- Implement API security, authentication, throttling and governance policies (OAuth2, JWT, OIDC).
- Deploy and manage Kong in Kubernetes-based environments using Docker and Helm.
- Manage Kong Konnect configurations - routes, services, consumers, catalog, upstreams and API packages.
- Provision and manage infrastructure using Terraform, with Azure compute, storage, security and networking.
- Automate deployments and operational processes using CI/CD tools (Jenkins / GitHub Actions).
- Monitor, troubleshoot and optimize gateway performance using Prometheus, Grafana and ELK/Splunk.
- Ensure compliance with enterprise AI governance, security and regulatory requirements.
- Establish AI platform standards, reusable AI APIs and best practices for GenAI adoption.
- Support AI agent and MCP (Model Context Protocol)-based integrations within enterprise ecosystems.
Must-Have Skills
- 4+ years of relevant experience in API Management, Middleware or Platform Engineering.
- Hands-on experience with Kong Gateway administration (OSS/Enterprise) - setup, maintenance and
- Terraform for infrastructure provisioning and configuration management.
- Azure (compute, storage, security and network).
Good-to-Have Skills
- Ansible for configuration automation.
- Exposure to other API gateways such as Apigee, IBM API Connect etc.
- AWS and/or GCP (compute, storage, security and network).
- AI Gateway / LLM proxy development and multi-LLM integration.
- Vector databases and RAG architecture concepts.
- Prompt management, prompt security and guardrails.
- LLMOps and AI observability / model performance monitoring.
Technical Skill Areas
Gateway & API ManagementKong Gateway (OSS/Enterprise), Kong Konnect, API Lifecycle Management, REST APIs, GraphQL
Security OAuth2, JWT, OIDC, API Security, AI Security, Responsible AI, Model Governance
Cloud & Infra Azure (must-have), AWS/GCP (good to have), Kubernetes, Docker, Helm
Experience Requirement
4+ years of total experience in API Management, Middleware, or Platform Engineering, with hands-on Kong Gateway administration experience. Experience with cloud-native and microservices architectures is preferred.