Gen AI Product Engineer

RBS

Gurugram District

On-site

INR 3,500,000 - 6,000,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

RBS is seeking a Gen AI Product Engineer at VP level to design, build, and scale GenAI-powered products and features delivering tangible business value. You will bridge product thinking and engineering execution, translating user needs into robust, production-ready AI solutions while driving GenAI innovation.

You will design and deliver production-grade GenAI solutions, including AI agents, conversational AI, and automation, focusing on scalability, reliability, and performance.

Qualifications

  • Experience building production GenAI software systems.
  • Strong Python and API design skills for scalable GenAI products.
  • Experience with LLMs, prompt engineering, and retrieval pipelines.

Responsibilities

  • Design, build, and deploy production-grade GenAI products and systems.
  • Translate user needs into scalable AI solutions with robust architecture.
  • Develop and operate LLM solutions including RAG pipelines and agent workflows.
  • Integrate GenAI capabilities into existing platforms via internal APIs and data pipelines.
  • Ensure security, governance, and risk management standards are met in delivery.
  • Monitor, optimize, and maintain GenAI systems in production.

Skills

Python
Frontend frameworks
Distributed systems
API design
Cloud-native
Observability
Performance
LLM concepts
Prompt engineering

Tools

vLLM
OpenAI-compatible serving
SDK integration

Job description

Job Description:

Join us as a Gen AI Product Engineer

  • In this key role, you’ll be responsible for designing, building, and scaling Generative AI (GenAI)-powered products and features that deliver tangible business value
  • We’ll look to you to bridge product thinking and engineering execution, translating user needs into robust, production-ready AI solutions while driving innovation in the application of GenAI capabilities
  • This is an opportunity to design and deliver production-grade GenAI solutions, including AI agents, conversational AI, and automation, with a focus on scalability, reliability, and performance
  • We're offering this role at vice president level
What you'll do

As a Gen AI Product Engineer, you'll design, build, and deploy production-grade GenAI products and systems that turn user and business needs into secure, scalable, and reliable solutions. You'll also translate product and user requirements into scalable technical solutions, balancing model quality, latency, system complexity, and long-term maintainability, while building and integrating large language model (LLM) capabilities using modern frameworks and application programming interfaces (APIs).

This will include working across orchestration layers, retrieval pipelines, system integrations, prompt and context engineering, and model evaluation.

You’ll also be:

  • Converting ambiguous product requirements and research concepts into robust technical architectures, balancing model capability, latency, cost, complexity, and maintainability
  • Ensuring all GenAI solutions meet enterprise security, governance, responsible AI, and risk management standards, with appropriate controls, escalation, and mitigation built into delivery
  • Developing and operating LLM solutions, including Retrieval-Augmented Generation (RAG) pipelines, agent workflows, orchestration, prompt and content engineering, and model integration patterns
  • Integrating GenAI capabilities into existing platforms through internal APIs, services, event flows, and data pipelines, ensuring resilience, observability, and maintainability in production environments
  • Defining and applying approaches to model evaluation, benchmarking, monitoring, and continuous optimisation to improve quality, accuracy, reliability, and user outcomes
  • Identifying and managing real-world AI system failure modes, including hallucinations, retrieval failures, tool-call errors, degraded model performance, and unsafe or non-compliant outputs
  • Supporting production operations, including service monitoring, incident response, root-cause analysis, and on-call responsibilities where required for business-critical GenAI systems
The skills you'll need

We're looking for someone with proven experience designing, building, and operating production-grade GenAI software systems, with strong capabilities in Python, front-end design frameworks, distributed systems, API design, cloud-native engineering, observability, and performance-critical workloads. You should also bring experience translating ambiguous research concepts, emerging AI capabilities, user needs, and product requirements into secure, scalable, and maintainable production systems within fast-moving product or research-led environments.

To succeed in this role, you'll need experience delivering GenAI or LLM-powered products beyond the prototype stage, including self-hosted model inference with frameworks such as vLLM, OpenAI-compatible serving patterns, orchestration layers, software development kit integration, and production systems. You must also bring a practical understanding of LLM application architecture, including prompt and context engineering, embeddings, vector search, RAG pipelines, agent workflows, tool-calling patterns, memory and context management, and the mitigation of real-world AI system failure modes.

You’ll also demonstrate:

  • An understanding of model training, fine-tuning, adaptation, inference, and serving pipelines, including trade-offs in model selection, performance, cost, reliability, scalability, and operational complexity
  • Experience evaluating, monitoring, and optimising AI systems, with working knowledge of responsible AI, model risk, security, governance, and operational controls in enterprise or regulated environments
  • Hands-on experience deploying small language models for latency-, cost-, privacy-, or domain-specific use cases

Hours

45

Job Posting Closing Date: 24/11/2026

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Generative AI Product Engineer
Generative AI Product Engineer

NatWest Group • Bengaluru

On-site
INR 4,000,000 - 8,000,000
Gen AI Product Engineer
Gen AI Product Engineer

NatWest Group • Bengaluru

On-site
INR 3,500,000 - 6,500,000
Gen AI Product Engineer
Gen AI Product Engineer

NatWest Group • Chennai

On-site
INR 600,000 - 1,200,000
Gen AI Product Engineer
Gen AI Product Engineer

NatWest Group • Gurugram District

On-site
INR 3,500,000 - 9,000,000
GenAI Architect
GenAI Architect

QualiZeal • Hyderabad

On-site
INR 3,500,000 - 6,500,000
AI Product Engineer
AI Product Engineer

Mouri Tech • Hyderabad, Chennai, Bengaluru

On-site
INR 1,200,000 - 1,800,000
Gen AI Engineer_4+yrs
Gen AI Engineer_4+yrs

Zorba AI • Hyderabad

On-site
INR 1,500,000 - 2,500,000
Gen AI Engineer_4+yrs
Gen AI Engineer_4+yrs

Zorba AI • Chennai District

On-site
INR 1,000,000 - 1,500,000
Gen AI Engineer_4+yrs
Gen AI Engineer_4+yrs

Zorba AI • Dadri

On-site
INR 1,500,000 - 2,500,000
Gen AI Engineer_4+yrs
Gen AI Engineer_4+yrs

Zorba AI • Kolkata District

On-site
INR 1,500,000 - 3,000,000