Agentic AIML

Innova ESI Pvt Ltd; Bengaluru; On-site; INR 3,000,000 - 6,500,000; Full time

Job summary

Innova ESI Pvt Ltd seeks an experienced AI Engineer to design and deploy AI solution architectures aligned with business goals and governance requirements. You will build LLM workflows, RAG applications, and agent-based systems, while establishing evaluation benchmarks and guardrails for reliability.

You will collaborate with Data Engineering, QA, security, and compliance teams to ensure production readiness and scalable, observable AI solutions across enterprise data platforms.

Qualifications

• BS in CS/Engineering/Data Science or related field; equivalent experience.
• Extensive software engineering, ML, or AI engineering experience.
• Hands-on in building and deploying generative AI and LLM-based apps in production.
• Experience with prompt engineering, RAG architectures, AI agents, evaluation, governance.
• Strong understanding of cloud-native architectures, APIs, data platforms, scalable systems.
• Knowledge of Responsible AI, security, privacy, compliance.
• Proven ability to collaborate with technical and business stakeholders.

Responsibilities

• Design AI solution architectures aligned with business goals and governance.
• Build and deploy LLM workflows, prompt orchestration, agents, RAG apps, and model integrations.
• Develop prompt strategies, grounding, tool-calling patterns, guardrails, and fallbacks.
• Partner with Data Engineering for trusted data access.
• Establish evaluation frameworks, datasets, rubrics, and benchmarks.
• Monitor output quality, latency, cost, and hallucination risk.
• Conduct failure-mode analyses and continuous improvements.
• Collaborate with QA, Responsible AI, Security, Privacy, Compliance, and EA.
• Document AI behavior, controls, and monitoring requirements.
• Support production readiness through observability and drift detection.

Skills

AI engineering

Prompt engineering

RAG architectures

LLM deployment

Cloud-native

APIs

Data platform

Model evaluation

Governance

Stakeholder collaboration

Education

Bachelor's degree in CS/Engineering/Data Science or related field

Tools

Python

TensorFlow

PyTorch

MLflow

Kubernetes

Job description

Design AI solution architectures aligned with business objectives, risk tolerance, and governance requirements.

Build and deploy LLM workflows, prompt orchestration chains, agent-based solutions, RAG applications, model integrations, classification models, and decision-support capabilities.

Develop prompt strategies, grounding approaches, tool-calling patterns, guardrails, and fallback mechanisms to improve solution quality and reliability.

Partner with Data Engineering teams to ensure access to trusted, governed, and high-quality data sources.

Establish evaluation frameworks, test datasets, scoring rubrics, and model-performance benchmarks.

Monitor and optimize output quality, relevance, accuracy, consistency, latency, cost efficiency, and hallucination risk.

Conduct failure-mode analysis and implement continuous improvements to AI systems.

Collaborate with Quality Engineering, Responsible AI, Security, Privacy, Compliance, and Enterprise Architecture teams.

Document AI solution behavior, limitations, controls, and operational monitoring requirements.

Support production readiness through observability, monitoring, model evaluation, and drift detection practices.

Required Qualifications

Bachelor's degree in Computer Science, Engineering, Data Science, or a related technical field; equivalent experience considered.

Significant experience in software engineering, machine learning, or AI engineering.

Hands-on experience building and deploying generative AI and LLM-based applications in production environments.

Experience with prompt engineering, RAG architectures, AI agents, model evaluation, and operational AI governance.

Strong understanding of cloud-native architectures, APIs, data platforms, and scalable software systems.

Knowledge of Responsible AI, security, privacy, and compliance practices.

Proven ability to work effectively with technical and business stakeholders.

Preferred Qualifications

Experience supporting Finance, FP&A, Accounting, Treasury, Tax, or other enterprise finance functions.

1-2+ years in developing and deploying agentic AI solutions.

Familiarity with AI observability, model monitoring, vector databases, semantic search, and knowledge retrieval systems.

Experience leading enterprise AI products from design through production support.