Artificial Intelligence Engineer

Hackajob; Hyderabad, Pune District, Bengaluru; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Hackajob seeks a Vice President AI Engineer to design, build, and scale AI/ML solutions—from agentic AI systems and LLM apps to end-to-end MLOps pipelines—across multiple business units. You will shape architecture, mentor teams, and ensure enterprise-grade reliability, security, and governance.

This role is based in Bengaluru and Pune, requiring senior technical leadership, cross-functional collaboration, and delivery of high-impact AI platforms and workflows.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Mathematics, or related discipline.
• 12+ years software engineering experience or building scalable ML infrastructure at enterprise scale.
• Expert-level Python (FastAPI, async) and/or Go/Java for production systems with high throughput.
• Experience with agentic AI systems, LLM applications, multi-agent orchestration, and deployment.
• Knowledge of LLM fine-tuning, prompt engineering, RAG, and agent frameworks.
• Hands-on GenAI/LLM systems experience including prompt engineering and model serving.
• Experience with AWS services (EC2/EKS, S3, IAM, RDS) and AI services (Bedrock, SageMaker).
• Docker and Kubernetes expertise; distributed systems architecture and microservices.
• Ability to communicate complex architectures to senior leadership and stakeholders.

Responsibilities

• Develop and deliver high-quality software solutions with scalable architectures.
• Collaborate with product, design, and other engineers to align requirements with business goals.
• Lead code reviews, promote code quality, and share knowledge across teams.
• Stay current with tech trends and contribute to the organization’s technical communities.
• Follow secure coding practices and implement robust unit testing.
• Mentor and guide engineering teams; influence strategic technology decisions.

Skills

Python

Go/Java

LLM/GenAI

MLOps

Docker

Kubernetes

AWS

Distributed systems

Architecture design

Stakeholder communication

Education

Bachelor's degree in CS/Engineering/Math

Tools

LangGraph

Strands

Bedrock

SageMaker

vLLM

OpenAI API

Docker

Kubernetes

Git

Job description

As a Vice President AI Engineer role, where you will serve as a senior engineer helping to drive adoption of state-of-the-art AI technologies. You'll use your expertise to design, build, and scale AI/ML solutions from agentic AI systems and LLM applications to end-to-end MLOps pipelines enabling the bank's success across multiple business units. You will shape architectural decisions, mentor engineering teams, and ensure our AI solutions meet the demands of enterprise-grade reliability, security, and governance.

To be successful in this role, you should have below skills:

• Bachelor's degree (or above) in Computer Science, Engineering, Mathematics, or related discipline
• 12+ years software engineering experience or experience designing and building scalable ML infrastructure, model serving platforms, and end-to-end MLOps systems at enterprise scale
• Expert-level proficiency in Python (FastAPI, async patterns) and/or Go/Java, with demonstrable experience building production systems serving high-throughput, low-latency workloads
• Strong experience developing agentic AI systems and LLM applications including multi-agent orchestration, tool use, planning frameworks, and production deployment of multi-layered AI workflows at scale
• Deep technical knowledge of LLM fine-tuning, prompt engineering, RAG architectures, and modern agentic frameworks (Strands, LangGraph, Google ADK) with validated ability to architect and optimise agent-based solutions
• Hands-on experience with GenAI/LLM systems — prompt engineering, loop engineering, retrieval-augmented generation, model serving (vLLM), and OpenAI-compatible API surfaces
• Experience with AWS services — EC2/EKS, S3, IAM, RDS, and at least one AI service (Bedrock, SageMaker)
• Hands-on experience with Docker and Kubernetes — containerising applications and deploying to orchestrated environments
• Experience with distributed systems architecture — microservices, cloud platforms, active-active replication, failover strategies, and data consistency patterns
• Proven ability to communicate complex technical architectures to senior leadership and cross-functional stakeholders

Some other highly valued skills may include below:

• Experience building evaluation frameworks for agentic systems including agent benchmarking, reasoning traces, and monitoring observability for multi-step AI workflows in production
• Experience in vector databases, knowledge graphs, semantic search, and memory systems for stateful agents with understanding of retrieval optimisation and context management
• Experience building AI safety/guardrails systems — content filtering, prompt injection detection, PII redaction, toxicity detection
• Knowledge of AI security frameworks — NIST AI RMF, MITRE ATLAS, OWASP LLM Top 10
• Experience with model fine-tuning (LoRA, RLHF, supervised fine-tuning) for domain-specific SLMs
• Knowledge of responsible AI practices, model governance, and security considerations for autonomous systems
• Background in financial services — understanding of regulatory requirements, data residency, and compliance obligations
• Experience with policy engines (OPA/Rego) and zero-trust identity models with OAuth2/OIDC (EntraID/Azure AD)
• Experience with cost attribution and chargeback models for shared AI infrastructure platforms

You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills.

This role is based in Bengaluru and Pune office.

Purpose of the role

To design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues.

Accountabilities

Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance.

Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives.

• Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing.
• Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth.
• Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions.
• Implementation of effective unit testing practices to ensure proper code design, readability, and reliability.

Vice President Expectations

• To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and elevate breaches of policies/procedures..
• If managing a team, they define jobs and responsibilities, planning for the department’s future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements..
• If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others..
• OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions..
• Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
• Manage and mitigate risks through assessment, in support of the control and governance agenda.
• Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
• Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
• Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
• Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
• Adopt and include the outcomes of extensive research in problem solving processes.
• Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.