Senior Engineer _AI Platform

Net Connect; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Net Connect in Bengaluru, India, is seeking a Senior Engineer AI Platform to design, develop, and evolve a scalable enterprise AI infrastructure and platform capabilities.

The role combines platform engineering, distributed systems, and cloud-native AI workloads, emphasizing high performance, security, and reliability across AWS and Kubernetes. You will lead critical initiatives, mentor engineers, and contribute to technology strategy.

Qualifications

• 7+ years of software/platform engineering experience, including 5+ years working with enterprise-scale platform or infrastructure architecture.
• Strong experience with distributed systems, high availability, active-active architecture, and failover patterns.

Responsibilities

• Design and develop enterprise-scale AI platform and infrastructure solutions.
• Build highly available distributed systems using active-active and failover architectures.
• Develop high-throughput, low-latency production services and APIs.
• Design and manage cloud-native AI infrastructure across AWS and Kubernetes.
• Build infrastructure supporting LLM and Agentic AI workloads.
• Implement and optimise AI model serving and inference infrastructure.
• Integrate AI platforms with enterprise applications and services.
• Collaborate with architects, product managers, engineers, and business stakeholders.
• Participate in code reviews and promote engineering best practices.
• Implement secure coding, testing, monitoring, and reliability practices.
• Contribute to technology strategy, platform standards, and continuous improvement.

Skills

Python

FastAPI

Asynchronous programming

Go

Java

Distributed systems

High availability

Cloud infrastructure

Kubernetes

Envoy Proxy

xDS API

WASM filters

AI model serving

GPU infrastructure

AI inference optimization

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical discipline

Tools

Envoy Proxy

Kubernetes

AWS

Job description

Role Overview: We are looking for a Senior Engineer AI Platform to design, develop, and improve enterprisescale AI infrastructure and platform capabilities.

The role combines platform engineering, distributed systems, cloud infrastructure, and Generative AI/Agentic

AI, with a focus on building highly scalable, secure, resilient, and high-performance AI platforms.

Key Responsibilities

• Design and develop enterprise-scale AI platform and infrastructure solutions.
• Build highly available distributed systems using active-active and failover architectures.
• Develop high-throughput, low-latency production services and APIs.
• Design and manage cloud-native AI infrastructure across AWS and Kubernetes.
• Build infrastructure supporting LLM and Agentic AI workloads.
• Implement and optimise AI model serving and inference infrastructure.
• Integrate AI platforms with enterprise applications and services.
• Collaborate with architects, product managers, engineers, and business stakeholders.
• Participate in code reviews and promote engineering best practices.
• Implement secure coding, testing, monitoring, and reliability practices.
• Contribute to technology strategy, platform standards, and continuous improvement.

Technical Requirements

• 7+ years of software/platform engineering experience, including 5+ years working with enterprisescale platform or infrastructure architecture.
• Strong experience with distributed systems, high availability, active-active architecture, and failover

patterns.

• Expert-level proficiency in Python, particularly FastAPI and asynchronous programming; Go or Java

Preferred / Additional Skills

• Experience implementing AI safety and guardrails, including:
• Prompt injection detection
• PII redaction
• Content filtering
• Knowledge of AI security frameworks such as:
• NIST AI RMF
• MITRE ATLAS
• OWASP LLM Top 10
• Strong experience with Envoy Proxy, including xDS API, WASM filters, and AI Gateway extensions.
• Experience with GPU infrastructure and AI inference optimisation.
• Financial services or banking experience, particularly around regulatory requirements, data residency,

and compliance.

Leadership & Stakeholder Skills

• Strong analytical and problem-solving capabilities.
• Ability to influence technical direction and architectural decisions.
• Strong communication and stakeholder management skills.
• Ability to collaborate across engineering, product, architecture, and business teams.
• Experience mentoring and guiding less experienced engineers.
• Ability to manage technical risks and strengthen platform controls.
• Strong understanding of enterprise technology strategy and cloud architecture.

Education

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical

discipline