AI Infrastructure Sr. Assoc - Agentic Engineer

Apex Group; Pune District; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Apex Group is seeking aSenior AI Infrastructure and Data Associate in Pune to design and manage AI infrastructure systems, including GPU clusters, distributed training, and data pipelines. You will mentor junior staff while driving infrastructure excellence.

The role requires hands-on experience with Kubernetes, cloud platforms, and ML workflows, with a focus on scalable, cost-aware operations and collaboration with ML engineers.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 3-5 years of experience in DevOps, cloud infrastructure, or SRE roles.
• Strong proficiency in Linux systems administration.
• Experience with container orchestration (Kubernetes, Docker).
• Proficiency in Python and Infrastructure as Code tools.
• Hands-on experience with cloud platforms (AWS, GCP, or Azure).
• Understanding of machine learning workflows and requirements.
• Experience with monitoring and observability tools.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.

Responsibilities

• Design and implement infrastructure frameworks for AI model training and deployment.
• Manage GPU cluster operations including monitoring, scaling, and optimization.
• Configure and maintain Kubernetes-based orchestration platforms for ML workloads.
• Implement and tune distributed training frameworks (PyTorch, TensorFlow).
• Build and maintain high-performance data pipelines for AI applications.
• Automate infrastructure provisioning using Terraform, Ansible, or Pulumi.
• Monitor cloud costs and optimize resource utilization (FinOps).
• Troubleshoot complex infrastructure issues and implement solutions.Collaborate with ML engineers to diagnose training bottlenecks and performance issues.
• Mentor Associate-level team members and contribute to team knowledge sharing.
• Document infrastructure architectures and operational procedures.

Skills

Linux systems administration

Python programming

Machine learning workflows

Monitoring and observability

Problem solving

Communication and collaboration

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Kubernetes

Docker

Terraform

Ansible

Pulumi

Job description

The Apex Group was established in Bermuda in 2003 and is now one of the world’s largest fund administration and middle office solutions providers.

Our business is unique in its ability to reach globally, service locally and provide cross-jurisdictional services. With our clients at the heart of everything we do, our hard-working team has successfully delivered on an unprecedented growth and transformation journey, and we are now represented by over circa 13,000 employees across 112 offices worldwide.Your career with us should reflect your energy and passion.

That’s why, at Apex Group, we will do more than simply ‘empower’ you. We will work to supercharge your unique skills and experience.

Take the lead and we’ll give you the support you need to be at the top of your game. And we offer you the freedom to be a positive disrupter and turn big ideas into bold, industry-changing realities.

For our business, for clients, and for you

JOB SUMMARY

The AI Infrastructure and Data Senior Associate plays a key role in designing and managing AI infrastructure systems at CAIDO Group. This role involves hands-on work with GPU clusters, distributed training frameworks, and data pipelines to ensure scalable and efficient AI operations. The Senior Associate will mentor junior team members while driving infrastructure excellence.

KEY RESPONSIBILITIES

• Design and implement infrastructure frameworks for AI model training and deployment
• Manage GPU cluster operations including monitoring, scaling, and optimization
• Configure and maintain Kubernetes-based orchestration platforms for ML workloads
• Implement and tune distributed training frameworks (PyTorch, TensorFlow)
• Build and maintain high-performance data pipelines for AI applications
• Automate infrastructure provisioning using Terraform, Ansible, or Pulumi
• Monitor cloud costs and optimize resource utilization (FinOps)
• Troubleshoot complex infrastructure issues and implement solutionsCollaborate with ML engineers to diagnose training bottlenecks and performance issues
• Mentor Associate-level team members and contribute to team knowledge sharing
• Document infrastructure architectures and operational procedures

REQUIRED QUALIFICATIONS

• Bachelor’s degree in Computer Science, Engineering, or related field
• 3-5 years of experience in DevOps, cloud infrastructure, or SRE roles
• Strong proficiency in Linux systems administration
• Experience with container orchestration (Kubernetes, Docker)
• Proficiency in Python and Infrastructure as Code tools
• Hands-on experience with cloud platforms (AWS, GCP, or Azure)
• Understanding of machine learning workflows and requirements
• Experience with monitoring and observability tools
• Strong problem-solving and analytical skills
• Excellent communication and collaboration abilities

PREFERRED QUALIFICATIONS

• Experience managing GPU clusters or HPC environments
• Knowledge of distributed training frameworks (PyTorch DDP, DeepSpeed)
• Familiarity with parallel file systems (Lustre, GPFS)
• Certified Kubernetes Administrator (CKA) or equivalent
• Cloud architecture certifications (AWS, GCP, Azure)
• Experience with MLOps practices and tools

WORK DETAILS

• Employment Type: Full-time, Permanent
• Location: Pune, India
• Department: CAIDO Group - Innovation and AI
• Reports To: AI Infrastructure and Data Manager
• Work Type: Office-based with potential hybrid options