Sr Software Engineer - AI Platform

Penguin Solutions; Bengaluru; Hybride; INR 3 500 000 - 7 000 000; Plein temps

Résumé du poste

Penguin Solutions seeks a Senior AI Platform Engineer to build and operate the production AI platform powering ClusterWareAI. You will deploy scalable infrastructure, services, and tooling to enable reliable AI workflows in enterprise environments.

Collaborate with AI, platform, and software teams to deliver secure, observable, and highly available AI services, optimize inference, and implement CI/CD for AI applications.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 7+ years of software or infrastructure engineering experience.
• Strong programming skills in Python.
• Experience developing and operating production AI or LLM-powered applications.
• Experience with Kubernetes, Docker, and cloud-native architectures.
• Experience with model serving technologies (e.g., vLLM, Triton) or similar.
• Experience building REST APIs, microservices, and distributed systems.
• Familiarity with vector databases, retrieval systems, and RAG architectures.

Responsabilités

• Build and operate the production AI platform supporting model serving, inference, and AI services.
• Develop scalable retrieval, knowledge management, and data ingestion pipelines for AI-driven operations.
• Build APIs, platform services, and automation integrating AI into ClusterWareAI.
• Implement AI observability, monitoring, and tooling for production AI services.
• Optimize inference performance, scalability, reliability, and efficiency.
• Maintain CI/CD pipelines and deployment automation for AI applications.
• Collaborate with AI, platform, and software teams to deploy AI capabilities to production.
• Contribute to platform security, reliability, and operational excellence.

Connaissances

Python programming

Distributed systems

REST APIs

Collaboration

Formation

Bachelor's degree in CS or related

Outils

Kubernetes

Docker

NVIDIA Triton / vLLM

Cloud-native architectures

Description du poste

Job Description:

At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide.

Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.

Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.

At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.

Job Overview

We are seeking a Senior AI Platform Engineer to build and operate the production AI platform that powers ClusterWareAI. In this role, you will develop the infrastructure, services, and tooling that enable our AI Operational Agent to reliably deploy, retrieve knowledge, execute workflows, and operate at scale in enterprise environments.

You will work closely with AI engineers, platform engineers, and software developers to build secure, scalable, observable, and highly available AI services for production deployments.

Responsibilities

• Build and operate the production AI platform that supports model serving, inference, and AI services.
• Develop scalable retrieval, knowledge management, and data ingestion pipelines to support AI-driven operations.
• Build APIs, platform services, and automation that integrate AI capabilities into ClusterWareAI.
• Implement AI observability, monitoring, evaluation, and operational tooling for production AI services.
• Optimize inference performance, scalability, reliability, and operational efficiency.
• Build and maintain CI/CD pipelines and deployment automation for AI applications.
• Partner with AI, platform, and software engineering teams to deploy AI capabilities into production.
• Contribute to platform security, reliability, and operational excellence.

Qualifications

• Bachelors degree in Computer Science, Engineering, or a related field.
• 7+ years of software engineering, platform engineering, or infrastructure engineering experience.
• Strong programming skills in Python.
• Experience developing and operating production AI or LLM-powered applications.
• Experience with Kubernetes, Docker, and cloud-native architectures.
• Experience with model serving technologies such as vLLM, NVIDIA Triton Inference Server, or similar platforms.
• Experience building REST APIs, microservices, and distributed systems.
• Familiarity with vector databases, retrieval systems, and RAG architectures.

Preferred Qualifications

• Experience implementing monitoring, observability, and operational tooling for AI services.
• Experience with managed AI platforms such as Azure AI Foundry, AWS Bedrock, or Google Vertex AI.
• Experience with AI engineering tools such as LangSmith, MLflow, OpenTelemetry, or similar technologies.
• Experience deploying GPU-based AI workloads in Kubernetes environments.
• Experience integrating AI services with enterprise applications, APIs, or infrastructure platforms.
• Background in enterprise infrastructure, cloud platforms, or systems management software.

Location

Hybrid - Bangalore

Travel

As needed