Senior Manager, Software Engineering

sghcorp.com; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Penguin Solutions in Bengaluru seeks a Senior Manager of Software Engineering to lead teams building core capabilities of ClusterWareAI, with strong exposure to Data Science, ML, GenAI, and agentic AI. You will oversee distributed systems, Kubernetes, and AI-enabled platform features.

The ideal candidate will build high-performing teams, drive technical execution, and partner with Data Science to productionize intelligent capabilities while scaling Bangalore as a key engineering center for

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• 15+ years of software engineering experience in enterprise software, distributed systems, cloud platforms, or infrastructure software.
• 5+ years of engineering leadership experience.
• Experience leading multiple engineering initiatives for a complex software product.
• Understanding of LLMs, AI agents, model serving, and AI lifecycle.
• Ability to work with Data Scientists and ML/AI engineers.
• Experience using AI-assisted development tools and workflows.
• Strong depth in distributed systems, cloud-native architectures, microservices, APIs, and infrastructure software.
• Kubernetes, containers, Linux, REST/gRPC APIs, and modern service architectures.
• Experience delivering highly available, scalable, resilient, secure production software.
• Strong practices: architecture review, automated testing, CI/CD, DevOps, observability, and production operations.
• Ability to lead architecture discussions and guide complex engineering decisions.
• Track record of recruiting, coaching, and developing senior engineers and tech leaders.

Responsibilities

• Lead, grow, and develop high-performing software engineering teams for ClusterWareAI platform components.
• Drive roadmap execution from architecture to production support.
• Define technical strategy with Product Management, Principal Engineers, and Architects.
• Collaborate with Data Science/AI teams to productionize ML models and GenAI capabilities.
• Establish engineering practices for AI/ML reliability, observability, security, evaluation, and governance.
• Provide technical leadership for distributed systems, Kubernetes, and cloud-native platform capabilities.
• Guide architectural decisions for scalability, availability, security, and maintainability.
• Drive development of control-plane services and APIs for provisioning, orchestration, and lifecycle management of AI infrastructure.
• Champion engineering excellence: code quality, test automation, CI/CD, and security.
• Build multi-tenant platforms with strong isolation, governance, and high availability.
• Set measurable goals for delivery, quality, reliability, and productivity.
• Collaborate with Support and Customer teams to resolve field issues and drive product improvements.
• Recruit and mentor engineers, developing senior leaders for broader roles.
• Promote AI-assisted software development practices with responsible governance.
• Improve developer experience and productivity with modern tooling and workflows.
• Identify dependencies and align cross-team goals.
• Communicate strategy and risks to senior leadership.
• Collaborate with globally distributed Bangalore-based teams to grow ClusterWareAI capabilities.

Skills

Distributed systems

Kubernetes

APIs & microservices

Cloud platforms

AI/ML platforms

Leadership & mentoring

Software architecture

Data Science collaboration

LLMs & GenAI

Education

Bachelor's or Master's in CS/Engineering

Tools

Git & CI/CD

Observability tools

Job description

At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide.

Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.

Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.

At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.

Job Overview

We are seeking an experienced Senior Manager, Software Engineering to lead engineering teams building core capabilities of the ClusterWareAI platform, with strong exposure to Data Science, Machine Learning, Generative AI, and Agentic AI.

ClusterWareAI enables deployment, orchestration, monitoring, optimization, and lifecycle management of large-scale AI infrastructure. This role will lead engineering across distributed systems, Kubernetes, infrastructure orchestration, observability, and AI-enabled platform capabilities.

The ideal candidate is a strong engineering leader who can build high-performing teams, drive technical execution, and work closely with Data Science and AI teams to productionize intelligent capabilities.

As a Senior Engineering Manager, you will provide technical and organizational leadership, drive execution across multiple initiatives, develop engineering leaders, and help establish Bangalore as a key engineering center for ClusterWareAI.

Responsibilities

• Lead, grow, and develop high-performing software engineering teams responsible for key components and services within the ClusterWareAI platform.
• Drive roadmap execution across multiple engineering initiatives from architecture and design through development, validation, release, and production support.
• Partner with Product Management, Principal Engineers, and Architects to define technical strategy, architecture, and execution priorities aligned with product and customer requirements.
• Partner with Data Science and AI teams to productionize ML models, analytics, GenAI, and agentic capabilities.
• Establish engineering practices for AI/ML reliability, observability, security, evaluation, and governance.
• Provide technical leadership for large-scale distributed systems and cloud-native platform capabilities spanning infrastructure orchestration, cluster management, APIs, Kubernetes, and AI infrastructure.
• Guide architectural decisions and technical trade-offs related to scalability, availability, performance, security, maintainability, and operational complexity.
• Drive the development of reliable control-plane services and APIs for provisioning, orchestration, monitoring, and lifecycle management of large-scale AI infrastructure.
• Champion engineering excellence through strong software architecture, code quality, test automation, CI/CD, observability, security, resiliency, and operational practices.
• Build platforms designed for large-scale and multi-tenant environments, with strong consideration for isolation, resource governance, high availability, failure recovery, and non-disruptive lifecycle operations.
• Establish measurable engineering and operational goals covering delivery predictability, product quality, reliability, performance, and engineering productivity.
• Partner with Quality Engineering, Support, and customer-facing teams to resolve complex field issues, drive root-cause analysis, and translate customer learnings into product and engineering improvements.
• Recruit, mentor, and retain strong engineering talent while developing senior engineers and technical leads into broader technical and organizational leadership roles.
• Create an environment of ownership and accountability where teams can make effective technical decisions and deliver customer outcomes with appropriate autonomy.
• Champion AI-assisted software development practices across the engineering organization, including the effective use of AI coding assistants and agentic development tools for design, implementation, testing, code review, debugging, documentation, and developer productivity, while establishing appropriate quality, security, and governance practices.
• Drive continuous improvement in developer experience and engineering productivity through modern development environments, automation, AI-assisted workflows, and measurable engineering practices.
• Identify dependencies and risks across engineering teams and drive alignment and resolution across organizational boundaries.
• Communicate engineering strategy, execution status, technical trade-offs, risks, and outcomes effectively to senior engineering and business leadership.
• Collaborate closely with globally distributed teams while continuing to build ClusterWareAI engineering capability and technical expertise in Bangalore.
• Evaluate and adopt AI-assisted software development approaches that improve engineering productivity while maintaining appropriate architecture, review, security, and quality standards.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• 15+ years of software engineering experience building enterprise software, distributed systems, cloud platforms, or infrastructure software with Practical exposure to Data Science, ML, GenAI, or AI/ML platforms.
• 5+ years of engineering leadership experience, with a demonstrated ability to lead and develop high-performing software engineering teams.
• Experience leading multiple engineering initiatives, teams, or technical workstreams for a complex commercial software product or platform.
• Understanding of LLMs, RAG, AI agents, model serving, evaluation, and ML lifecycle.
• Ability to work effectively with Data Scientists and ML/AI Engineers.
• Experience using AI-assisted development tools and workflows.
• Strong technical depth in distributed systems, cloud-native architectures, microservices, APIs, and infrastructure software.
• Strong understanding of Kubernetes, containers, Linux, REST/gRPC APIs, and modern service architectures.
• Experience designing and delivering highly available, scalable, resilient, and secure production software.
• Strong understanding of modern software engineering practices including architecture and design reviews, Agile development, automated testing, CI/CD, DevOps, observability, and production operations.
• Ability to engage deeply in architecture and technical design discussions and provide effective guidance on complex engineering decisions.
• Experience owning software through the complete lifecycle—from requirements and architecture through development, deployment, operation, and continuous improvement.
• Demonstrated ability to recruit, coach, mentor, and develop senior engineers and technical leaders.
• Demonstrated experience adopting AI-assisted software development tools and workflows, with an understanding of how to apply them effectively while maintaining code quality, security, architectural integrity, and engineering accountability.
• Strong customer and product mindset with the ability to translate customer requirements and operational challenges into engineering priorities.
• Experience collaborating effectively across Product Management, Architecture, Quality Engineering, Support, and other engineering organizations.
• Excellent communication, collaboration, and stakeholder-management skills, including experience working with globally distributed teams.

Preferred Qualifications

Experience with one or more of the following:

• AI infrastructure, GPU cloud/neocloud platforms, or large-scale cloud infrastructure.
• Building cloud control planes, infrastructure management platforms, or orchestration systems.
• Kubernetes platform engineering and large-scale container orchestration.
• GPU infrastructure, heterogeneous accelerator environments, or GPU resource management.
• Bare-metal provisioning, fleet management, and infrastructure lifecycle automation.
• Multi-tenant platforms, resource scheduling, quotas, isolation, and infrastructure security.
• High-performance networking technologies including InfiniBand, RDMA/RoCE, and high-speed Ethernet.
• Distributed storage and data infrastructure.
• Infrastructure automation and Infrastructure as Code technologies such as Ansible.
• Observability, Site Reliability Engineering practices, service-level objectives, high availability, and automated remediation.
• Workload management and scheduling technologies such as Kubernetes and Slurm.
• Hybrid cloud and enterprise SaaS platforms.
• High Performance Computing environments.
• AI/ML platform infrastructure, LLM infrastructure, or AI-enabled infrastructure operations.
• Building or scaling engineering teams within a growing product or engineering organization.