Sr. Software Engineer - Applied AI

Spore N Sprouts; Bengaluru; Hybrid; INR 2,500,000 - 4,500,000; Full time

Job summary

Penguin Solutions in Bangalore is seeking a Senior Applied AI Engineer to build AI-powered capabilities for the ClusterWareAI AI Operational Agent. You will translate workflows into AI experiences using LLMs, retrieval systems, and enterprise integrations.

You will collaborate with Product Management and software engineers to rapidly prototype, develop, and ship production-ready AI features, staying current with advances in agentic AI and embeddings to deliver customer value.

Qualifications

• Bachelor's degree required in CS/Engineering or related field.
• 5+ years of software engineering with hands-on AI development.
• Strong Python skills and testing experience with Pytest or similar.

Responsibilities

• Develop AI-powered workflows and enterprise integrations.
• Design prompts, tooling, and reasoning for enterprise use cases.
• Build retrieval, grounding, and context management with RAG.
• Evaluate AI quality and improve reliability and UX.
• Collaborate with PM and engineering to prototype and ship features.
• Stay current with LLMs and agentic AI advances.

Skills

Python

AI application development

LLM APIs

REST APIs

Pytest

Education

Bachelor's degree in Computer Science or related field

Tools

LangChain

LangGraph

Semantic Kernel

Job description

At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide.

Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.

Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.

At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.

Job Overview

We are looking for a Senior Applied AI Engineer to build intelligent capabilities for the ClusterWareAI AI Operational Agent. This role will focus on translating customer and operational workflows into AI-powered experiences using large language models, retrieval systems, and enterprise integrations.

You will work closely with Product Management, AI Platform Engineering, and software engineering teams to rapidly prototype, develop, and deliver production-ready AI capabilities.

Responsibilities

• Develop AI-powered workflows that automate infrastructure and operational tasks.
• Design prompts, tool integrations, and reasoning workflows for enterprise use cases.
• Build retrieval, knowledge-grounding, and context management solutions using retrieval-augmented generation (RAG).
• Evaluate AI quality and continuously improve accuracy, reliability, and user experience.
• Integrate AI capabilities with enterprise systems, APIs, and the ClusterWareAI platform.
• Collaborate with Product Management and engineering teams to rapidly prototype and deliver AI features.
• Stay current with advances in LLMs, agentic AI, and emerging AI technologies, applying them where they create customer value.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of software engineering experience, including hands-on AI application development.
• Strong Python programming skills, including experience with Python testing frameworks such as Pytest or equivalent.
• Experience building applications using LLM APIs, agent frameworks, or similar AI orchestration technologies.
• Experience with prompt engineering and retrieval techniques, including RAG.
• Strong understanding of REST APIs and enterprise integrations.
• Excellent problem-solving and communication skills.

Preferred Qualifications

• Experience with LangChain, LangGraph, Semantic Kernel, LlamaIndex, AutoGen, or similar AI frameworks.
• Experience building enterprise copilots or AI assistants.
• Experience measuring AI quality through evaluation frameworks and user feedback.
• Experience with embeddings and vector databases.
• Experience with model adaptation techniques such as fine-tuning, LoRA, parameter-efficient fine-tuning (PEFT), or similar approaches.
• Familiarity with infrastructure management, IT operations, or enterprise SaaS platforms.

Location

Hybrid - Bangalore

Travel

As needed