Sr. Software Engineer - Applied AI

Penguin Solutions; Bengaluru; Hybrid; INR 600,000 - 900,000; Full time

Job summary

Penguin Solutions is seeking a Senior Applied AI Engineer to translate customer workflows into AI-powered experiences using large language models and retrieval systems. You will collaborate with Product Management and engineering to rapidly prototype and deliver production-ready AI capabilities.

This role focuses on building AI-powered workflows for infrastructure tasks, designing prompts and integrations, and advancing LLM-based copilots for enterprise use.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 5+ years of software engineering with hands-on AI development.
• Strong Python programming with Pytest or equivalent.
• Experience building apps using LLM APIs, agent frameworks, or orchestration tech.
• Experience with prompt engineering and retrieval techniques (RAG).
• Strong understanding of REST APIs and enterprise integrations.
• Excellent problem-solving and communication skills.

Responsibilities

• Develop AI-powered workflows that automate infrastructure tasks.
• Design prompts, tool integrations, and reasoning workflows for enterprise use cases.
• Build retrieval, knowledge-grounding, and context management using retrieval-augmented generation (RAG).
• Evaluate AI quality and continuously improve accuracy, reliability, and user experience.
• Integrate AI capabilities with enterprise systems, APIs, and the ClusterWareAI platform.
• Collaborate with Product Management and engineering teams to rapidly prototype and deliver AI features.
• Stay current with advances in LLMs, agentic AI, and emerging AI technologies for customer value.

Skills

Python programming

AI application development

Problem-solving

Communication

REST APIs

Prompt engineering

LLM orchestration

Education

Bachelor's degree in Computer Science/Engineering or related field

Tools

Pytest

LLM APIs

LangChain (preferred)

RAG

APIs & integration tooling

Job description

At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide.

Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.

Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.

At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.

Job Overview

We are looking for a Senior Applied AI Engineer to build intelligent capabilities for the ClusterWareAI AI Operational Agent. This role will focus on translating customer and operational workflows into AI-powered experiences using large language models, retrieval systems, and enterprise integrations.

You will work closely with Product Management, AI Platform Engineering, and software engineering teams to rapidly prototype, develop, and deliver production-ready AI capabilities.

Responsibilities

• Develop AI-powered workflows that automate infrastructure and operational tasks.
• Design prompts, tool integrations, and reasoning workflows for enterprise use cases.
• Build retrieval, knowledge-grounding, and context management solutions using retrieval-augmented generation (RAG).
• Evaluate AI quality and continuously improve accuracy, reliability, and user experience.
• Integrate AI capabilities with enterprise systems, APIs, and the ClusterWareAI platform.
• Collaborate with Product Management and engineering teams to rapidly prototype and deliver AI features.
• Stay current with advances in LLMs, agentic AI, and emerging AI technologies, applying them where they create customer value.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of software engineering experience, including hands-on AI application development.
• Strong Python programming skills, including experience with Python testing frameworks such as Pytest or equivalent.
• Experience building applications using LLM APIs, agent frameworks, or similar AI orchestration technologies.
• Experience with prompt engineering and retrieval techniques, including RAG.
• Strong understanding of REST APIs and enterprise integrations.
• Excellent problem-solving and communication skills.

Preferred Qualifications

• Experience with LangChain, LangGraph, Semantic Kernel, LlamaIndex, AutoGen, or similar AI frameworks.
• Experience building enterprise copilots or AI assistants.
• Experience measuring AI quality through evaluation frameworks and user feedback.
• Experience with embeddings and vector databases.Experience with model adaptation techniques such as fine-tuning, LoRA, parameter-efficient fine-tuning (PEFT), or similar approaches.
• Familiarity with infrastructure management, IT operations, or enterprise SaaS platforms.

Location

Hybrid - Bangalore

Travel

As needed