AI Solution Architect (US)

Penguin Computing; United States; On-site; USD 130,000 - 162,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plan

Paid Time Off

Life Insurance

Job summary

Penguin Computing is seeking an experienced AI Solution Architect to lead pre-sales technical discussions and design end-to-end AI solutions using NVIDIA technology. This remote position will engage directly with clients, translating complex challenges into actionable solutions.

The ideal candidate will have at least 7 years of experience in pre-sales roles and exceptional communication skills. A comprehensive compensation package is provided including medical benefits, retirement plans, and paid time off.

Qualifications

• 7+ years of experience in a customer-facing, pre-sales technical role.
• Hands-on experience with designing complex enterprise systems.
• Strong ability to present complex topics to diverse audiences.

Responsibilities

• Lead technical discussions with prospective clients.
• Design comprehensive, end-to-end AI solutions.
• Serve as primary technical author for project proposals.

Skills

Presentation skills

Communication skills

Project management

Technical expertise in AI/ML

Tools

NVIDIA AI Software Stack

Kubernetes

AWS

Azure

GCP

Job description

Overview

As an AI Solution Architect, you will be the lead technical visionary in our pre‑sales process, acting as the trusted advisor to our clients and the technical conscience for our sales team. You will be responsible for translating complex customer challenges into elegant, feasible, and compelling end‑to‑end AI solutions. This is a deeply technical, customer‑facing role where you will have the opportunity to design cutting‑edge agentic AI systems on the industry‑leading NVIDIA AI Enterprise platform. If you are a master of the whiteboard, passionate about solving complex problems, and skilled at bridging the gap between business objectives and technical implementation, this role is for you.

Responsibilities

Lead Pre‑Sales Technical Discussions

• Engage directly with prospective clients to lead deep technical discovery sessions. You will be responsible for understanding and documenting their business goals, technical requirements, and operational constraints.

Design End‑to‑End Solutions

• Act as the lead architect in designing comprehensive, end‑to‑end agentic AI solutions. Your designs will be centered on the NVIDIA AI Enterprise platform and will encompass the full stack, from hardware and networking to MLOps and application layers.

Act as Primary Technical Author

• Serve as the primary technical author for all service project proposals, statements of work (SOWs), and detailed architectural documentation. You will ensure that every solution is technically sound, feasible, and directly aligned with the customer's business objectives.

Present and Defend Solutions

• Drive the presentation of all technical and architectural proposal content. You must be able to confidently present to a wide range of audiences, from deeply technical engineers to C‑level executives, and handle challenging questions and objections.

Manage Technical Scope and Timelines

• Concurrently manage multiple project design and architecture development activities. You will be responsible for clearly communicating project deliverables, milestones, potential risks/mitigations, and likely development and delivery timelines to both customers and internal teams.

Stay on the Cutting Edge

• You will be expected to remain up to date on the latest full‑stack AI software, hardware, and delivery capabilities to ensure that Penguin's solutions are always best‑in‑class.

Qualifications

• 7+ years of experience in a customer‑facing, pre‑sales technical role such as Solutions Architect, Pre‑Sales Engineer, or a similar capacity.
• Deep, hands‑on experience designing complex, large‑scale enterprise systems (e.g., in AI/ML, HPC, Big Data, or enterprise software).
• Exceptional presentation, whiteboarding, and communication skills, with a demonstrated ability to present complex technical topics to both technical and non‑technical audiences.
• Proven ability to manage multiple, concurrent design and architecture projects in a fast‑paced sales environment.
• A strong understanding of the interplay between software, hardware, and networking in modern data center environments.

Preferred Qualifications

• Deep technical expertise with the NVIDIA AI software stack (NVIDIA AI Enterprise, Triton Inference Server, NeMo, TensorRT‑LLM, etc.) and underlying hardware platforms (e.g., DGX, HGX).
• Experience designing solutions for LLM inference, agentic AI systems, or other advanced AI workloads.
• Experience with both public cloud (AWS, Azure, GCP) and on‑premises infrastructure deployments.
• Familiarity with MLOps principles, CI/CD, and container orchestration (Kubernetes).

Location

This is a remote position in the United States.

Travel

Flexible (with travel to client sites and Penguin Solutions offices as needed)

Compensation & Benefits

The base pay range that the Company reasonably expects to pay for this position in the United States is $130,000 - $162,000; the pay ultimately offered may vary based on business considerations, including job‑related knowledge, skills, experience, and education. The position is bonus‑eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan.

Inclusion & Belonging Statement

We are committed to creating an inclusive environment that embraces differences and fosters belonging for all.