Senior Solutions Engineer, AI Infrastructure

VAST Data; New York (NY); On-site; USD 150,000 - 200,000; Full time

Job summary

VAST Data is seeking a deeply technical Solutions Architect to design, evaluate, and deploy infrastructure for large-scale AI, HPC, and data-intensive workloads. This customer-facing role requires experience in production infrastructure and will focus on helping customers create reliable architectures involving GPUs and high-performance storage systems.

The ideal candidate will possess a strong technical background, including expertise in Linux, distributed systems, and Kubernetes. They will work closely with customers from the initial discovery session through to production success.

Qualifications

• 8 to 12+ years of technical experience with significant infrastructure experience.
• Ability to communicate with engineers and executives.
• Strong problem-solving and systems debugging skills.

Responsibilities

• Lead technical discovery with customers across infrastructure.
• Design architectures for large-scale AI and HPC workloads.
• Translate complex technical requirements into clear solution designs.

Skills

Linux kernel implementation

Distributed systems

Kubernetes

HPC systems

Problem-solving

Communication with stakeholders

Tools

Kubernetes

InfiniBand

CUDA

Job description

We're looking for a deeply technical Solutions Architect to help customers design, evaluate, and deploy infrastructure for large-scale AI, HPC, analytics, and data‑intensive workloads.

This is a customer‑facing technical role for someone who has lived inside production infrastructure. You may have been a platform engineer, infrastructure engineer, SRE, MLOps engineer, AI infrastructure engineer, storage engineer, cloud engineer, or HPC systems engineer. What matters most is that you have built, operated, or architected real systems, and can bring that credibility into customer conversations.

Our customers are building infrastructure at serious scale: GPU clusters, high‑performance storage systems, Kubernetes platforms, distributed training environments, inference platforms, data pipelines, lakehouses, and large enterprise systems. You'll help them reason about architectures involving 10,000+ GPUs, 100PB+ of storage, high‑performance networking, distributed filesystems, orchestration layers, and demanding production workloads.

You'll own technical discovery, architecture design, PoC planning, competitive positioning, and customer technical strategy. You'll work from the first whiteboard session through evaluation, deployment planning, and production success. You'll also partner closely with product and engineering teams to bring field feedback into the roadmap.

We're looking for someone who can go deep technically, communicate clearly, operate without a rigid playbook, and translate complex infrastructure into customer outcomes.

Responsibilities

• Lead technical discovery with customers across infrastructure, platform, ML, data, and executive stakeholders.
• Design architectures for large‑scale AI, HPC, analytics, and enterprise data workloads.
• Help customers evaluate infrastructure involving GPUs, storage, networking, orchestration, and data movement.
• Design and execute proofs of concept that validate performance, scale, reliability, and business value.
• Translate complex technical requirements into clear solution designs, reference architectures, and deployment guidance.
• Debug customer issues across Linux, storage, networking, Kubernetes, schedulers, GPUs, and application workloads.
• Build technical assets, demos, runbooks, and field guidance for repeatable customer engagements.
• Partner with sales on technical strategy, competitive positioning, and deal execution.
• Partner with product and engineering to communicate customer requirements, gaps, and roadmap opportunities.
• Help customers move from architecture design to production deployment.

Requirements

• 8 to 12+ years of technical experience, with significant hands‑on infrastructure experience.
• Experience building, operating, or architecting production platform infrastructure.
• Strong understanding of Linux kernel implementation details, distributed systems including PAXOS and raft, storage implementations details like NAND or write amplification, networking store/forward, load balancing designs, and production operations.
• Experience with one or more of: GPU infrastructure, large scale HPC systems, Kubernetes platforms from scratch, MLOps, storage systems, cloud infrastructure, data platforms, or large‑scale enterprise infrastructure.
• Ability to communicate credibly with engineers, architects, technical executives, and business stakeholders.
• Strong discovery, problem‑solving, and systems debugging skills.
• Comfort operating in ambiguous, fast‑moving environments.
• Interest in customer‑facing technical work, solution design, and business outcomes.

Preferred Experience

• Experience with large‑scale GPU clusters, distributed training, inference infrastructure, or AI platforms.
• Experience with petabyte‑scale storage or high‑performance data systems.
• Experience with Kubernetes, Slurm, Ray, Spark, or other orchestration/scheduling systems.
• Domain expertise with one or more of: Lustre, Ceph, Weka, BeeGFS, GPFS, VAST, object storage, or distributed filesystems.
• Experience with InfiniBand, RoCE, RDMA, high‑performance Ethernet, or NVIDIA/Mellanox networking.
• Direct experience with CUDA, NCCL, DCGM, GPUDirect, checkpointing, dataset staging, or model‑serving infrastructure.
• Experience across multiple industries or customer environments.