Senior AI Compute & Data Infrastructure Architect

CDFAM - Computational Design Symposium

Palo Alto, Northern (CA, KY)

Hybrid

USD 180,000 - 240,000

Full time

4 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Vinci is hiring a senior infrastructure engineer in Palo Alto to own the compute and data architecture for large-scale physics training workloads. You will ensure scalable GPU capacity, efficient scheduling, and robust data pipelines to feed petabyte-scale datasets for AI research.

You will lead hands-on engineering, mentor new engineers, and set technical direction with the AI team and leadership. This role emphasizes reliability, cost control, and scalable experimentation.

Qualifications

  • 10+ years building large-scale distributed systems.
  • Direct experience with multi-node training on GPUs.
  • Experience serving petabyte-scale training data.
  • Ability to set scheduling and quota policies for GPUs.
  • Track record mentoring engineers and teaching across teams.
  • Ability to define technical direction and roadmaps.

Responsibilities

  • Define compute architecture for scalable GPU capacity.
  • Own workload scheduling across training and validation.
  • Design data infra to feed training jobs at scale.
  • Build and operate training/validation platform.
  • Ensure reliability, utilization, and cost targets.
  • Contribute production code and perform reviews.
  • Mentor team members and help grow the org.
  • Set long-term technical direction with leadership.

Skills

Distributed systems
GPU infrastructure
Multi-node training
Scheduling & quotas
Mentoring engineers
Technical direction
Cost optimization

Education

Advanced degree

Tools

Kubernetes
Ray
Slurm
Airflow

Job description

Vinci is hiring a senior infrastructure engineer in Palo Alto to own the compute and data architecture for large-scale physics training workloads. You will ensure scalable GPU capacity, efficient scheduling, and robust data pipelines to feed petabyte-scale datasets for AI research.

You will lead hands-on engineering, mentor new engineers, and set technical direction with the AI team and leadership. This role emphasizes reliability, cost control, and scalable experimentation.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Compute & Data Infrastructure Architect
Senior AI Compute & Data Infrastructure Architect

Vinci • Palo Alto (CA)

On-site
USD 180,000 - 240,000
AI Infrastructure Architect — Scalable GPU Compute
AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
Senior AI Infrastructure Solutions Architect
Senior AI Infrastructure Solutions Architect

VAST Data • New York (NY)

On-site
USD 150,000 - 200,000
Senior AI Infrastructure Engineer — Scale GPU Clusters
Senior AI Infrastructure Engineer — Scale GPU Clusters

AI Breaking Wire • San Francisco (CA)

On-site
USD 280,000 - 400,000
Equity
Medical, dental, and vision benefits
Unlimited PTO
+2
Senior Systems Engineer for Scalable AI Training Infra
Senior Systems Engineer for Scalable AI Training Infra

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Health insurance
Dental insurance
Vision insurance
+3
Foundation Model Architect & AI Infra – Production Scale
Foundation Model Architect & AI Infra – Production Scale

Vinci4D • Palo Alto (CA), Northern (KY)

Hybrid
USD 210,000 - 270,000
Senior AI Infrastructure Lead: GPU Clusters & LLMs
Senior AI Infrastructure Lead: GPU Clusters & LLMs

Cadence Design Systems • San Jose (CA)

On-site
USD 137,000 - 254,000
Senior GPU Compute Solutions Architect
Senior GPU Compute Solutions Architect

Computacenter AG & Co. oHG • Northern (KY)

Hybrid
USD 190,000 - 230,000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

AfterQuery • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior AI Compute Infrastructure Architect
Senior AI Compute Infrastructure Architect

Arm Limited • Seattle (WA)

Hybrid
USD 263,000 - 355,000
Relocation package
Visa sponsorship