Lead AI Systems Architect — Edge & Cloud

NIO; San Francisco (CA); On-site; USD 192,100 - 249,600; Full time

Benefits offered by this job

Medical plans

Dental & vision

HSA contribution

Flexible Spending Accounts (FSA)

401(k)

Job summary

NIO is seeking a senior leader to architect Hybrid AI Vision, orchestrate cross‑functional engineering efforts, and drive performance for edge and cloud inference. You will shape strategic roadmaps, mentor engineers, and ensure resilient, scalable AI systems across distributed environments.

The role requires deep expertise in distributed systems, AI model serving, and compiler engineering, with a focus on performance optimizations and hardware-aware deployment.

Qualifications

• Ph.D. in CS/CE/AI with 8+ years leadership experience.
• Master's with 12+ years in leading AI/infra roadmaps.

Responsibilities

• Architect the Hybrid AI Vision and lead architectural design for hybrid inference systems.
• Lead, mentor, and inspire a team of engineers across distributed systems orchestration and AI compiler engineering.
• Oversee high-availability orchestration engines with dynamic model fallback and robust telemetry.

Skills

Distributed systems

Inference optimization

C++ / Python

Education

Ph.D. in CS/CE/AI

M.S. with 12+ years

Tools

vLLM

TensorRT-LLM

MLIR

Apache TVM

Triton

llama.cpp

Job description

NIO is seeking a senior leader to architect Hybrid AI Vision, orchestrate cross‑functional engineering efforts, and drive performance for edge and cloud inference. You will shape strategic roadmaps, mentor engineers, and ensure resilient, scalable AI systems across distributed environments.

The role requires deep expertise in distributed systems, AI model serving, and compiler engineering, with a focus on performance optimizations and hardware-aware deployment.