Senior AI Data Pipeline Architect

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Job summary

NVIDIA Corporation is seeking a senior software leader to design and optimize high-performance data pipelines for autonomous vehicle AI workloads. The role focuses on scalable microservices, distributed processing, and state-of-the-art data architectures to enable rapid AI training and data mining.

Ideal candidates bring 6+ years MS or 8+ years BS-equivalent experience, strong Python or Golang skills, and hands-on expertise with Kubernetes, Hive, Parquet, SQL, and Milvus.

Qualifications

• MS with 6+ years, or BS with 8+ years of relevant experience in CS/CE or related field.
• Strong programming skills in Python or Golang.
• Experience with Kubernetes, Helm, Hive, Parquet, SQL, vector databases like Milvus.
• Excellent architectural skills and problem-solving mindset.

Responsibilities

• Scope and build tools, microservices, workflows, and distributed apps to accelerate data mining and AI training.
• Design and implement streaming, resilience, logging, security, authentication, orchestration, and data management solutions.
• Deploy AI models.
• Design and develop Retrieval-Augmented Generation (RAG) workflows for hybrid/agentic patterns.
• Analyze and optimize complex distributed systems for speed-of-light performance.

Skills

Python

Golang

Kubernetes

Helm

Hive

Parquet

SQL

Milvus

Data mining

ETL pipelines

Education

MS degree

BS degree

Tools

Milvus

Spark

Job description

NVIDIA Corporation is seeking a senior software leader to design and optimize high-performance data pipelines for autonomous vehicle AI workloads. The role focuses on scalable microservices, distributed processing, and state-of-the-art data architectures to enable rapid AI training and data mining.

Ideal candidates bring 6+ years MS or 8+ years BS-equivalent experience, strong Python or Golang skills, and hands-on expertise with Kubernetes, Hive, Parquet, SQL, and Milvus.