Senior Data Platform Architect – Scalable Web Crawling

NVIDIA Corporation; Zürich; On-site; CHF 250,000 - 380,000; Full time

Job summary

NVIDIA Corporation in Switzerland seeks an engineering lead to architect and scale the data acquisition infrastructure powering our foundation models. You will own the platform from source discovery through ingestion, ensuring high throughput, reliability, and quality data for training pipelines.

This hands‑on leadership role spans distributed systems, crawl infrastructure, and third‑party data ingestion. You will mentor engineers, drive architecture reviews, and partner with research, product,

Qualifications

• Bachelor's, Master's, or PhD in CS/CE or related field, or equivalent experience.
• 15+ years building large-scale distributed systems and data infrastructure.
• Hands-on engineering with web crawling, data ingestion, and scheduling.

Responsibilities

• Design scalable frontier storage and queueing with high-throughput writes and efficient lookups.
• Build a shared crawl execution layer that handles dynamic websites at scale.
• Develop pipelines for open-web, licensed, and partner content, including code and multimodal data.
• Translate requirements into stable interfaces and auditable data governance controls.

Skills

Distributed systems design

Web crawling

Data pipelines

System architecture

Technical leadership

Education

BS/MS/PhD in Computer Science or related field

Job description

NVIDIA Corporation in Switzerland seeks an engineering lead to architect and scale the data acquisition infrastructure powering our foundation models. You will own the platform from source discovery through ingestion, ensuring high throughput, reliability, and quality data for training pipelines.

This hands‑on leadership role spans distributed systems, crawl infrastructure, and third‑party data ingestion. You will mentor engineers, drive architecture reviews, and partner with research, product,