Senior AI Data Pipeline Engineer

Socket.dev; United States; Remote; USD 184,000 - 357,000; Full time

Job summary

NVIDIA is seeking a senior software engineer to design and optimize microservices and data pipelines for processing massive autonomous vehicle data and enabling AI training. You will build scalable ETL workflows, deploy AI models, and engineer streaming, logging, security, and data-management capabilities in a high-performance environment.

You will collaborate with AI and system software teams, adopt new technologies such as NVIDIA RAPIDS, and contribute to RAG-based workflows for hybrid and

Qualifications

• Experience developing high-performance, scalable software systems.
• MS with 6+ years, or BS (or equivalent experience) with 8+ years of relevant experience in Computer Science, Computer Engineering, or a related technical field.
• Strong programming skills in Python or Golang
• Proficiency in Kubernetes, Helm, Hive, Parquet, SQL, vector databases, e.g., Milvus.
• Strong architectural skills with a proactive, problem-solving mentality.
• Experience in data mining | AI development
• Experience building ETL pipelines and working with big data engines.
• Exceptional collaboration skills to work with system software and AI expert teams.
• Eagerness to learn and adopt new technologies such as NVIDIA RAPIDS.

Responsibilities

• Scope and build tools, microservices, workflows, and distributed applications to accelerate data mining and AI training.
• Design and implement solutions for streaming, resilience, logging, security, authentication, workflow orchestration, and data management.
• Deploy AI models.
• Design and develop Retrieval-Augmented Generation (RAG) workflows enabling hybrid and agentic patterns.
• Analyze and operationalize complex distributed systems for speed-of-light performance.

Skills

High-performance software

Python

Golang

Data mining

AI development

ETL pipelines

Big data engines

Collaboration

NVIDIA RAPIDS

Microservices design

Distributed computing

Education

MS with 6+ years, or BS with 8+ years in Computer Science/Engineering

Tools

Kubernetes

Helm

Hive

Parquet

SQL

Milvus

Job description

NVIDIA is seeking a senior software engineer to design and optimize microservices and data pipelines for processing massive autonomous vehicle data and enabling AI training. You will build scalable ETL workflows, deploy AI models, and engineer streaming, logging, security, and data-management capabilities in a high-performance environment.

You will collaborate with AI and system software teams, adopt new technologies such as NVIDIA RAPIDS, and contribute to RAG-based workflows for hybrid and