Senior Data Ingestion Engineer - AVs

Socket.dev; Santa Clara (UT); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Software Engineer to advance the data ingestion platform for Autonomous Vehicles Infrastructure. You will own building and optimizing ingestion pipelines, data serving, and quality checks to support AV data needs across teams.

Required 8+ years in distributed systems with Go/C++ proficiency and Linux scripting. The role involves collaboration with AV teams, cloud platforms, and containerized services, with equity and benefits offered.

Qualifications

• Bachelor's degree or equivalent experience in CS/engineering.
• 8+ years of relevant experience in autonomous vehicles or software infrastructure.
• Extensive experience building distributed systems.
• Proven track record designing and building large-scale ingestion pipelines.
• Strong data warehousing, data modeling, and DBMS knowledge.
• Proficiency in Go and C++, plus Python or Matlab in Linux.
• Familiarity with Spark or Hadoop.
• Experience with data streaming (Kafka, RabbitMQ) is a plus.
• Knowledge of AWS/GCP/Azure and Docker/Kubernetes.

Responsibilities

• Implement and maintain data ingestion pipelines from diverse sources.
• Design and optimize data serving mechanisms in real-time and batch modes.
• Monitor data pipelines to ensure availability and reliability.
• Collaborate across teams to improve processing efficiency and latency.
• Implement data quality checks to ensure integrity.
• Scale data infrastructure for increasing AV data volumes.
• Create and maintain documentation for ingestion and serving processes.
• Work with the AV development team to align data requirements.

Skills

Distributed systems

Data ingestion pipelines

Go and C++

Data warehousing

Cloud platforms

Docker/Kubernetes

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Kafka

Hadoop

Spark

SQL

Job description

NVIDIA is seeking a Senior Software Engineer to advance the data ingestion platform for Autonomous Vehicles Infrastructure. You will own building and optimizing ingestion pipelines, data serving, and quality checks to support AV data needs across teams.

Required 8+ years in distributed systems with Go/C++ proficiency and Linux scripting. The role involves collaboration with AV teams, cloud platforms, and containerized services, with equity and benefits offered.