Senior Software Engineer, Data Ingestion - Autonomous Vehicles

NVIDIA; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Software Engineer to advance the data ingestion platform for Autonomous Vehicles Infrastructure. You will own pipelines that bring data from diverse sources into AV systems and ensure efficient serving for multiple teams.

The role demands deep distributed-systems expertise, Go and C++, and experience with streaming tech like Kafka/RabbitMQ in Linux. Equity and comprehensive benefits accompany the base compensation.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field (or equivalent).
• 8+ years of relevant experience in autonomous vehicles or software infrastructure.
• Experience building distributed data pipelines for large-scale systems.
• Strong data warehousing concepts, data modeling, and DBMS knowledge.

Responsibilities

• Implement and maintain data ingestion pipelines from diverse sources for AV data.
• Design and optimize data serving mechanisms for real-time and batch access.
• Monitor pipelines to ensure data availability and reliability.
• Collaborate with cross-functional teams to improve processing efficiency and reduce latency.
• Implement data validation and quality checks for ingested data.
• Scale data infrastructure to accommodate growing AV data volumes.
• Create and maintain documentation for ingestion and serving processes.
• Work with AV teams to understand data requirements and enhance data-driven solutions.

Skills

Go

C++

Python

Linux

Distributed systems

Data ingestion

Kafka

RabbitMQ

Cloud platforms

Education

Bachelor's degree in CS/Engineering

Tools

Apache Spark

Hadoop

Job description

NVIDIA is hiring a Senior Software Engineer to work on improving the data ingestion platform in our Autonomous Vehicles division! As a Data Ingestion engineer for Autonomous Vehicles Infrastructure, you will play a crucial role in managing and optimizing the flow of data from various sources into our AV systems. Your primary focus will be on ensuring the seamless ingestion and efficient serving of AV data to support critical operations.

What you'll be doing:

• Implement and maintain data ingestion pipelines from diverse sources, ensuring a continuous and reliable flow of AV data into the system.
• Design and optimize data serving mechanisms to deliver AV data to different teams and applications in real-time and batch processing scenarios.
• Monitor data pipelines and services to proactively identify and resolve any issues, ensuring data availability and reliability.
• Collaborate with cross-functional teams to improve data processing efficiency, reduce latency, and enhance overall system performance.
• Implement validation and data quality checks to ensure the integrity and accuracy of ingested data.
• Scale data infrastructure to handle the ever-increasing volumes of AV data generated by our expanding fleet of vehicles.
• Create and maintain detailed documentation for data ingestion and serving processes, ensuring knowledge sharing across the team.
• Work closely with the AV development team to understand data requirements and contribute to the enhancement of data-driven solutions.

What we need to see:

• Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
• 8+ years of relevant experience working on autonomous vehicles and/or software infrastructure.
• Extensive expertise in developing distributed systems.
• Proven experience in designing and building data ingestion pipelines for large-scale systems.
• Strong proficiency in data warehousing concepts, data modeling, and database management systems.
• Proficient in Go, C++ and have experience with scripting languages such as Python or Matlab in a Linux environment
• Familiarity with distributed computing frameworks like Apache Spark or Hadoop.
• Hands-on experience with data streaming technologies (e.g., Kafka, RabbitMQ) is a plus.
• Knowledge of cloud-based platforms (AWS, GCP, or Azure) and containerization (Docker/Kubernetes).
• Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.

The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.