GPU-Accelerated Spark Systems Engineer

NVIDIA; Champaign (IL); On-site; USD 224,000 - 356,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA in Champaign, IL seeks a Sr. Systems Software Engineer for the Apache Spark Acceleration group to push GPU-accelerated data processing at scale.

You will implement native C++/CUDA for Spark operations, build libraries for DataFrames, and work with open source communities to drive performance and reliability. Ideal candidates bring 9+ years of software development, strong C++, Java, and Scala skills, and experience with enterprise data platforms.

Qualifications

• 9+ years of experience in software development
• 5+ years hands on experience with data platform development
• BS/MS/PhD in computer science or a related field (or equivalent experience)
• Proficiency in C++, Java, Scala
• Experience supporting enterprise customers
• Familiarity with the open source data platform ecosystem is a plus (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, etc.)
• Experience using AI tools in software development

Responsibilities

• Enable C++ native execution of Spark operations on CUDA
• Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats such as Parquet, ORC and JSON
• Collaborate with distributed systems teams to craft solutions to distributed processing problems at large scale
• Work with open source communities to enhance libraries like RAPIDS, CCCL and UCX through technical discussion and code contributions
• Provide recommendations and feedback to teams regarding decisions surrounding infrastructure, CI and testing strategy
• Build, test and optimize across different platforms

Skills

C++

Java

Scala

Education

BS/MS/PhD in computer science

Tools

CUDA

RAPIDS

UCX

Job description

NVIDIA in Champaign, IL seeks a Sr. Systems Software Engineer for the Apache Spark Acceleration group to push GPU-accelerated data processing at scale.

You will implement native C++/CUDA for Spark operations, build libraries for DataFrames, and work with open source communities to drive performance and reliability. Ideal candidates bring 9+ years of software development, strong C++, Java, and Scala skills, and experience with enterprise data platforms.