Senior Principal Systems Software Engineer - GPU Spark

NVIDIA Corporation; Champaign (IL); On-site; USD 272,000 - 431,000; Full time

Job summary

NVIDIA Corporation in Champaign, IL seeks a Sr. Principal Systems Software Engineer for the Apache Spark Acceleration group.

You will develop Java, Scala and CUDA/C++ libraries to accelerate Spark/DataFrame workloads, integrate with Parquet/ORC/JSON, and enable interoperability with Iceberg/Delta Lake and Unity Catalog. You’ll contribute to cuDF, CCCL, UCX, and other OSS projects while tackling large-scale distributed processing challenges.

Qualifications

• 15+ years of work experience in software development.
• Excellent programming skills in C++, Java, and/or Scala.
• Outstanding technical skills in designing and implementing high-quality distributed systems.
• Familiarity with the open source data platform ecosystem (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, etc.). Meaningful contributions to the OSS community a plus.

Responsibilities

• Develop Java, Scala and CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats such as Parquet, ORC and JSON
• Enable interoperability with table formats such as Apache Iceberg and Delta Lake, and metastores such as Unity Catalog
• Work with open source communities to enhance libraries like NVIDIA cuDF, CCCL and UCX through technical discussion and code contributions
• Collaborate with distributed systems teams to craft solutions to distributed processing problems challenges at large scale
• Provide recommendations and feedback to teams regarding decisions surrounding topics such as infrastructure, continuous integration and testing strategy
• Build, test and optimize CUDA/C++ libraries across different platforms

Skills

Distributed systems design

Java programming

C++ programming

Scala programming

Team collaboration

Education

BS/MS/PhD in Computer Science or Computer Engineering

Tools

CUDA/C++

Java

Scala

cuDF

CCCL

UCX

Apache Spark

Job description

NVIDIA Corporation in Champaign, IL seeks a Sr. Principal Systems Software Engineer for the Apache Spark Acceleration group.

You will develop Java, Scala and CUDA/C++ libraries to accelerate Spark/DataFrame workloads, integrate with Parquet/ORC/JSON, and enable interoperability with Iceberg/Delta Lake and Unity Catalog. You’ll contribute to cuDF, CCCL, UCX, and other OSS projects while tackling large-scale distributed processing challenges.