Principal Systems Software Engineer

Jobtailor; California (MO); On-site; USD 150,000 - 230,000; Full time

Job summary

Jobtailor is seeking a senior software engineer to develop Java, Scala and CUDA/C++ libraries to accelerate DataFrames and I/O on Parquet, ORC and JSON formats.

You will collaborate with open source communities and distributed systems teams to optimize performance across platforms, contribute to cuDF, CCCL and UCX, and influence infrastructure, CI and testing strategies to keep us at the cutting edge. The role emphasizes leadership in OSS collaborations and high-performance computing.

Qualifications

• 15+ years of software development experience.
• Strong distributed systems design and implementation skills.
• Excellent C++, Java, and/or Scala programming abilities.
• Ability to collaborate across cross-functional teams.
• Familiarity with OSS data platform ecosystem; contributions welcome.
• Strong interpersonal skills.
• Database query optimization is a strong plus.

Responsibilities

• Develop Java, Scala and CUDA/C++ libraries to accelerate DataFrames and I/O operations on Parquet, ORC and JSON.
• Enable interoperability with Iceberg and Delta Lake, and metastores like Unity Catalog.
• Contribute to open source projects such as cuDF, CCCL and UCX.
• Collaborate with distributed systems teams to address large-scale distributed processing challenges.
• Provide feedback on infrastructure, CI and testing strategies.
• Build, test and optimize CUDA/C++ libraries across platforms.

Skills

Java

Scala

CUDA/C++

Distributed systems

C++

Open source contributions

Education

BS/MS/PhD in Computer Science/Computer Engineering or related field

Tools

Apache Spark

Iceberg

Delta Lake

Unity Catalog

cuDF

CCCL

UCX

Job description

Responsibilities

• Develop Java, Scala and CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats such as Parquet, ORC and JSON
• Enable interoperability with table formats such as Apache Iceberg and Delta Lake, and metastores such as Unity Catalog
• Work with open source communities to enhance libraries like NVIDIA cuDF, CCCL and UCX through technical discussion and code contributions
• Collaborate with distributed systems teams to craft solutions to distributed processing problems challenges at large scale
• Provide recommendations and feedback to teams regarding decisions surrounding topics such as infrastructure, continuous integration and testing strategy
• Build, test and optimize CUDA/C++ libraries across different platforms

Requirements

• BS, MS, or PhD in Computer Science, Computer Engineering, or closely related field (or equivalent experience)
• 15+ years of work experience in software development
• Outstanding technical skills in designing and implementing high-quality distributed systems
• Excellent programming skills in C++, Java, and/or Scala
• Ability to work with teams across organizational boundaries and geographies
• Familiarity with the open source data platform ecosystem (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, etc.). Meaningful contributions to the OSS community a plus.
• Highly motivated with strong interpersonal skills
• Database query optimization is a strong plus

Core Competencies

Demonstrates expertise in developing high-quality distributed systems using Java, Scala, and CUDA/C++. Proficient in optimizing libraries for data processing and contributing to open source projects within the data platform ecosystem.