Senior Data Processing Engineer - OSS & Engine Architect

NetApp, Inc.; San Jose (CA); Hybrid; USD 196,000 - 293,000; Full time

Benefits offered by this job

Health Insurance

Retirement Plans

Paid Time Off

RSUs

Job summary

NetApp is seeking a Senior/Principal Data Processing Engineer - OSS to advance open-source platforms within DataPelago’s engine. You will enhance interfaces with Spark, Flink, Gluten, Velox, and related ecosystems, contributing to scalable, production-grade data processing solutions.

Ideal candidates bring 12+ years in CS with deep Spark/Flink experience, strong C/C++/Java skills, and a track record of delivering high-performance engines on Linux in hybrid environments.

Qualifications

• 12+ years of relevant experience with computer science degree
• 3+ years of deep technical experience in developing core components of open-source data processing platforms
• 3+ years of instrumenting, analyzing, and optimizing performance of data processing engines
• Strong knowledge of Spark, Flink, Presto/Trino architectures
• Proven release of high-performance data processing engines in production
• Exceptional programming in C, C++, and Java
• Extensive development experience in Linux environments
• Strong analytical and problem-solving skills with a passion for performance optimization

Responsibilities

• Architect how the data processing engine interfaces with OSS platforms
• Lead design of functional and performance enhancements in Spark, Flink, Gluten, Velox integration
• Develop, test, optimize, and maintain components of the data processing engine
• Analyze technology roadmaps to identify opportunities for differentiation
• Collaborate with engineering, product, OSS community and customer success teams
• Foster best practices in design reviews, testing, CI/CD, and issue resolution

Skills

C

C++

Java

Linux

Spark

Flink

Education

Bachelor's in Computer Science

Master's in Computer Science

Tools

Apache Gluten

Velox

Apache Spark

Apache Flink

Presto/Trino

Job description

NetApp is seeking a Senior/Principal Data Processing Engineer - OSS to advance open-source platforms within DataPelago’s engine. You will enhance interfaces with Spark, Flink, Gluten, Velox, and related ecosystems, contributing to scalable, production-grade data processing solutions.

Ideal candidates bring 12+ years in CS with deep Spark/Flink experience, strong C/C++/Java skills, and a track record of delivering high-performance engines on Linux in hybrid environments.