Principal Data Processing Optimization Engineer

NetApp, Inc.; San Jose, Northern (CA, KY); Hybrid; USD 228,000 - 339,000; Full time

Benefits offered by this job

Health insurance

Employee stock purchase plan

Paid time off

Job summary

NetApp, Inc. is seeking a Senior/Principal Data Processing Optimization Engineer in San Jose, CA. You will advance planner and optimization capabilities to maximize performance and cost efficiency for open-source SQL and Python workloads on CPU and GPU infrastructure.

This role offers hybrid work, engaging with DataPelago acceleration and Spark/Flink integrations, and the opportunity to influence product-wide optimization strategies and customer deployments.

Qualifications

• 15+ years of experience in query planning and optimization.
• At least 5+ years on Spark, Presto/Trino, or Flink.
• Strong SQL semantics and Python processing preferred.
• Deep knowledge of databases and data warehouses.

Responsibilities

• Research, design, and implement query plan optimization techniques.
• Integrate with Spark and Flink engines.
• Ensure performance in customer deployments.
• Establish metrics for plan quality and performance.
• Lead major components and provide technical leadership.
• Collaborate with teams and mentor juniors.

Skills

Query optimization

Parallel processing

SQL processing

Python processing

Distributed systems

Education

BSc in CS

Master/PhD preferred

Tools

Apache Spark

Presto/Trino

Apache Flink

Job description

NetApp, Inc. is seeking a Senior/Principal Data Processing Optimization Engineer in San Jose, CA. You will advance planner and optimization capabilities to maximize performance and cost efficiency for open-source SQL and Python workloads on CPU and GPU infrastructure.

This role offers hybrid work, engaging with DataPelago acceleration and Spark/Flink integrations, and the opportunity to influence product-wide optimization strategies and customer deployments.