Senior Software Engineer, Data Processing & CS

NetApp; San Jose (CA); Hybrid; USD 196,000 - 293,000; Full time

Job summary

NetApp is hiring a senior DataPelago software engineer focused on data processing validation and customer success. You will craft synthetic workloads, diagnose complex logs, and collaborate to prevent issues in production.

The role requires extensive Spark, SQL, and Python experience, with cloud deployment knowledge across SaaS, VM, container, and serverless environments. A hybrid work model supports collaboration and impact.

Qualifications

• Bachelor’s degree in computer science or related field.
• 12+ years of experience developing, validating and supporting enterprise data processing software.
• 2+ years of experience providing direct support to external customers.
• 2+ years of experience supporting Apache Spark pipelines for data engineering and analytics.
• Solid knowledge of SQL and Python.
• Proficient in testing data products and test automation.
• Good understanding of deployment and operations of data processing products and pipelines in the cloud (SaaS, VM-based, container-based, and serverless). Experience with GCP, AWS and their Apache Spark offerings preferred.
• Good customer engagement and communication skills.

Responsibilities

• Develop synthetic workload queries and datasets for testing DPA-S, reflecting real field environments.
• Develop analysis and diagnostic tools that analyze logs from DPA-S, Spark, and deployment environment to pinpoint root causes and mitigations.
• Field and address or elevate customer support issues as part of the product support rotation.
• Conduct end-to-end product validation, collaborating with others to define, review, and execute test plans.
• Analyze artifacts from product validation testing and issues raised by customers to identify configuration tuning opportunities, product usage recommendations, and bugs.
• Leverage automation and AI techniques effectively in the entire process of product validation and product support.
• Create bug reports, RCA documents, configuration guides, and best practice documents.

Skills

SQL

Python

Spark

Customer engagement

Test automation

Cloud deployment

Education

Bachelor's degree in CS or related field

Tools

Spark History Server

Spark UI

Job description

NetApp is hiring a senior DataPelago software engineer focused on data processing validation and customer success. You will craft synthetic workloads, diagnose complex logs, and collaborate to prevent issues in production.

The role requires extensive Spark, SQL, and Python experience, with cloud deployment knowledge across SaaS, VM, container, and serverless environments. A hybrid work model supports collaboration and impact.