Sr. Staff Engineer, Lustre

DDN; North Carolina; Hybrid; USD 180.000 - 240.000; Vollzeit

Zusammenfassung

DDN is seeking a Staff Engineer with 10+ years in distributed storage and Linux-based systems engineering to lead hands-on design and debugging for LustreFS and related components.

You will drive investigations, optimize performance, and ensure operational excellence across llite, MDS/MDT, OSS/OST, LDLM and LNet, collaborating with QE, support and release teams. Strong C and Linux skills plus AI-assisted tooling are highly valued.

Qualifikationen

• 10+ years in systems software or distributed storage.
• Strong LustreFS experience with depth in at least one subsystem.
• Proficient C programming and Linux debugging skills.
• Knowledge of Linux kernel internals, filesystem semantics, networking, performance.
• Experience with high-performance transports and multi-layer debugging.

Aufgaben

• Design, develop and debug LustreFS features across subsystems.
• Investigate scale defects, perform root-cause analysis and fixes.
• Contribute to performance tuning and reliability improvements for large-scale deployments.
• Participate in code and design reviews with rigorous testing practices.
• Collaborate with QE and support to improve diagnostic data and coverage.
• Document subsystem behavior, debugging approaches and best practices.
• Leverage AI-assisted tools to speed up triage and design ideation.

Kenntnisse

C programming

Linux debugging

LustreFS development

Systems troubleshooting

AI-assisted debugging

Tools

LustreFS tooling

RDMA / InfiniBand / TCP storage networking

LNet knowledge

Jobbeschreibung

We are seeking a Staff Engineer with 10+ years of experience in distributed storage and Linux-based systems engineering. This is a hands-on senior technical role focused on design, debugging, performance, and operational excellence across LustreFS and adjacent stack components. The ideal candidate brings strong expertise in one or more Lustre subsystems, can independently drive complex investigations, and collaborates effectively across engineering, QE, support and release teams. Engineers who are comfortable using AI to accelerate triage, debugging, code comprehension and new feature design will be especially valuable.

Key Responsibilities

• Design, develop and debug LustreFS features, fixes and enhancements across relevant subsystems such as llite, MDS/MDT, OSS/OST, LDLM and LNet.

• Investigate customer and scale-related defects, drive root-cause analysis and implement high-quality fixes with strong attention to correctness and maintainability.

• Contribute to performance tuning, failure analysis and reliability improvements for large-scale Lustre deployments.

• Participate actively in code reviews, design reviews and subsystem discussions, bringing rigor to testing and operational readiness.

• Work closely with QE and support to reproduce issues, improve diagnostic data quality and increase coverage for high-risk failure scenarios.

• Help document subsystem behavior, debugging approaches, known failure patterns and operational best practices.

• Use AI-assisted tools where appropriate to speed up issue triage, summarize logs, improve code understanding and capture reusable lessons learned.

Required Qualifications

• 10+ years of experience in systems software, distributed systems, storage, Linux kernel or filesystem engineering.

• Strong experience in LustreFS development, support or performance engineering with depth in at least one major subsystem.

• Strong C programming and Linux systems debugging skills.

• Working knowledge of Linux kernel internals, filesystem semantics, networking and performance analysis.

• Experience with LNet and/or high-performance transports such as RDMA, InfiniBand, RoCE or TCP-based storage networking.

• Ability to debug and resolve issues spanning multiple layers including client, server, network and backend storage.

• Strong collaboration skills and the ability to work across functions in a fast-moving engineering environment.

Preferred Skills

• Experience in HPC, AI infrastructure or large-scale parallel storage environments.

• Exposure to metadata-heavy and throughput-heavy workload characterization and tuning.

• Familiarity with ZFS, ldiskfs, NVMe-backed storage and related observability / performance tooling.

• Experience creating test plans, reproducer frameworks, runbooks or diagnostic automation.

• Comfort using AI tools to accelerate debugging, code reviews, triage, documentation and early-stage design ideation.

• Experience mentoring junior engineers or leading focused technical efforts within a subsystem.

What You Will Work On

• Hands-on development and debugging of LustreFS defects, performance issues and subsystem enhancements.

• Customer-facing and scale-related issue investigation across llite, metadata, object storage, LNet and transport layers.

• Collaborative design and implementation of reliability, observability and serviceability improvements.

• Reviewing and validating fixes through targeted tests, failure injection, log analysis and performance characterization.

• Using AI-assisted workflows to accelerate triage, debug loops, code understanding and documentation quality.

• Contributing to team redundancy by strengthening documentation, code review quality and subsystem knowledge sharing.

Why This Role Matters

This role is central to building durable engineering redundancy in LustreFS: expanding deep subsystem ownership, reducing concentration risk, and accelerating next-generation delivery through strong engineering fundamentals and AI-enabled execution.