HPC Data Provenance – Postdoctoral Researcher

Lawrence Livermore National Laboratory

Livermore (CA)

On-site

USD 129,000 - 158,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Lawrence Livermore National Laboratory is seeking a Postdoctoral Researcher to advance data provenance, multi-layer tracing, and I/O characterization for large-scale HPC workflows. The role focuses on automatic provenance capture across application, runtime, and kernel layers using tracers and eBPF, with validation on AI-for-science workloads on LLNL systems.

You will collaborate with domain scientists, design scalable registries, and contribute to open-source software while reporting results

Qualifications

  • PhD in Computer Science, Computer Engineering, or related field.
  • Experience in HPC I/O, storage systems, or scientific data management.
  • Experience in tracing, profiling, or performance analysis of parallel or distributed applications.
  • Experience with large-scale deep learning or scientific workflows.
  • Ability to conduct high-quality research and develop implementations of sophisticated algorithms.
  • Experience programming in C/C++ and Python in a Linux environment.
  • Strong communication skills and publication record.
  • Experience with data provenance, lineage tracking, or reproducibility of scientific workflows.
  • Experience with OS internals or kernel instrumentation (e.g., Linux kernel, eBPF).
  • Experience with I/O tracing tools (e.g., Darshan, DFTracer, Recorder).

Responsibilities

  • Research and develop low-overhead, multi-layer provenance and I/O capture techniques for HPC workflows across layers.
  • Integrate capture with HPC resource managers (Flux, Slurm) for automatic provenance collection.
  • Design scalable registries assigning stable identities to datasets and checkpoints across tools.
  • Normalize and temporally align large trace and event streams into a common schema.
  • Characterize and minimize overhead of tracing on large-scale workloads.
  • Develop benchmarks, ground-truth datasets, and validation methodologies.
  • Create high-quality, open-source software extensible to downstream users.
  • Deploy and evaluate software on LLNL HPC systems with domain scientists.
  • Pursue independent research and collaborate with internal/external teams.
  • Publish results in peer-reviewed journals and present at conferences.
  • Present progress in group meetings and participate in divisions.

Skills

C/C++
Python
Linux
Data provenance
eBPF
I/O tracing
OS internals
Performance analysis

Education

PhD in Computer Science or related field

Tools

Slurm
Flux
Darshan
DFTracer
Recorder

Job description

HPC Data Provenance – Postdoctoral Researcher

Mid-Senior Level | Full-time
Postdoctoral/Fellowship | Livermore, CA | 11/17/2026
Reference #: REF9138R
Job Code: PDS.1 Post-Dr Research Staff 1
Organization: Computing
Position Type: Post Doctoral
Security Clearance: None/Position does not require US citizenship (assignments longer than 179 days require a federal background investigation)
Drug Test: Required for external applicant(s) selected for this position (includes testing for use of marijuana)
Medical Exam: Not applicable

Join us and make YOUR mark on the World!

Lawrence Livermore National Laboratory (LLNL) has turned bold ideas into world-changing impact advancing science and technology to strengthen U.S. security and promote global stability.

Our mission spans four critical national security areas nuclear deterrence, threat preparedness, energy security, and multi-domain defense empowering teams to take on the toughest challenges of today and tomorrow. With a culture built on innovation and operational excellence, LLNL is a place where your expertise can make a real impact.

Job Description

We are seeking a Postdoctoral Researcher to perform research in data provenance, multi-layer tracing, and I/O characterization for large-scale scientific and AI workflows on high-performance computing (HPC) systems. Scientists increasingly need to answer questions such as which data produced a result, what transformed it, and which downstream models and analyses are affected when that data changes. Today the evidence needed to answer these questions is fragmented across hardware, operating system, I/O, runtime, and workflow layers. You will research and develop low-overhead techniques to automatically capture provenance from heterogeneous sources (e.g., application- and workflow-level tracers, data registries, and kernel-level instrumentation such as eBPF), assign stable identities to data artifacts as they move through workflows, and normalize and temporally align these records into a common representation that supports trustworthy, auditable lineage at HPC scale. You will work with domain scientists to validate these capabilities on leading-edge AI-for-science workflows running on Livermore Computing production systems. This position is in the Center for Applied Scientific Computing (CASC) within the Computing Directorate.

In this role you will

  • Research and develop low-overhead, multi-layer provenance and I/O capture techniques for HPC workflows spanning the application, runtime, I/O library, file system, and operating system layers.
  • Research and develop methods to integrate capture with HPC resource managers (e.g., Flux, Slurm) so that provenance is collected automatically without requiring changes to user workflows.
  • Design and implement scalable registries that assign stable identities to datasets, model checkpoints, and workflow stages and reconcile the names used for them across different tools.
  • Research and develop techniques to normalize, compress, and temporally align high-volume heterogeneous trace and event streams into a common schema.
  • Characterize and minimize the performance overhead of tracing and provenance capture on large-scale deep learning and scientific workloads.
  • Develop benchmarks, ground-truth datasets, and validation methodologies to evaluate provenance correctness, coverage, and overhead.
  • Develop high-quality, open-source software that is extensible and maintainable by downstream users and developers.
  • Deploy and evaluate software on Laboratory production HPC systems and interact with application scientists to understand practical, real-world requirements and limitations.
  • Pursue independent (but complementary) research interests and interact with team members internally and externally.
  • Publish research results in external peer-reviewed scientific journals and participate in conferences and workshops.
  • Present formal and informal overview of research progress at group meetings.
  • Participate in existing division collaborations and alliances with academia and industry.
  • Perform other duties as assigned.
Qualifications
  • PhD in Computer Science, Computer Engineering, or related field.
  • Research experience in HPC I/O, storage systems, or scientific data management.
  • Research experience in tracing, profiling, or performance analysis of parallel or distributed applications.
  • Research experience with large-scale deep learning or scientific workflows, either as workloads to characterize or as tools applied to systems problems.
  • Ability to conduct high-quality research and to develop implementations of sophisticated algorithms and systems to evaluate the results.
  • Experience programming in C/C++ and Python in a Linux environment.
  • Proficient verbal and written communication skills necessary to interact with members of a research team, author technical and scientific reports and papers, and deliver technical presentations.
  • Demonstrated publication record in peer-reviewed journals and/or conferences.
  • Strong decision-making skills necessary to independently solve complex research problems.
  • Experience with data provenance, lineage tracking, or reproducibility of scientific or machine learning workflows.
  • Experience with operating system internals or kernel-level instrumentation (e.g., the Linux kernel, eBPF).
  • Experience with I/O tracing and characterization tools (e.g., Darshan, DFTracer, Recorder) or I/O benchmarks for deep learning.
  • Experience indexing, compressing, or analyzing large trace or event datasets.
  • Experience running workloads on leadership-class HPC systems, parallel file systems, and HPC resource managers.
  • Experience developing and maintaining open-source research software with an external user community.

Pay Range

$143,328 Annually

Additional Information

All your information will be kept confidential according to EEO guidelines.

Position Information

This is a Postdoctoral appointment with the possibility of extension to a maximum of three years. The postdoctoral appointment is a temporary, mentored training position intended for individuals in the early stages of their postdoctoral research careers. Consistent with the structure of the program, applicants must have received their Ph.D. (or equivalent doctorate) within five years of the anticipated start date.

Why Lawrence Livermore National Laboratory?

  • Included in 2026Best Places to Work by Glassdoor!
  • Flexible schedules (*depending on project needs)

None required.However, if your assignment is longer than 179 days cumulatively within a calendar year, you must go through the Personal Identity Verification process. This process includes completing an online background investigation form and receiving approval of the background check.

National Defense Authorization Act (NDAA)

The 2025 National Defense Authorization Act (NDAA), Section 3112, generally prohibits citizens of China, Russia, Iran and North Korea without dual US citizenship or legal permanent residence from accessing specific non-public areas of national security or nuclear weapons facilities. The restrictions of NDAA Section 3112 apply to this position. To be qualified for this position, Candidates must be eligible to access the Laboratory in compliance with Section 3112.

Pre-Employment Drug Test

External applicant(s) selected for this position must pass a post-offer, pre-employment drug test. This includes testing for use of marijuana as Federal Law applies to us as a Federal Contractor.

Wireless and Medical Devices

Per the Department of Energy (DOE), Lawrence Livermore National Laboratory must meet certain restrictions with the useand/or possession ofmobile devices in Limited Areas. Depending on your job duties, you may be required to work in a Limited Area whereyou are not permitted to have a personal and/or laboratory mobile devicein your possession. This includes, but not limited to cell phones, tablets, fitness devices, wireless headphones, and other Bluetooth/wireless enabled devices.

Ifyou useamedical device, whichpairs with a mobile device,you must still follow the rules concerningthe mobile device in individual sections within Limited Areas. Sensitive Compartmented Information Facilities requireseparate approval. Hearing aids without wireless capabilities or wireless that has been disabled are allowed in Limited Areas, Secure Space and Transit/Buffer Space within buildings.

We are an equal opportunity employer that is committed to providing all with a work environment free of discrimination and harassment. All qualified applicants will receive consideration for employment without regard to race, color, religion, marital status, national origin, ancestry, sex, sexual orientation, gender identity, disability, medical condition, pregnancy, protected veteran status, age, citizenship, or any other characteristic protected by applicable laws.

Reasonable Accommodation

Our goal is to create an accessible and inclusive experience for all candidates applying and interviewing at the Laboratory. If you need a reasonable accommodation during the application or the recruiting process, please use our online form to submit a request.

CaliforniaPrivacy Notice

The California Consumer Privacy Act (CCPA) grants privacy rights to all California residents. The law also entitlesjob applicants, employees, and non-employee workers to be notified of what personal information LLNL collects and for what purpose. The Employee Privacy Notice can be accessed here .

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

HPC Data Provenance – Postdoctoral Researcher
HPC Data Provenance – Postdoctoral Researcher

LLNL • Livermore (CA)

On-site
USD 122,000 - 165,000
HPC Data Provenance - Postdoctoral Researcher
HPC Data Provenance - Postdoctoral Researcher

Lawrence Livermore National Laboratory • Livermore (CA)

On-site
USD 129,000 - 158,000
Flexible schedules
Relocation assistance
Education reimbursement
Numerical Program Analysis for Scientific Computing Postdoctoral Researcher
Numerical Program Analysis for Scientific Computing Postdoctoral Researcher

LLNL • Livermore (CA)

On-site
USD 129,000 - 158,000
Flexible schedules
Numerical Program Analysis for Scientific Computing Postdoctoral Researcher
Numerical Program Analysis for Scientific Computing Postdoctoral Researcher

Lawrence Livermore National Laboratory • Livermore (CA)

On-site
USD 129,000 - 158,000
Reduced Order Modeling - Postdoctoral Researcher
Reduced Order Modeling - Postdoctoral Researcher

Llnl • Livermore (CA)

On-site
USD 129,000 - 158,000
Flexible schedules
Reduced Order Modeling - Postdoctoral Researcher
Reduced Order Modeling - Postdoctoral Researcher

Lawrence Livermore National Laboratory • Livermore (CA)

On-site
USD 129,000 - 158,000
SI/ML Computational Biologist - Postdoctoral Researcher
SI/ML Computational Biologist - Postdoctoral Researcher

Lawrence Livermore National Laboratory • Livermore (CA)

On-site
USD 111,000 - 135,000
Relocation Assistance
Education Reimbursement Program
Flexible schedules
+1
Agentic Science Postdoctoral Researcher
Agentic Science Postdoctoral Researcher

Lawrence Livermore National Laboratory • Livermore (CA)

On-site
USD 122,000 - 165,000
Flexible schedules
Atomistic and Data-Driven Modeling of Materials for Energy Applications - Postdoctoral Researcher
Atomistic and Data-Driven Modeling of Materials for Energy Applications - Postdoctoral Researcher

Lawrence Livermore National Laboratory • Livermore (CA)

On-site
USD 111,000 - 135,000
Computational Fault Mechanics - Postdoctoral Researcher
Computational Fault Mechanics - Postdoctoral Researcher

Lawrence Livermore National Laboratory • Livermore (CA)

On-site
USD 111,000 - 135,000
Relocation assistance
Education reimbursement program
Flexible schedules
+1