Senior HPC Systems Programmer - 139214

University of California San Diego

San Diego (CA)

On-site

USD 100,000 - 188,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

UC San Diego's San Diego Supercomputer Center (SDSC) seeks a Senior HPC Systems Programmer to lead software design and cloud infrastructure efforts across campus, state, and national scales. The role focuses on scalable architectures, reliability, and performance for large HPC platforms.

You will automate management, optimize clusters, and oversee security and testing. The incumbent mentors junior staff and collaborates with User Services to deliver robust, high-availability research computing

Qualifications

  • Bachelor's degree in related area and / or equivalent experience / training.
  • Advanced knowledge of secure software development utilizing diverse programming languages including but not limited to C/C++, Java, Javascript, Python and Go.
  • Strong demonstrated experience with Ethernet and IP networking, including VLANs, subnets, and routing.
  • Advanced knowledge of Linux, including services, networking, and file systems.
  • Advanced experience managing Kubernetes clusters, with specific focus on geographically distributed designs.
  • Demonstrated experience setting up AI infrastructure including incorporation of innovative accelerator hardware, storage, and inference services leveraging Kubernetes and on-prem HPC resources

Responsibilities

  • Lead software design for HPC systems and cloud infrastructure.
  • Automate system maintenance, monitor networks, and ensure high availability of clusters.
  • Coordinate software updates across production HPC clusters and manage Kubernetes-based environments.
  • Collaborate with User Services and national projects to gather requirements and implement scalable solutions.
  • Develop training materials and mentor junior staff on HPC operations and security practices.

Skills

C/C++
Java
Javascript
Python
Go
Networking

Education

Bachelor's degree or equivalent

Tools

Kubernetes
Linux

Job description

UCSD Layoff from Career Appointment: Apply by 4/13/26 for consideration with preference for rehire. All layoff applicants should contact their Employment Advisor.

Reassignment Applicants: Eligible Reassignment clients should contact their Disability Counselor for assistance.

DEPARTMENT OVERVIEW

The Mission of the San Diego Supercomputer Center is to translate innovation into practice. SDSC adopts and partners on innovations in industry and academia in the areas of software, hardware, computational and data sciences, and related areas, and translates them into cyberinfrastructure that solves practical problems across any and all scientific domains and societal endeavors. Cyberinfrastructure refers to an accessible, integrated network of high-performance computing, data, and networking resources and expertise, focused on accelerating scientific inquiry and discovery. With more than 250 employees and $30-50M of revenue a year, SDSC is a global leader in the design, development, and operations of cyberinfrastructure.

SDSC supports hundreds of multidisciplinary programs spanning a wide variety of domains, from earth sciences and biology to astrophysics, bioinformatics, and health IT. SDSC presently operates multiple large HPC systems ranging from a 120k x86 CPU core general purpose system to a system explicitly designed for Artificial Intelligence and Machine Learning, and a nationally distributed system open for all of academia to integrate with. SDSC offers research data services across the entire vertical stack from universally scalable storage to consulting services on FAIR, Big Data, and AI. SDSC offers a rich set of cloud services both on-premise, in the commercial cloud, and as hybrid services across both.

SDSC has three geographic scopes, a national scope supporting cyberinfrastructure for the entire US research and education community, a California scope with a special focus on convergence research that addresses the three dominant threats to CA: Drought, Fire, Earthquakes, and a campus scope focusing on advancing the global impact of SDSC by advancing the research objectives of the UC San Diego faculty, researchers, and students.

SDSC impacts researchers at scales from 1,000's to Millions. SDSC annually trains thousands of researchers in cyberinfrastructure tools and software, and supports thousands of individual researchers via Unix accounts on its large HPC systems. SDSC was a leader developing the Science Gateway concept, and continues to be a global leader in its evolution. SDSC operates multiple major such gateways with user communities ranging from the tens of thousands to the millions. SDSC's educational programs includes online courses that have been attended by more than a million students.

SDSC is committed to democratizing access to cyberinfrastructure across all of its geographic scopes. SDSC strives towards a culture that supports our employees to be their best, achieve their goals, and enjoy their lives, both professionally and personally.

POSITION OVERVIEW

The Senior HPC Systems Programmer will apply advanced software concepts and objectives to medium to large projects of broad scope and complexity, regularly resolve highly complex issues where analysis of situations or data requires an in-depth evaluation of variable factors as well as select tools, methods, techniques and evaluation criteria to obtain results.

As the scale and complexity of HPC systems grow, the ability to automate systems management and to understand, analyze, and troubleshoot multiple hardware and software layers becomes critical. As part of SDSC's High Performance Systems group, the Senior HPC Systems Programmer performs software design and is a lead developer in the areas of: analyzing network and file system performance; automating system maintenance; monitoring systems and network; and developing innovative cyberinfrastructure for campus, state, and national scale HPC platforms and Cloud infrastructure orchestration. The position also participates in the analysis, specification, design, implementation, and monitoring of high performance and cloud computing systems to enable scientific research computing.

The responsibilities include management of the HPC cluster and cloud software development environment, defining coding standards, and code review. As part of the design process, creating software architectures with an eye for scaling to the thousands of computers in production. Leads and automates the testing of complex software platforms operating across several networks and after validating the changes, coordinate the software update of production HPC clusters. Leads development, deployment and management of Cloud and container infrastructure projects, extensions to existing software tools and creates and applies policies for resource use. The developed and maintained software manages and monitors system internals, networks, storage, and operating systems, along with emerging technologies. Supporting this requires in-depth knowledge and experience with all the facets of HPC and cloud systems, such as resource managers, schedulers, orchestrators, and parallel file systems (e.g., Lustre). The development tasks specifically include managing Kubernetes clusters like the PNRP Nautilus and the Voyager AI supercomputer.

The position involves working closely with the user services teams to continually improve the process for building and deploying HPC applications. As part of the HPC Systems Group, refines and updates the systems management and monitoring software to provide a constantly improving level of availability of our clusters and file systems. Determines features needed for new and existing software, chooses best methods to implement those features, sets the task priority and communicates those tasks to other members of the team. Prioritizes multiple simultaneous software development project based on need and communicates resource requirements to management and project leaders. Works with User Services to continually improve the process for building and deploying applications. This includes working with the PNRP systems and user support teams to evaluate new feature requirements, designing solutions and implementing them.

The incumbent is responsible for incorporating application testing into automated build processes. This includes development, deployment, and integration of system tests into the operation of clusters. Must ensure the appropriate level of security of the development, staging, and production environments to facilitate rapid early development while maintaining secure build environments for production software. Defines and implements the process for staging and testing changes to production based on the invasiveness of the change.

They will participate in collaborative, team-based efforts, including national initiatives such as ACCESS and related working groups and prioritize a complex set of development and deployment tasks based on input from User Services and management. The incumbent understand the requirements of highly complex distributed services that interact across multiple internal and external projects at the SDSC, campus, and National level and will provide guidance and mentorship to junior staff, supporting their development in HPC systems operations and large-scale data management. They will also work closely with other SDSC and UCSD groups to integrate HPC compute and storage systems into broader campus and national research activities. The Senior HPC Systems Programmer will create software specifications with focuses on availability, reliability, perfomance, scaling, and maintainability by others within DESC, work with teams from national projects in a distributed development environment and contribute to the development and implementation of security practices and operational procedures. Additionally, they will partner with User Services and operations teams to support training, documentation, and coordination of system maintenance activities as well as contribute to technical presentations, documentation, and knowledge sharing within the organization and at professional meetings.

For more information, please visit: https://www.sdsc.edu/

QUALIFICATIONS
  • Bachelor's degree in related area and / or equivalent experience / training.
  • Advanced knowledge of secure software development utilizing diverse programming languages including but not limited to C/C++, Java, Javascript, Python and Go.
  • Strong demonstrated experience with Ethernet and IP networking, including VLANs, subnets, and routing.
  • Advanced knowledge of Linux, including services, networking, and file systems.
  • Advanced experience managing Kubernetes clusters, with specific focus on geographically distributed designs.
  • Demonstrated experience setting up AI infrastructure including incorporation of innovative accelerator hardware, storage, and inference services leveraging Kubernetes and on-prem HPC resources
SPECIAL CONDITIONS
  • Job offer is contingent upon satisfactory clearance based on Background Check results.
  • Occasional evenings and weekends may be required. On-call rotation may be required.

Annual Full Pay Range: $100,100 - $187,500 (will be prorated if the appointment percentage is less than 100%)

Hourly Equivalent: $47.94 - $89.80

Factors in determining the appropriate compensation for a role include experience, skills, knowledge, abilities, education, licensure and certifications, and other business and organizational needs. The Hiring Pay Scale referenced in the job posting is the budgeted salary or hourly range that the University reasonably expects to pay for this position. The Annual Full Pay Range may be broader than what the University anticipates to pay for this position, based on internal equity, budget, and collective bargaining agreements (when applicable).

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

HPC Systems Engineer - 132811
HPC Systems Engineer - 132811

UC San Diego/UC San Diego Health • United States

Hybrid
USD 94,000 - 115,000
Facilties and Space Manager - 141990
Facilties and Space Manager - 141990

University of California San Diego • San Diego (CA)

On-site
USD 79,000 - 115,000
Cmptl and Data Sci Rsch Spec 4 - 142124
Cmptl and Data Sci Rsch Spec 4 - 142124

University of California San Diego • San Diego (CA)

On-site
USD 60,000 - 90,000
HPC Systems Engineer - 132811
HPC Systems Engineer - 132811

University of California San Diego • San Diego (CA)

Hybrid
USD 94,000 - 115,000
Senior HPC Systems Programmer - 139214
Senior HPC Systems Programmer - 139214

UC San Diego/UC San Diego Health • United States

Hybrid
USD 100,000 - 188,000
Systems and Network Administrator - 136522
Systems and Network Administrator - 136522

UC San Diego Health • San Diego (CA)

Hybrid
USD 96,862 - 143,947
Cmptl and Data Sci Rsch Spec 4 - 142124
Cmptl and Data Sci Rsch Spec 4 - 142124

UC San Diego/UC San Diego Health • United States

Hybrid
USD 83,000 - 86,000
Sr. High-Performance Computing Engineer - 141797
Sr. High-Performance Computing Engineer - 141797

University of California San Diego • San Diego (CA)

On-site
USD 150,000 - 210,000
Data Systems Analyst 3 - 136354
Data Systems Analyst 3 - 136354

UC San Diego Health • San Diego (CA)

Hybrid
USD 88,000 - 161,600
Systems Administrator 4
Systems Administrator 4

Military, Veterans and Diverse Job Seekers • San Diego (CA)

On-site
USD 110,000 - 170,000