Scientific Data Platform Engineer (Kubernetes)

Abundance Network; Menlo Park (CA); Hybrid; USD 116,000 - 164,000; Full time

Benefits offered by this job

Health insurance

Dental & vision insurance

Retirement plan

Vacation & PTO

Professional development funding

Tuition reimbursement

On-site amenities

Job summary

SLAC National Accelerator Laboratory seeks a Software Developer 2 to design, deploy, and maintain scalable data-driven services for S3DF science programs. You will build APIs, containerize apps, and deploy on Kubernetes while integrating IAM and data-management workflows.

You will collaborate with Rubin data management and platform teams, supporting data-intensive workflows, performance tuning, and real-time data pipelines in a world-class scientific computing environment.

Qualifications

• Bachelor's degree in physics, CS, or related field with 5 years of relevant experience.
• Proficiency in Python; C/C++ or JavaScript a plus.
• Experience with Git, CI/CD pipelines, code review, and agile/scrum.
• Familiarity with data-driven workflows.
• Hands-on experience with PostgreSQL (schema design, query optimization, operational mgmt).
• Experience with Apache Kafka or similar data pipelines.
• Production deployment of Kubernetes in scale.
• Understanding distributed compute, storage, HPC, networking concepts.
• Experience with monitoring, benchmarking, and performance analysis.
• Strong organizational and communication skills; collaborative, distributed team.

Responsibilities

• Design, deploy, and maintain applications and APIs for S3DF programs, enabling scientists to access and analyze large-scale datasets.
• Build data-serving interfaces and processing pipelines handling petabyte-scale astronomy data.
• Containerize applications and deploy on Kubernetes using cloud-native practices.
• Integrate applications with IAM frameworks (OIDC, SAML2, JWT, LDAP, COManage).
• Write clean, tested code and maintain shared software repositories across S3DF programs.
• Contribute to data stewardship by ensuring metadata integrity and data lifecycle alignment.
• Provide user support, troubleshoot issues, and monitor service health.
• Collaborate with Rubin data management teams and platform engineers.

Skills

Python

C/C++

JavaScript

Git

CI/CD

Agile/Scrum

Data-driven workflows

Networking concepts

System monitoring

Performance analysis

Distributed compute

Containerization

Kubernetes

Education

Bachelor's degree in physics, computer science, or related field

Tools

Kubernetes

Docker

PostgreSQL

Apache Kafka

Job description

SLAC National Accelerator Laboratory seeks a Software Developer 2 to design, deploy, and maintain scalable data-driven services for S3DF science programs. You will build APIs, containerize apps, and deploy on Kubernetes while integrating IAM and data-management workflows.

You will collaborate with Rubin data management and platform teams, supporting data-intensive workflows, performance tuning, and real-time data pipelines in a world-class scientific computing environment.