platform engineer for high-performance computing

Enfint; Greater London; On-site; GBP 75,000 - 120,000; Full time

Benefits offered by this job

Agile working culture with flexibility

Job summary

GSK is seeking a software engineer for the Onyx Research Data Platform to design, build, and operate tools and workflows that solve key business problems, leveraging hybrid on-prem and cloud compute. Proficiency in Python, Kubernetes, and CI/CD will drive scalable services for researchers and decision-makers.

You will help transition HPC users, optimize performance for large data, and contribute to open source and documentation.

Qualifications

• Bachelor's degree in data engineering, Computer Science, Software Engineering, or a related discipline.
• Experience with Python and cloud technologies.
• Experience with High Performance Compute (HPC).
• Deep knowledge of programming languages and toolchains for documentation, testing, and operations/observability.
• Experience with CI/CD implementations using git and a CI/CD stack.
• Deep expertise with Docker, Kubernetes, and CNCF ecosystem including Helm.
• Experience with workflow orchestration tools such as Argo Workflow, Airflow, Nextflow, Snakemake, VisTrails, or Cromwell.
• Familiarity with open-source software development and contributions (nice to have).

Responsibilities

• Design, build, and operate tools, services, and workflows that solve key business problems.
• Develop key components of a hybrid on-prem/cloud compute platform for interactive and scalable batch computing.
• Establish processes and workflows to transition existing HPC users and teams to the platform.
• Build code-driven environments, applications, and containers/images.
• Deploy applications through CI/CD.
• Provide leadership to team members and help them complete work correctly.

Skills

Python

Cloud

HPC

CI/CD

Docker

Kubernetes

Argo Workflow

OpenMPI/OpenMP

Education

Bachelor's degree in data engineering, Computer Science, or Software Engineering

Tools

Jira

Confluence

spack

easybuild

CMake

Make

Helm

Job description

Описание

GSK is a global biopharma company focused on preventing and treating disease through specialty medicines and vaccines. Its Onyx Research Data Platform organization develops data, AI/ML, and computational capabilities to accelerate the discovery of new medicines and improve productivity for scientists, engineers, and decision-makers.

Задачи

• Design, build, and operate tools, services, and workflows that solve key business problems
• Develop key components of a hybrid on-prem/cloud compute platform for interactive and scalable batch computing
• Establish processes and workflows to transition existing HPC users and teams to the platform
• Build code-driven environments, applications, and containers/images
• Deploy applications through CI/CD
• Consult science users on application scalability to PBs of data
• Optimize the design and execution of complex solutions in large-scale distributed computing environments
• Produce well-engineered software with automated test suites, technical documentation, and operational strategies
• Ensure consistent use of platform abstractions for logging and lineage quality
• Participate in code reviews and partner to improve team standards
• Follow the QMS framework and CI/CD best practices and guide improvements to ways of working
• Provide leadership to team members and help them complete work correctly.

Требования

• Bachelor's degree in data engineering, Computer Science, Software Engineering, or a related discipline
• Experience with Python
• Experience with Cloud
• Experience with High Performance Compute (HPC)
• Deep knowledge of at least one common programming language, including toolchains for documentation, testing, and operations/observability
• Deep expertise in modern software development tools and ways of working
• Deep cloud expertise, including infrastructure-as-code tools and scalable compute technologies
• Experience with CI/CD implementations using git and a common CI/CD stack
• Deep expertise with Docker, Kubernetes, and the broader CNCF ecosystem, including Helm
• Experience with low-level application build tools such as make and CMake, and automated build systems such as spack or easybuild
• Experience with workflow orchestration tools such as Argo Workflow, Airflow, Nextflow, Snakemake, VisTrails, or Cromwell
• Experience with application performance tuning and optimization in parallel and distributed computing, including MPI, OpenMP, or Gloo
• Deep understanding of hardware, networks, storage, and their impact on application performance
• Demonstrated excellence in agile software development environments using tools such as Jira and Confluence
• Deep familiarity with high-performance application tools, techniques, and optimizations, including engagement with the open-source community
• Nice to have: Contributions to open-source tools.

Условия

• Agile working culture with flexibility opportunities.