Software Engineer, HPC Scheduling

NorthMark Strategies; Dallas (TX); On-site; USD 90,000 - 130,000; Full time

Benefits offered by this job

Company-Paid Lunch Stipend

100% Employer-Paid Medical and Benefits

401(k) with company match

25 days of Paid Time Off

12 company holidays

Job summary

NorthMark Strategies in Dallas, Texas, seeks a motivated individual for an HPC Scheduling role. You will develop and manage a large HPC platform that supports complex research workloads and batch jobs on Kubernetes.

The ideal candidate will have a strong software engineering background, especially in developing Kubernetes components and managing large-scale infrastructures. Responsibilities include designing scalable software solutions, managing databases, and supporting containerized applications.

The role offers a comprehensive benefits package, including health insurance and paid time off.

Qualifications

• Experience with developing Kubernetes components such as controllers and operators.
• Knowledge of event-driven programming and message queues.
• Experience in high-performance computing or DAG workflows.
• Operating systems at scale using a cloud provider, ideally AWS.
• Use of operational tools for monitoring and logging.

Responsibilities

• Design and develop high-quality software solutions using procedural programming languages and Golang.
• Build and maintain highly scalable systems for large-scale research workloads.
• Manage data interactions across relational and non-relational databases.
• Develop and operate containerized applications within Kubernetes.
• Support Linux-based systems for the core compute platform.
• Independently resolve complex technical issues.

Skills

Experience with developing Kubernetes components

Understanding of event-driven programming

High-performance computing experience

Experience of DAG workflows

Cloud provider operations

Monitoring and logging with Prometheus/Grafana

Job scheduling systems like SLURM

Job description

NorthMark Compute & Cloud (NMC²) is backed by dedicated leadership and investment, with a clear mission as it operates at the bleeding edge of technology. Its goal is to scale and enhance the high-performance computing (HPC) and cloud infrastructure that supports its clients' research, production, and delivery, enabling breakthroughs that shape the industries of tomorrow. Its engineers build critical infrastructure to eliminate friction in scientific research, simulations, analysis, and decision-making, accelerating discovery and driving faster innovation.

The Position

The HPC Scheduling team develops and manages a large high-performance compute (HPC) platform to enable the business to conduct complex research at scale. We are seeking a highly motivated person to join our team to help us continue to push the envelope running batch workloads on Kubernetes.

The ideal candidate will have an active interest in Kubernetes and batch computing, a broad range of experience with software engineering and development, as well as experience managing large-scale infrastructure and complex tooling environments.

The main focus will be on Armada – an exciting open source CNCF project built and maintained by the team – which we use to solve multi-cluster Kubernetes batch job scheduling at scale.

You’ll join an experienced team, working at the cutting‑edge of ML workloads and at scale.

Responsibilities

• Designing and developing high-quality software solutions using procedural programming languages, with a focus on Golang.
• Building and maintaining highly scalable, highly available and globally distributed systems to support large-scale research workloads.
• Managing and optimising data interactions across relational and non-relational databases, particularly PostgreSQL.
• Developing and operating containerised applications within Kubernetes, ensuring effective orchestration and workload scheduling.
• Supporting, tuning and troubleshooting Linux-based systems as part of our core compute platform.
• Applying core networking knowledge to help debug, optimise and enhance platform connectivity and performance.
• Independently diagnosing and resolving complex technical issues across infrastructure and software layers.
• Applying solid software architecture principles, computer science fundamentals and data structure knowledge to guide design decisions and code quality.
• Driving continuous improvement by contributing to CI/CD pipelines and engineering best practices.
• Staying up to date with emerging technologies and approaches, and applying new knowledge across disciplines.

Requirements

• Experience with developing Kubernetes components, such as controllers and operators.
• Experience with event-driven programming and message queues, such as Apache Kafka and Pulsar.
• Experience of high-performance computing, Kubernetes, or DAG (Directed Acyclic Graph) workflows.
• Experience of running systems at scale using a cloud provider, ideally AWS.
• Use of operational and runtime tools and practices, including monitoring and logging with systems such as Prometheus and Grafana.
• Experience of operating or using job scheduling systems, such as SLURM.

Must be legally authorized to work in the United States

Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.

Benefits & Perks

• Company‑Paid Lunch Stipend: Lunch is provided via GrubHub.
• Company‑Paid Benefits: 100% Employer‑Paid Medical in our High Deductible Health Plan, Dental and Vision benefits for employees and their families, 16 weeks of Paid Parental Leave, Employee Assistance Program, Life insurance, Short‑Term Disability and Long‑Term Disability.
• 401(k): Company will match 100% of your contributions up to 6%.
• Optional Employee‑Paid Benefits: Medical insurance in our PPO plan and a variety of other benefits such as Health Savings Accounts (with Company Contribution!), Flexible Spending Accounts, Supplemental Life Insurance, Wellhub and more.
• Time Off: 25 days of Paid Time Off plus 12 company holidays.

It is impossible to list every requirement for, or responsibility of, any position. Similarly, we cannot identify all the skills a position may require since job responsibilities and the Company’s needs may change over time. Therefore, the above job description is not comprehensive or exhaustive. The Company reserves the right to adjust, add to or eliminate any aspect of the above description. The Company also retains the right to require all employees to undertake additional or different job responsibilities when necessary to meet business needs.

EQUAL OPPORTUNITY EMPLOYER

NORTHMARK STRATEGIES LLC IS AN EQUAL EMPLOYMENT OPPORTUNITY EMPLOYER. THE COMPANY'S POLICY IS NOT TO DISCRIMINATE AGAINST ANY APPLICANT OR EMPLOYEE BASED ON RACE, COLOR, RELIGION, NATIONAL ORIGIN, GENDER, AGE, SEXUAL ORIENTATION, GENDER IDENTITY OR EXPRESSION, MARITAL STATUS, MENTAL OR PHYSICAL DISABILITY, AND GENETIC INFORMATION, OR ANY OTHER BASIS PROTECTED BY APPLICABLE LAW. THE FIRM ALSO PROHIBITS HARASSMENT OF APPLICANTS OR EMPLOYEES BASED ON ANY OF THESE PROTECTED CATEGORIES.