Software Golang Engineer (Kubernetes)

HellaGoodAudio; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive compensation

Hybrid or remote options

Work from anywhere up to 45 days/year

Private medical insurance

Extra vacation and sick leave

Language courses

Modern offices with snacks and drinks

Team sports and social activities

Job summary

HellaGoodAudio is seeking a skilled Go developer to design and build AI inference and training cloud products optimized for Kubernetes. You will implement scalable inference servers and distributed training jobs across GPU fleets, and write Go code powering Kubernetes controllers, operators, and CRDs.

You will create APIs, CLIs, and developer tools to simplify deployment, lifecycle management, and monitoring of AI applications, while advancing serverless container workflows and ensuring fast

Qualifications

• Strong Go programming experience.
• Deep understanding of Kubernetes architecture and resource management.
• Experience with Kubernetes APIs and CRDs.
• Proficiency with Docker and Helm in cloud-native environments.
• Excellent problem-solving and communication skills.
• Ability to work in a collaborative, team-oriented environment.

Responsibilities

• Design and implement AI inference and model training cloud products optimized for Kubernetes, including autoscaling and distributed training.
• Write clean, efficient Go code for Kubernetes controllers, operators, and CRDs.
• Build APIs, CLIs, and developer tools to streamline deployment, lifecycle management, and monitoring of AI apps.
• Develop serverless container workflows with fast cold starts and resource-efficient scaling.
• Improve system performance, reliability, and security for AI workloads (GPU scheduling, orchestration, throughput).
• Stay updated on Kubernetes ecosystem advances and influence the product roadmap.

Skills

Go programming

Kubernetes development

Excellent communication

Team collaboration

Problem solving

Tools

Kubernetes controllers/operators

Kubernetes APIs/CRDs

Docker

Helm

Job description

What You'll Do

• Design and implement AI inference and model training cloud products optimized for Kubernetes - from autoscaling inference servers to distributed training jobs across GPU fleets
• Write clean, efficient, and maintainable Go code to power Kubernetes controllers, operators, and custom resources supporting AI workloads
• Build APIs, CLIs, and developer tools that simplify the deployment, lifecycle management, and monitoring of AI applications
• Develop features that optimize serverless container workflows for AI, ensuring fast cold starts, resource-efficient scaling, and workload isolation
• Contribute to system performance, reliability, and security, with a focus on AI-specific challenges such as GPU scheduling, job orchestration, and data throughput
• Stay on top of Kubernetes ecosystem advancements (e.g., K8s-native ML tooling, scheduling improvements, SIGs) and influence our product roadmap accordingly

What We're Looking For

• Strong proficiency in Go programming, with experience in Kubernetes development, including controllers and operators.
• Deep understanding of Kubernetes architecture, resource management, and container orchestration.
• Experience working with Kubernetes APIs and custom resources (CRDs).
• Solid knowledge of cloud-native technologies and frameworks, including Docker and Helm.
• Strong problem-solving skills, with a passion for tackling complex challenges in distributed systems.
• Excellent communication skills and the ability to thrive in a collaborative, team-oriented environment.

Nice to Have

• Experience with Python programming language
• Experience with developing AI/ML pipelines or integrating AI frameworks (e.g., TensorFlow, PyTorch) into Kubernetes.
• Understanding of GPU scheduling and optimization in Kubernetes environments.
• Knowledge of security best practices in Kubernetes, including role-based access control (RBAC) and container security.
• Contributions to open-source Kubernetes projects or cloud-native communities.

Benefits

At Gcore, we want you to do your best work and enjoy the journey. Our benefits are designed to support your growth, well-being, and life beyond work:

• Competitive compensation
• Flexible working hours and hybrid or remote options, depending on your role
• Work from anywhere in the world for up to 45 days per year
• Private medical insurance for you and your family*
• Extra paid vacation and sick leave days*
• Support for life's important moments and celebrations
• Language courses to help you connect and grow
• Modern, welcoming offices with snacks, drinks, and entertainment*
• Team sports and social activities*

*Benefits may vary depending on your location.

Equal Opportunity Employer

We provide equal opportunity to all applicants without regard to race, color, religion, sex, sexual orientation, age, gender identity, gender expression, national origin, disability, or any other legally protected characteristics.