Software Engineer, General

AION; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

AION in Bengaluru is building an interoperable AI cloud platform and seeks backend engineers to contribute across the Compute and Inference layers. You will write production-grade Go, design APIs, and collaborate with senior engineers on architecture.

The role covers multi-cloud orchestration, autoscaling, databases, messaging queues, observability, and robust testing. You will own parts of the platform, participate in reviews, and help with documentation and onboarding for a growing team.

Qualifications

• 2–4 years in backend engineering or distributed systems.
• Strong Go coding with concurrency and testing.
• Experience with RESTful APIs and microservices.

Responsibilities

• Build and maintain platform services for Compute and Inference.
• Implement multi-cloud orchestration and autoscaling.
• Develop REST/gRPC APIs and database schemas.
• Write unit/integration tests and participate in reviews.

Skills

Golang

REST APIs

Distributed systems

PostgreSQL

Kafka/RabbitMQ

Kubernetes

Testing

CI/CD

Terraform

Tools

Docker

Terraform

Prometheus

Job description

About AION AION is building an interoperable AI cloud platform by transforming the future of high-performance computing (HPC) through its decentralized AI cloud. Purpose-built for bare-metal performance, AION democratizes access to compute and provides managed services, aiming to be an end-to-end AI lifecycle platform?taking organizations from data to deployed models using its forward-deployed engineering approach. AI is transforming every business around the world, and the demand for compute is surging like never before. AION thrives to be the gateway for dynamic compute workloads by building integration bridges with diverse data centers around the world and re-inventing the compute stack via its state-of-the-art serverless technology. We stand at the crossroads where enterprises are finding it hard to balance AI adoption with security. At AION, we take enterprise security and compliance very seriously and are re-thinking every piece of infrastructure from hardware and network packets to API interfaces. Led by high-pedigree founders with previous exits, AION is well-funded by major VCs with strategic global partnerships. Headquartered in the US with global presence, the company is building its initial core team in India.

You're product-minded?you understand how your technical decisions impact developers using AION's platform and think about the end-to-end user experience. You're a team player comfortable wearing multiple hats?one day you're building product features, the next you're joining customer calls to understand their deployment challenges, and the day after you're helping with UI/UX, customer success, documentation and product ops.

Requirements

What You'll Do

• Build and maintain platform services across AION's Compute and Inference platforms, working closely with senior engineers and platform leads
• Implement features for multi-cloud orchestration, resource scheduling, model deployment pipelines, and autoscaling systems
• Write well-maintained, production-grade code with proper abstractions, design patterns, and comprehensive test coverage
• Contribute to low-level design (LLD) including service APIs, database schema design, data models, and component interactions
• Collaborate with senior engineers on high-level design discussions, providing implementation perspectives and feasibility inputs

Backend Systems & Distributed Infrastructure

• Develop RESTful APIs and gRPC services for platform control planes, resource management, and inference serving
• Design and implement database schemas for storing platform state, resource metadata, billing data, and observability metrics
• Work with distributed storage systems, message queues (Kafka, RabbitMQ), and databases (PostgreSQL, Redis) to build reliable platform components
• Build event-driven architectures for asynchronous processing, job scheduling, and platform automation
• Implement monitoring, logging, and alerting for platform services to ensure production reliability

Code Quality & Engineering Excellence

• Write comprehensive unit tests, integration tests, and end-to-end tests to ensure code reliability
• Participate in code reviews, providing constructive feedback and learning from senior engineers' perspectives
• Refactor existing code to improve maintainability, performance, and scalability
• Document design decisions, API specifications, and operational runbooks for platform services
• Debug production issues and contribute to incident response and post-mortems

Technical Skills & Experience

If you are meeting some of these requirements and feel comfortable catching up on others, we definitely recommend you to apply:

• 2-4 years of experience in backend engineering, platform development, or distributed systems
• Strong proficiency in Golang?you write idiomatic Go code with proper error handling, concurrency patterns, and testing
• Solid understanding of backend systems fundamentals: RESTful APIs, microservices architecture, and API design principles
• Hands-on experience with databases (PostgreSQL, MySQL) including schema design, query optimization, and transactions
• Familiarity with storage systems (object storage like S3, block storage, distributed file systems) and their use cases
• Experience working with message queues (Kafka, RabbitMQ, NATS) and event-driven architectures
• Understanding of distributed systems concepts: consensus, eventual consistency, fault tolerance, and retry mechanisms
• Experience with containerization (Docker) and basic Kubernetes concepts
• Knowledge of testing frameworks and practices (unit tests, integration tests, mocking)
• Familiarity with Git, CI/CD pipelines, and modern development workflows
• Exposure to cloud platforms (AWS/GCP/Azure) and their core services is a plus
• Experience with infrastructure-as-code (Terraform) or observability tools (Prometheus, Grafana) is beneficial

Bonus / Good to Have

• HPC & Cluster Management: Experience handling large-scale HPC clusters using Kubernetes and Slurm for job scheduling, resource allocation, and workload orchestration
• Data Engineering: Expertise with data pipelines, ETL systems, and large-scale data processing frameworks
• Systems-Level Programming: Experience with low-level systems programming such as storage systems, Kubernetes operators, OS-level software development, or daemon services (llm-d, system agents)
• ML Platform Engineering: Experience productionizing ML pipelines, batch job orchestration, model fine-tuning workflows, and Jupyter notebook orchestration systems

Enterprise Deployment: Experience platformizing and packaging software for on-premises deployments or customer VPC installations with emphasis on security, compliance, and operational simplicity

Benefits

Preferred Attributes:

• Founder-level ownership and bias for action.
• Strong strategic thinking and ability to connect technical decisions to business impact.
• Excellent communication and mentoring skills.
• Thrives in ambiguity, fast-paced environments, and early-stage startup culture.

Why Join AION?

• Work directly with high-pedigree founders shaping technical and product strategy.
• Build infrastructure powering the future of AI compute globally.
• Significant ownership and impact with equity reflective of your contributions.
• Competitive compensation, flexible work options, and wellness benefits