Software Development Engineer 3

Hiver; Bengaluru; Hybrid; INR 4,500,000 - 6,500,000; Full time

Job summary

Hiver in Bengaluru, India is seeking an experienced SDE III (Backend) to own major backend surfaces and architect scalable systems that power AI-driven workflows for collaborative email and customer service.

You will lead end-to-end features, collaborate with ML/AI teams, and ensure reliability for processing millions of emails daily across thousands of users.

Qualifications

• 5+ years building and scaling production systems end-to-end.
• Solid backend expertise in Go/Java/Python/RoR.
• Deep understanding of distributed systems, concurrency, performance, and resiliency.
• Experience with SQL plus familiarity with NoSQL/caches.
• Exposure to production model serving (embeddings, inference APIs).
• Strong fundamentals in cloud infra (AWS preferred), containers, and CI/CD.

Responsibilities

• Scale backend systems to handle rapidly growing traffic and AI workloads.
• Build low-latency inference and retrieval endpoints, caching layers, and model-serving pipelines.
• Improve reliability, resiliency, and performance across monolith and microservices environments.
• Work with Kafka/RabbitMQ to build high-volume, event-driven data flows.
• Partner with ML/AI teams to deploy embeddings, rerankers, RAG systems, and evaluation workflows.
• Ship features end-to-end across backend APIs, domain models, and data pipelines.
• Integrate AI suggestions, copilots, and retrieval-based workflows seamlessly into the product experience.
• Collaborate closely with design & product to deliver polished, consumer-grade UX.
• Implement secure, compliant data handling for structured/unstructured customer data.
• Own observability across the stack tracing, metrics, dashboards, feature flags, SLOs.
• Lead debugging of complex issues across frontend, backend, infra, and model pipelines.
• Drive postmortems, root-cause analysis, and process improvements.

Skills

Backend development

Distributed systems

Go/Java/Python/RoR

SQL & NoSQL

Cloud & CI/CD

Tools

Kafka/RabbitMQ

AWS

Containers (Docker/K8s)

Job description

Opportunity:

As an SDE III (Backend) at Hiver, you will work end-to-end across backend, and AI systems to craft the next generation of collaborative email, automation, and AI-powered customer service workflows.

You will own major product surfaces, architect scalable systems, and bring intelligent experiences to life in the UI while ensuring reliability for 5M+ emails processed daily across thousands of active users.

Key Responsibilities

What you will do?

Backend, Distributed Systems & AI

• Scale backend systems to handle rapidly growing traffic and AI workloads.
• Build low-latency inference and retrieval endpoints, caching layers, and model-serving pipelines.
• Improve reliability, resiliency, and performance across monolith and microservices environments.
• Work with Kafka/RabbitMQ to build high-volume, event-driven data flows.
• Partner with ML/AI teams to deploy embeddings, rerankers, RAG systems, and evaluation workflows.

Product Engineering

• Ship features end-to-end across backend APIs, domain models, and data pipelines.
• Integrate AI suggestions, copilots, and retrieval-based workflows seamlessly into the product experience.
• Collaborate closely with design & product to deliver polished, consumer-grade UX.

Data, Security & Observability

• Implement secure, compliant data handling for structured/unstructured customer data.
• Own observability across the stack tracing, metrics, dashboards, feature flags, SLOs.
• Lead debugging of complex issues across frontend, backend, infra, and model pipelines.
• Drive postmortems, root-cause analysis, and process improvements.

What were looking for?

Must Have:

• 5+ years building and scaling production systems end-to-end.
• Solid backend expertise in Go/Java/Python/RoR.
• Deep understanding of distributed systems, concurrency, performance, and resiliency.
• Experience with SQL plus familiarity with NoSQL/caches.
• Exposure to production model serving (embeddings, inference APIs).
• Strong fundamentals in cloud infra (AWS preferred), containers, and CI/CD.

Nice to Have:

• Prior experience building and shipping AI systems/features into production.