Senior Backend Systems Engineer - Scalable Microservices

Hume AI, Inc.; New York (NY); On-site; USD 170,000 - 230,000; Full time

Job summary

Hume AI, Inc. in New York City seeks a Senior Software Engineer for the Backend Engineering team to build resilient microservices, APIs, and control planes that power our voice AI platform.

You will own backend design from implementation through deployment, focusing on reliability, performance, and scalability in a fast-growing startup. You will collaborate with data plane, UI, research, ML, product, and infra teams, write clear docs, and operate with autonomy to ship production-ready systems

Qualifications

• Significant professional experience building server-side, distributed, or systems software.
• A deep understanding of networking protocols and concepts (TCP, TLS, HTTP, WebSocket).
• Proficiency in at least one systems-oriented language (Rust, Go, C, or C++).
• Strong Linux fundamentals and production troubleshooting/profiling skills.
• Experience with production APIs and backend services.
• Familiarity with testing frameworks and CI/CD workflows.
• Experience with databases (PostgreSQL, DynamoDB, or Google Cloud Datastore).
• Owns systems end-to-end and communicates clearly.

Responsibilities

• Design, build, and maintain backend microservices powering Hume’s voice AI capabilities.
• Develop secure, reliable public-facing and internal APIs.
• Diagnose production issues across app, OS, container, and network layers.
• Implement real-time audio streaming and model inference integrations.
• Coordinate inference workloads across data planes via control plane APIs.
• Profile and optimize latency, throughput, and memory usage.
• Improve observability, resilience, and operational safety.
• Make architectural tradeoffs for reliability and velocity.
• Collaborate with research and product teams to productionize model capabilities.
• Write clear technical documentation for systems and features.

Skills

Distributed systems

Networking

Rust

Go

C

C++

Linux

API design

CI/CD

Databases

Tools

Kubernetes

OpenTelemetry

Datadog

Prometheus

Envoy

Job description

Hume AI, Inc. in New York City seeks a Senior Software Engineer for the Backend Engineering team to build resilient microservices, APIs, and control planes that power our voice AI platform.

You will own backend design from implementation through deployment, focusing on reliability, performance, and scalability in a fast-growing startup. You will collaborate with data plane, UI, research, ML, product, and infra teams, write clear docs, and operate with autonomy to ship production-ready systems