Senior Software Engineer - Microservices

Hume AI, Inc.; New York (NY); On-site; USD 170,000 - 230,000; Full time

Job summary

Hume AI, Inc. in New York City seeks a Senior Software Engineer for the Backend Engineering team to build resilient microservices, APIs, and control planes that power our voice AI platform.

You will own backend design from implementation through deployment, focusing on reliability, performance, and scalability in a fast-growing startup. You will collaborate with data plane, UI, research, ML, product, and infra teams, write clear docs, and operate with autonomy to ship production-ready systems

Qualifications

• Significant professional experience building server-side, distributed, or systems software.
• A deep understanding of networking protocols and concepts (TCP, TLS, HTTP, WebSocket).
• Proficiency in at least one systems-oriented language (Rust, Go, C, or C++).
• Strong Linux fundamentals and production troubleshooting/profiling skills.
• Experience with production APIs and backend services.
• Familiarity with testing frameworks and CI/CD workflows.
• Experience with databases (PostgreSQL, DynamoDB, or Google Cloud Datastore).
• Owns systems end-to-end and communicates clearly.

Responsibilities

• Design, build, and maintain backend microservices powering Hume’s voice AI capabilities.
• Develop secure, reliable public-facing and internal APIs.
• Diagnose production issues across app, OS, container, and network layers.
• Implement real-time audio streaming and model inference integrations.
• Coordinate inference workloads across data planes via control plane APIs.
• Profile and optimize latency, throughput, and memory usage.
• Improve observability, resilience, and operational safety.
• Make architectural tradeoffs for reliability and velocity.
• Collaborate with research and product teams to productionize model capabilities.
• Write clear technical documentation for systems and features.

Skills

Distributed systems

Networking

Rust

Go

C

C++

Linux

API design

CI/CD

Databases

Tools

Kubernetes

OpenTelemetry

Datadog

Prometheus

Envoy

Job description

Hume AI is looking for a systems-oriented backend engineer to build the microservices, APIs, and control planes behind Hume’s voice AI platform. Join us in the heart of New York City and contribute to our endeavor to ensure that AI is guided by human values, the most pivotal challenge (and opportunity) of the 21st century.

About Us

Hume AI is a Series B startup dedicated to building artificial intelligence that is directly optimized for human well-being. As the first company to release speech language models, we’re focused on expanding our research to encompass audio understanding models and evaluation platforms for enterprises.

Our goal is to enable a future in which technology draws on an understanding of human emotional expression to better serve human goals. As part of our mission, we also conduct groundbreaking scientific research, publish in leading scientific journals like Nature, and support a non-profit, The Hume Initiative, that has released the first concrete ethical guidelines for empathic AI (www.thehumeinitiative.org). You can learn more about us on our website (https://hume.ai/) and read about us in WIRED, Forbes, and Venturebeat.

About the Role

As a Senior Software Engineer on the Backend Engineering team, you will help build the backend microservices that power Hume’s APIs and control planes. You will work closely with data plane engineers, UI engineers, research scientists, machine learning engineers, product managers, and infrastructure engineers to bring new product features and inference capabilities into production.

This is a systems-oriented backend role focused on reliability, performance, scalability, and efficient resource utilization. You will operate with a high degree of autonomy, make sound architectural decisions, and own systems throughout their lifecycle—from initial design and implementation through deployment, observability, and production support.

What You’ll Do

• Design, build, and maintain the backend microservices that deliver Hume’s voice AI capabilities to users.

• Design and develop public-facing and internal APIs that are secure, reliable, performant, and highly available.

• Diagnose complex production issues across application, operating system, container, and networking layers.

• Build capabilities such as real-time audio streaming and integrations with model inference systems.

• Design and develop control plane APIs that coordinate inference workloads across data planes.

• Profile and optimize latency, throughput, memory usage, and resource utilization.

• Improve the observability, resilience, testability, and operational safety of the platform.

• Make architectural and implementation tradeoffs across reliability, performance, complexity, and development velocity.

• Collaborate with research and product teams to turn emerging model capabilities into reliable production systems.

• Write clear technical documentation for the systems and features you build.

What You’ll Bring

• Significant professional experience building server-side, distributed, or systems software.

• A deep understanding of networking protocols and concepts, including TCP, TLS, HTTP, and WebSocket.

• Professional experience with at least one systems-oriented programming language, such as Rust, Go, C, or C++.

• Strong Linux fundamentals and hands-on experience troubleshooting and profiling production systems.

• Experience with one or more relevant systems areas, such as distributed systems, networking, concurrency, resource management, filesystems, or computer architecture.

• Experience designing, operating, and evolving production APIs and backend services.

• Experience with testing frameworks and CI/CD workflows.

• Experience with databases such as PostgreSQL, DynamoDB, or Google Cloud Datastore.

• A strong sense of ownership and the ability to make pragmatic engineering and architectural decisions independently.

• Excellent written and verbal communication skills. Engineers at Hume document the systems and products they build.

• The ability to use AI-assisted coding tools effectively to accelerate delivery while retaining ownership of the result—including the ability to explain, validate, debug, and modify the resulting code independently when necessary.

Bonus Points

• Demonstrated experience designing or building high-concurrency, high-throughput, or latency-sensitive systems.

• Experience designing or operating control plane/data plane architectures.

• Experience with Kubernetes.

• Experience with observability and distributed tracing tools such as Datadog, Prometheus, or OpenTelemetry.

• Experience with L4/L7 proxies such as NGINX, HAProxy, or Envoy.

• Experience designing REST or gRPC APIs and OpenAPI specs.

• Experience building container images and maintaining production CI/CD pipelines.