Staff AI Inference Backend Engineer — Production Systems

Hume AI, Inc.; New York (NY); Presencial; USD 180 000 - 240 000; Tempo integral

Resumo da oferta

Hume AI, Inc. in New York City is seeking a systems-oriented engineer to own the path from trained models to production inference. You will manage graph export, engine compilation, runtime integration, and contracts, building a robust inference platform for multiple models.

You will collaborate with researchers, ML engineers, backend engineers, and product teams to deliver high-performance, reliable, and scalable inference systems with strong observability and safety features.

Qualificações

• Significant professional experience building server-side, infrastructure, distributed, or systems software.
• Strong Linux fundamentals and hands-on experience troubleshooting and profiling production systems.
• Professional experience with at least one systems-oriented language such as Rust, Go, C, or C++.
• Experience with distributed systems concepts such as load balancing, health checking, failure recovery, observability, and capacity management.
• A practical understanding of neural-network execution, including computation graphs, tensor shapes, data types, and accelerator execution.
• Experience profiling and optimizing production systems.
• Comfort working across languages and tooling, including Python for model export, validation, and integration workflows.
• Strong ownership, independent technical judgment, and clear written and verbal communication.
• The ability to use AI-assisted coding tools effectively while retaining the ability to explain, validate, debug, and modify the result independently.

Responsabilidades

• Own the path from trained checkpoint to served request, including graph export, engine compilation, runtime integration, and serving configuration.
• Build and evolve internal inference platform for serving multiple models across products and workloads.
• Design and operate serving infrastructure, including routing, load balancing, health checking, autoscaling, capacity management, and failure handling.
• Build reproducible, versioned inference artifacts and tooling for validation, deployment, promotion, and rollback.
• Build verification gates that catch numerical, behavioral, and performance regressions before production.
• Design and maintain internal client libraries and standardized serving contracts.
• Profile and optimize latency, throughput, memory usage, batching, scheduling, and accelerator utilization.
• Diagnose production issues across application, runtime, container, networking, driver, and hardware boundaries.
• Improve observability, resilience, testability, and operational safety across the inference stack.
• Write clear technical documentation for the systems and APIs you build.

Conhecimentos

Server-side systems

Linux troubleshooting

Distributed systems

Neural-network execution

Performance profiling

Python workflows

Ownership & communication

AI-assisted coding

Cross-team collaboration

Ferramentas

Rust

Go

C

C++

Descrição da oferta de emprego

Hume AI, Inc. in New York City is seeking a systems-oriented engineer to own the path from trained models to production inference. You will manage graph export, engine compilation, runtime integration, and contracts, building a robust inference platform for multiple models.

You will collaborate with researchers, ML engineers, backend engineers, and product teams to deliver high-performance, reliable, and scalable inference systems with strong observability and safety features.