Senior Systems Engineer, On-Prem AI Platform

Hume AI, Inc.; New York, Northern (NY, KY); Hybrid; USD 150,000 - 230,000; Full time

Job summary

Hume AI, Inc. in New York City is seeking a Senior Software Engineer on the Data Plane team to help build Hume’s on-premises inference and workflow platform for running large-scale AI workloads.

You will work closely with backend engineers, research scientists, ML engineers, product managers, and infrastructure engineers to bring new models and inference capabilities into production. This is a systems-oriented role focused on reliability, performance, and efficient resource utilization.

Qualifications

• Significant professional experience building server-side or systems software.
• Strong Linux fundamentals and hands-on experience troubleshooting and profiling production systems.
• Experience in distributed systems, networking, filesystems, concurrency, resource management, or computer architecture.
• Proficiency in Rust, C, or C++ with a systems-oriented mindset.

Responsibilities

• Design, build, and maintain the data plane software that executes AI models and voice data workflows.
• Develop capabilities such as declarative workflow execution, parallel and fan-out processing, inference-engine integrations, tracing, and execution-status reporting.
• Integrate new models and runtimes while maintaining consistent performance, reliability, and operational behavior.
• Diagnose complex production issues across application, operating-system, container, networking, and hardware boundaries.
• Profile and optimize latency, throughput, memory usage, and resource utilization.
• Improve the observability, resilience, testability, and operational safety of the platform.
• Collaborate with research and product teams to turn emerging model capabilities into reliable production systems.
• Write clear technical documentation for the systems and features you build.

Skills

Server-side experience

Linux fundamentals

Distributed systems

Networking

Filesystems

Concurrency

Resource management

Computer architecture

Rust

C

C++

Ownership

Communication

AI-assisted coding

Job description

Hume AI, Inc. in New York City is seeking a Senior Software Engineer on the Data Plane team to help build Hume’s on-premises inference and workflow platform for running large-scale AI workloads.

You will work closely with backend engineers, research scientists, ML engineers, product managers, and infrastructure engineers to bring new models and inference capabilities into production. This is a systems-oriented role focused on reliability, performance, and efficient resource utilization.