Backend Engineer

Hark; San Jose (CA); On-site; USD 170,000 - 400,000; Full time

Job summary

Hark, based in San Jose, California, seeks a skilled backend developer to build robust systems for AI agents. This role demands over 5 years of experience, a mastery of backend development, and the ability to successfully deploy high-concurrency services.

The ideal candidate will collaborate closely with researchers and engineers, focusing on system reliability, low-latency performance, and full-cycle ownership of features. Competitive salary offered between $170,000 and $400,000 based on experience.

Qualifications

• 5+ years of experience building mission-critical backend systems.
• Proven track record of shipping APIs and infrastructure that handle real-world traffic.
• Experience integrating LLMs into backend pipelines.

Responsibilities

• Design and build high-concurrency backend services for agent orchestration.
• Develop robust failure-handling and state management for workflows.
• Architect foundational APIs and services for the Hark ecosystem.
• Optimize the stack for low-latency streaming and processing.
• Lead features from design to production deployment.
• Implement automated evaluation frameworks for system health.

Skills

Backend & Systems Mastery

Production at Scale

AI System Intuition

Language Proficiency

Infrastructure Mindset

Technical Communication

Tools

Go

Rust

C++

Java

gRPC

WebSockets

Kubernetes

Job description

About Hark

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We’re pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

To get there, we’re developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

You’ll build the backend systems that make Hark’s AI agent actually work — reliable, fast, and production-grade.

That means the hard infrastructure problems: high-concurrency services, low-latency streaming, state management for long-running agent workflows, and the execution layer that connects model outputs to real-world actions. You are building the nervous system of an agentic product.

This is a high-ownership role on a small team. You’ll work directly with model researchers and platform engineers, and the systems you build will determine whether Hark feels like a slow chatbot or something genuinely new.

Responsibilities

• Core Runtime Architecture: Design and build the high-concurrency backend services responsible for agent orchestration, tool execution, and real-time streaming.
• Systems Reliability: Develop robust failure-handling, retry logic, and state management for long-running agentic workflows.
• Platform Primitives: Architect the foundational APIs and services—including memory retrieval systems and sandboxed execution environments—that power the entire Hark ecosystem.
• Performance Engineering: Optimize the stack for low-latency streaming and high-throughput data processing to ensure seamless agent-user interactions.
• Full-Cycle Ownership: Lead features from low-level design and prototyping to production deployment, monitoring, and performance tuning.
• System Observability: Implement deep instrumentation and automated evaluation frameworks to track system health and model quality regressions.

Requirements

• Backend & Systems Mastery: 5+ years of experience building mission-critical backend systems. You are an expert in concurrency, networking protocols, and distributed systems.
• Production at Scale: Proven track record of shipping APIs and infrastructure that handle real-world traffic, with a deep understanding of horizontal scaling and “day 2” operations.
• AI System Intuition: Experience integrating LLMs into backend pipelines. You understand the unique failure modes of non-deterministic systems and how to wrap them in deterministic, reliable code.
• Language Proficiency: Strong experience in at least one systems-level language (e.g., Go, Rust, C++, or Java).
• Infrastructure Mindset: Comfort with cloud-native architectures (AWS/GCP), container orchestration, and building secure, isolated execution sandboxes.
• Technical Communication: Ability to articulate complex architectural tradeoffs and collaborate with model researchers to bridge the gap between AI and production-grade software.

Bonus Qualifications

• Hands‑on experience with gRPC, WebSockets for high-performance streaming.
• Prior work with vector databases, distributed caching, or custom memory management systems.
• Deep knowledge of Kubernetes, microservices security, or serverless execution patterns.
• Experience building developer-facing APIs or SDKs.

Compensation

The US base salary range for this full‑time position is between $170,000 - $400,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components and benefits depending on the specific role. This information will be shared if an employment offer is extended.