Senior AI Platform Engineer – Remote, High-Impact Systems

name; United States; On-site; USD 210,000 - 230,000; Full time

Benefits offered by this job

Fully remote work environment

Competitive base salary

Competitive equity package

High-impact role in growth engineering

Ownership of cutting-edge AI products

Job summary

Himalayas is seeking a Senior/Staff Software Engineer to design and build next-generation AI-powered agent platforms for customer-facing applications. This remote role welcomes candidates in the United States or Canada and emphasizes hands-on experience shipping production-grade LLM or agentic systems.

You will lead cross-functional initiatives, mentor engineers, and own backend architecture from concept through production while balancing latency, reliability, and cost.

Qualifications

• 5+ years of professional software engineering experience.
• Proven experience building and shipping production-grade AI/LLM-powered applications or agentic systems.
• Strong expertise in backend development using Node.js and TypeScript.
• Experience designing scalable distributed systems, microservices, and backend infrastructure.
• Hands-on experience with: Tool calling, Prompt engineering, Agent loops, AI orchestration frameworks.
• Familiarity with evaluation and observability tooling for non-deterministic AI systems such as LangSmith, Braintrust, and custom evaluation frameworks.
• Full-stack engineering experience with modern frontend frameworks such as React and TypeScript.
• Strong understanding of databases such as PostgreSQL and MongoDB.
• Excellent communication and collaboration skills with cross-functional teams.
• Demonstrated ownership mentality and ability to operate independently in ambiguous environments.

Responsibilities

• Own and deliver AI agent experiences end-to-end, including backend orchestration, LLM integrations, conversational interfaces, tool execution, and evaluation systems.
• Design scalable architectures for agentic AI systems and contribute to platform-level AI infrastructure.
• Build and improve shared systems such as: Tool abstractions, Retrieval pipelines / RAG systems, Conversation persistence, Evaluation frameworks, Permissioning and observability.
• Collaborate closely with Product, Design, and Engineering leadership to define technical direction and product strategy.
• Make thoughtful engineering tradeoffs balancing latency, reliability, scalability, and cost efficiency.
• Improve AI system quality through experimentation, evaluation frameworks, and continuous iteration.
• Lead or contribute to large-scale technical initiatives across multiple teams.
• Mentor engineers and promote engineering best practices across the organization.

Skills

Node.js

TypeScript

Backend architecture

Distributed systems

AI tooling

Prompt engineering

Agent orchestration

Observability tooling

React

PostgreSQL

MongoDB

Cross-functional leadership

Tools

LangSmith

Braintrust

Custom evaluation frameworks

Job description

Himalayas is seeking a Senior/Staff Software Engineer to design and build next-generation AI-powered agent platforms for customer-facing applications. This remote role welcomes candidates in the United States or Canada and emphasizes hands-on experience shipping production-grade LLM or agentic systems.

You will lead cross-functional initiatives, mentor engineers, and own backend architecture from concept through production while balancing latency, reliability, and cost.