AI Harness Engineer

Armis

New York (NY)

On-site

USD 197,000 - 230,000

Full time

7 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

RSUs

Job summary

Armis is seeking a hands-on Backend Engineer to design and build secure AI infrastructure for production AI agents in a fast-paced startup environment. You will create Agent Control Plane capabilities, embed security into agents, and develop reusable services, APIs, and tooling that scale with AI applications.

You will collaborate with AI researchers and engineers to move prototypes to production and define engineering standards.

Qualifications

  • 5+ years of backend software engineering experience.
  • Experience building AI Harnesses.
  • Experience with Harness & AI Security.
  • Experience building backend services and microservice architectures.
  • Experience working with AWS cloud services.
  • Experience designing APIs and distributed systems.
  • Hands-on experience building AI applications, AI agents, or agentic workflows.
  • Experience working with Agent SDKs.
  • Familiarity with Model Context Protocol (MCP).
  • Experience building developer tools, APIs, or CLI applications.
  • Strong understanding of software architecture and production engineering.
  • Comfortable working in startup environments with significant ownership.
  • Ability to independently drive projects from concept through production.

Responsibilities

  • Design and build secure AI infrastructure for production AI agents.
  • Develop Agent Control Plane capabilities that manage, monitor, and secure agent execution.
  • Build embedded controls and security mechanisms directly into AI agents.
  • Develop reusable services, APIs, and developer tooling that support AI applications.
  • Build and maintain integrations with modern Agent SDKs and Model Context Protocol (MCP).
  • Design backend microservices using Python and AWS.
  • Build observability into AI systems, including telemetry, monitoring, tracing, and operational visibility.
  • Develop public-facing developer tools and command-line interfaces (CLI).
  • Partner closely with AI researchers to rapidly transition prototypes into production-ready systems.
  • Own projects from architecture through deployment.
  • Help define engineering standards and reusable patterns across the AI platform.
  • Collaborate with stakeholders across Product, Sales, and Executives while leading technical initiatives when appropriate.

Skills

Backend engineering
AI Harnesses
Harness & AI Security
Microservices
AWS
APIs & distributed systems
AI applications/agents
Agent SDKs
Model Context Protocol (MCP)
Developer tools / CLI
Software architecture
Startup ownership

Job description

We're building the next generation of secure AI infrastructure.


Our team is creating the foundational technologies that allow AI agents to operate safely, securely, and reliably at scale. This includes building secure agent control planes, embedded controls, developer tooling, observability, and infrastructure that enables production-ready AI systems.


This is a hands-on engineering role for someone who enjoys building products from the ground up. You'll partner closely with AI researchers and backend engineers to rapidly move ideas into production while helping establish engineering best practices across our AI Center of Excellence.


******This is NOT a machine learning or model training role *****

Instead, we're looking for exceptional \"Backend Engineers\" who understand modern AI systems and enjoy building the infrastructure and products around them.

What You'll Do


  • Design and build secure AI infrastructure for production AI agents.

  • Develop Agent Control Plane capabilities that manage, monitor, and secure agent execution.

  • Build embedded controls and security mechanisms directly into AI agents.

  • Develop reusable services, APIs, and developer tooling that support AI applications.

  • Build and maintain integrations with modern Agent SDKs and Model Context Protocol (MCP).

  • Design backend microservices using Python and AWS.

  • Build observability into AI systems, including telemetry, monitoring, tracing, and operational visibility.

  • Develop public-facing developer tools and command-line interfaces (CLI).

  • Partner closely with AI researchers to rapidly transition prototypes into production-ready systems.

  • Own projects from architecture through deployment.

  • Help define engineering standards and reusable patterns across the AI platform.

  • Collaborate with stakeholders across the board in our Product, Sales, and Executive teams. Along with collaborate with senior engineers while independently leading technical initiatives when appropriate


What We're Looking For

Required


  • 5+ years of backend software engineering experience.

  • Experience building AI Harnesses is required

  • Experience with Harness & AI Security is required

  • Experience building backend services and microservice architectures.

  • Experience working with AWS cloud services.

  • Experience designing APIs and distributed systems.

  • Hands-on experience building AI applications, AI agents, or agentic workflows.

  • Experience working with Agent SDKs.

  • Familiarity with Model Context Protocol (MCP).

  • Experience building developer tools, APIs, or CLI applications.

  • Strong understanding of software architecture and production engineering.

  • Comfortable working in startup environments with significant ownership.

  • Ability to independently drive projects from concept through production.


Preferred Qualifications


  • Experience building Agent Control Planes.

  • Experience implementing embedded controls or policy enforcement within AI agents.

  • Experience building AI observability platforms.

  • Security engineering background.

  • Experience building secure AI systems.

  • Experience working with LLMs in production environments.

  • Experience with Kubernetes and containerized services.

  • Experience integrating AI systems with cloud infrastructure.

  • Familiarity with AI governance, guardrails, and runtime s


Pay range: $197,000 - $230,000 Bonus & RSU's

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Harness Engineer
AI Harness Engineer

Armis • United States

On-site
USD 197,000 - 230,000
Lead Harness AI Engineer
Lead Harness AI Engineer

FICO • United States

On-site
USD 180,000 - 260,000
Harness Engineer
Harness Engineer

AI Fabrik • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior AI Agent Harness Engineer
Senior AI Agent Harness Engineer

Intel • Phoenix (AZ)

Hybrid
USD 195,000 - 362,000
AI Harness & Security Engineer (Backend/AI Agents)
AI Harness & Security Engineer (Backend/AI Agents)

Armis • United States

On-site
USD 197,000 - 230,000
Principal Software Engineer
Principal Software Engineer

Mosaic.tech • United States

On-site
USD 150,000 - 255,000
Competitive salary
Healthcare benefits
FSA
+6
AI/ML Engineer
AI/ML Engineer

Appsierra Group • United States

Hybrid
USD 200,000 - 350,000
AI Systems Engineer, Codex Agents
AI Systems Engineer, Codex Agents

OpenAI • San Francisco (CA)

On-site
USD 230,000 - 385,000
Staff Software Engineer
Staff Software Engineer

Mosaic.tech • United States

On-site
USD 150,000 - 226,000
Competitive salary
Healthcare benefits
FSA
+5
AI Engineer - GenAI & Agentic Systems
AI Engineer - GenAI & Agentic Systems

Horizontal Talent • San Diego (CA)

On-site
USD 30,000 - 63,000
medical
dental
vision
+1