AI Software Engineer

HRCap, Inc.

United States

Hybrid

USD 120,000 - 180,000

Full time

4 hours ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

HRCap, Inc. is seeking an AI Software Engineer to join our U.S. founding team. You will architect backend systems for domain-specific AI services, leverage vision-language models, and integrate advanced agent loops for production-grade deployments.

The role focuses on building scalable inference systems, low-latency streaming, and multi-GPU orchestration while collaborating with global product teams to translate client needs into robust, high-performance AI platforms.

Qualifications

  • 3+ years of professional experience developing, deploying, and operating live AI-based services or cloud applications.
  • Strong CS fundamentals: OS, computer architecture, data structures, and algorithms.
  • Proficiency in Python, Java, or C/C++ and modern backend frameworks (FastAPI, Flask, Django, Spring Boot).
  • Relational databases experience with PostgreSQL or MySQL.
  • Experience designing LLM-backed services or AI Agents and using AI developer tools.
  • Strong global communication to align technical solutions with business needs.

Responsibilities

  • Design, build, and optimize backend architectures for AI services using CV, VLMs, and LLMs.
  • Prototype features with AI tools and harden them into production-ready APIs.
  • Deploy, monitor, and operate live AI inference services across cloud and on-prem multi-GPU environments.
  • Design runtime and orchestration layers for autonomous AI Agents with tool-calling and memory management.
  • Migrate services to MCP servers and define interfaces for Agents to interact with backend.
  • Integrate multi-modal LLM APIs and establish prompt-engineering structures.

Skills

Backend development (AI services)
CS fundamentals
Programming languages: Python/Java/C/C
Databases: PostgreSQL/MySQL
AI tooling & LLM tooling
Global/cross-functional collaboration

Tools

FastAPI
Flask
Django
Spring Boot
PostgreSQL
MySQL
Websockets
LangChain
LangGraph

Job description

A rapidly growing, world-class AI technology firm is aggressively expanding its U.S. presence. Leveraging industry-leading AI to solve major industry challenges, the firm builds robust, automated product ecosystems. We are hiring a talented AI Software Engineer (3+ years experience) to join the foundational U.S. team. This role is at the absolute frontier of artificial intelligence, focusing on building domain-specific AI applications, developing sophisticated autonomous Agent architectures, and scaling global inference systems.

Why Join Us
  • Ground-Floor Market Expansion: Experience the high-impact, high-ownership environment of launching a global tech firm's U.S. presence, backed by deeply established international corporate resources.
  • Frontier AI Engineering: Move beyond basic API integrations. You will architect autonomous Agent loops, design complex tool-calling mechanics, and build with cutting-edge infrastructure like the Model Context Protocol (MCP).
  • End-to-End System Ownership: Take absolute ownership over the entire lifecycle—from rapid prototyping and proof-of-concept (PoC) validation to hardening services into production-ready, global-scale systems.
  • Advanced Architecture Challenges: Tackle sophisticated optimization problems, including low-latency multi-modal streaming, multi-GPU resource scaling, and enterprise-grade SLA management.
Responsibilities
AI Service Commercialization & Backend Engineering
  • Design, build, and optimize cost-efficient, scalable backend architectures for domain-specific AI services utilizing Computer Vision, vision-language models (VLMs), and Large Language Models (LLMs).
  • Rapidly prototype new product features using AI-powered developer tools, then systematically harden them into highly stable, secure, and production-ready enterprise APIs.
  • Deploy, monitor, and operate live AI inference services across distributed cloud and on-premise multi-GPU environments.
  • Design and implement the runtime execution and orchestration layer for autonomous AI Agents, incorporating complex tool-calling, advanced reasoning patterns, and stateful memory management.
  • Migrate existing services to Model Context Protocol servers, defining well-structured interfaces so autonomous Agents can seamlessly interact with backend infrastructure.
  • Integrate multi-modal LLM APIs and establish systematic prompt-engineering structures to safely handle edge cases and runtime exceptions.
Reliability, SLAs & Cross-Functional Alignment
  • Establish, monitor, and optimize Agent service SLAs, explicitly defining SLIs/SLOs around response latency, availability, and error rates.
  • Architect resilient fallback mechanisms, retry policies, and circuit breaker strategies to guarantee high-availability service performance.
  • Collaborate closely with global product management, business development, and core AI research teams to translate real-world client needs into high-performance technical systems.
Qualifications
Required
  • Experience: 3+ years of professional experience developing, deploying, and operating live, production-grade AI-based services or cloud applications.
  • CS Fundamentals: Exceptional command of core Computer Science fundamentals, including Operating Systems, computer system architecture, data structures, and algorithms.
  • Technical Stack: High proficiency in at least one major programming language (Python, Java, or C/C++) and experience with modern backend frameworks (e.g., FastAPI, Flask, Django, or Spring Boot).
  • Database Design: Proven experience building and optimizing relational databases using RDBMS ecosystems like PostgreSQL or MySQL.
  • AI Tooling & Mindset: Previous exposure to designing LLM-backed services or AI Agents, paired with a history of using AI developer tools to supercharge personal development productivity.
  • Global Readiness: Strong communication skills to proactively align technical solutions with business needs. No restrictions on international or overseas travel.
Preferred
  • Advanced Agent Frameworks: Hands-on experience implementing multi-agent architectures or complex workflows using frameworks like LangChain, LangGraph, or custom-built loop logic through the execution of iterative reasoning loops.
  • Network & API Optimizations: Deep understanding of designing real-time streaming responses, websockets, and highly asynchronous API architectures.
  • Advanced Retrieval & Inference: Experience building optimized data pipelines for function calling, RAG (Retrieval-Augmented Generation), and handling high-traffic global inference under constrained GPU resources.
  • Protocol Expertise: Foundational knowledge of MCP (Model Context Protocol) concepts or hands-on experience building custom MCP servers.
  • Location: United States (U.S. Market Division — Hybrid / Remote Options Available)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer - Forward Deployed
AI Engineer - Forward Deployed

Moring • Atlanta (GA)

On-site
USD 120,000 - 160,000
Senior Agentic AI Engineer
Senior Agentic AI Engineer

ImagineX Consulting • United States

Remote
USD 150,000 - 190,000
AI Software Engineer
AI Software Engineer

Vcloud Technologies Investment • United States

Remote
USD 180,000 - 240,000
Founding Engineer - Applied AI
Founding Engineer - Applied AI

Ersilia • San Francisco (CA)

On-site
USD 170,000 - 210,000
Unlimited PTO
Health insurance
Visa sponsorship
Lead AI Engineer
Lead AI Engineer

Salt • New York (NY)

On-site
USD 180,000 - 230,000
Senior Agentic AI Engineer
Senior Agentic AI Engineer

ImagineX LLC • Northern (KY)

Hybrid
USD 140,000 - 190,000
Senior Agentic AI Engineer
Senior Agentic AI Engineer

Build • Northern (KY)

Hybrid
USD 150,000 - 190,000
Architect / Principal Software Engineer
Architect / Principal Software Engineer

EPAM Systems • United States

On-site
USD 180,000 - 260,000
AI Engineer/Architect
AI Engineer/Architect

Empiric • Indianapolis (IN)

On-site
USD 100,000 - 150,000
Staff AI Engineer
Staff AI Engineer

Eleven Recruiting • United States

Remote
USD 180,000 - 240,000