Senior Backend Engineer

GCS Recruitment

United States

Remote

USD 150,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

GCS Recruitment seeks a Senior Backend Engineer to architect an on-premise AI orchestration platform, building secure API gateways and robust microservices for enterprise ERP and engineering data access.

You will work with Data Scientists and Platform Engineers to deliver scalable, auditable systems in regulated environments, ensuring high availability and strong security across critical workflows.

Qualifications

  • 5+ years of Backend Engineering experience in distributed systems or AI/ML model deployment.
  • Experience delivering governance-heavy, Stage Gate compliant projects in regulated sectors.
  • Proven ability to build secure, scalable on-premise microservices and API gateways.

Responsibilities

  • Architect the orchestration layer coordinating AI workers and agents.
  • Design the Task Router and Intent Classifier for deterministic workflows.
  • Develop API gateways and data access layers for SAP S/4HANA, Ariba, and ERP systems.
  • Implement secure, observable, low-latency microservices for real-time decisions.

Skills

Python
Go
FastAPI/Django
Kubernetes
Security RBAC
APIs REST/gRPC
SQL PostgreSQL
Vector DBs Weaviate/Milvus
ERP protocols OData/SOAP

Tools

Docker
Kubernetes
NGINX
Kong
Weaviate
Milvus
Git

Job description

Role Summary

We are seeking a Senior Backend Engineer to build the production-grade application architecture for a large-scale AI transformation programme. You will be the architect behind the "nervous system" of AI agents, designing the secure API gateways and orchestration layers that allow Large Language Models (LLMs) to interact with enterprise ERPs and sensitive engineering data. You will act as the technical anchor for critical build initiatives across flagship programmes. Your mandate is to move beyond simple model serving and build robust, on-premise microservices that power enterprise engineering platforms and autonomous AI agents. Working within a structured "Stage Gate" delivery model, you will ensure software meets strict security and reliability standards required in highly regulated environments.

Key Responsibilities
  1. Agent Orchestration & System Architecture
    • Agentic Frameworks: Architect the orchestration layer (Agent of Agents) that coordinates specialized AI workers (e.g., Controllership Agent, Treasury Agent), managing state, task routing, and error handling.
    • Workflow Logic: Design the "Task Router & Intent Classifier" services that map user prompts to specific skills/playbooks, ensuring deterministic execution of critical financial and engineering workflows.
    • Microservices Design: Build scalable, containerized microservices that handle high-concurrency requests, ensuring low-latency responses for real-time market intelligence and design trade-off analysis.
  2. Enterprise Integration & API Gateways
    • Secure SAP Connectivity: Build the "Data Access Layer" (DAL) that serves as the secure gateway for AI agents to read/write to SAP S/4HANA and Ariba, enforcing strict validation logic before any transaction is committed.
    • Scalable Data Lakehouse Connectivity: Build a scalable, secure, observable connection layer to the central data platform, ensuring all read transactions are authenticated, authorized, and properly audited.
    • RAG Integration: Develop the backend logic to interface with Vector Databases (e.g., Weaviate) and Retrieval Models, enabling AI-powered knowledge mining solutions to securely query historical proposals and technical documents.
    • External API Managers: Construct robust connectors for external data feeds (e.g., S&P Global, Orbis), handling rate limiting, caching, and data normalization.
  3. Security, Performance & Deployment
    • Enterprise-Grade Security: Implement "Gateway & Policy Guard" services that enforce Authentication, Role-Based Access Control (RBAC), and PII/ITAR redaction before data reaches an LLM.
    • On-Premise Optimization: Engineer systems for strictly air-gapped or on-premise deployment, optimizing efficient resource usage on local GPU clusters.
    • Reliability Engineering: Implement comprehensive logging, tracing, monitoring, and observability mechanisms while adhering to enterprise best practices and governance standards.
Technical Requirements
  • Core Languages: Expert proficiency in Python (FastAPI/Django) for AI integration and Go or Java for high-performance microservices.
  • Containerization & Orchestration: Deep experience with Docker and Kubernetes (K8s) for deploying scalable applications in on-premise environments.
  • API Architecture: Strong background in designing RESTful APIs and gRPC services. Experience building API Gateways (e.g., Kong, NGINX) for traffic management and security.
  • Database Management: Proficiency with Relational Databases (PostgreSQL) for transactional data and Vector Databases (Weaviate, Milvus) for semantic search applications.
  • Integration Protocols: Familiarity with enterprise integration patterns and ERP protocols (OData, SOAP) is a strong plus.
Professional Qualifications
  • Experience: 5+ years of experience in Backend Engineering, with a focus on building distributed systems or platforms that serve ML/AI models in production.
  • Structured Delivery: Ability to thrive in a "Governance Collision" environment, delivering Agile software (Sprints, MVPs) that passes rigorous "Stage Gate" reviews and Systems Engineering audits.
  • Operational Mindset: Experience building systems that require high availability and auditability, preferably in Fintech, Healthcare, Defence, or other highly regulated sectors.
  • Collaboration: Proven track record of working with Data Scientists to productize models and Frontend Engineers to deliver seamless user experiences.
Why This Role?

You are not just building APIs; you are building the "hands" that allow AI to do real work. Your code will enable AI agents to automate complex workflows, forecast critical operational risks, and support engineering and business decision-making. If you want to build the secure, high-performance architecture that makes AI tangible, this role is for you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Software Engineer
Senior AI Software Engineer

Liberty Personnel Services, Inc. • New York (NY)

On-site
USD 140,000 - 200,000
Remote Backend Engineer
Remote Backend Engineer

IntePros • United States

On-site
USD 120,000 - 180,000
Backend Engineer
Backend Engineer

ProNexus • San Francisco (CA)

On-site
USD 150,000 - 190,000
Principal Engineer & Architect - AI Agent Plaform
Principal Engineer & Architect - AI Agent Plaform

DevSavant Inc. • United States

Remote
USD 180,000 - 240,000
Senior Software/AI engineer Central Europe
Senior Software/AI engineer Central Europe

Zoolatech • Central (LA)

On-site
USD 140,000 - 190,000
Senior AI Engineer
Senior AI Engineer

Goliath Partners Inc. • San Francisco (CA)

On-site
USD 290,000 - 350,000
Principal Software Engineer – Backend
Principal Software Engineer – Backend

enlyft • Kirkland (WA)

On-site
USD 180,000 - 260,000
Senior AI Engineer - Forward Deployed (FDE)
Senior AI Engineer - Forward Deployed (FDE)

Moring • Atlanta (GA)

On-site
USD 150,000 - 220,000
Senior AI Platform Engineer - Agent Orchestration & SDLC
Senior AI Platform Engineer - Agent Orchestration & SDLC

Anblicks • Dallas (TX)

On-site
USD 140,000 - 190,000
Applied AI Engineer
Applied AI Engineer

Hydrogen Group • Palo Alto (CA)

On-site
USD 100,000 - 130,000