Senior Backend Architect: AI Orchestration & On-Prem

GCS Recruitment; United States; Remote; USD 120,000 - 210,000; Full time

Job summary

GCS Recruitment is seeking a Senior Back-end Engineer to architect production-grade backend services for a large-scale AI transformation programme. You will design secure API gateways, orchestration layers, and on-premise microservices that enable LLMs to interact with ERP systems and engineering data.

The role emphasizes governance, Stage Gate reviews, and high-availability engineering, with responsibilities spanning agent orchestration, enterprise integration, and robust monitoring.

Qualifications

• 5+ years of backend engineering experience.
• Experience building distributed systems for production-scale AI/ML applications.
• Strong knowledge of REST and gRPC APIs.
• On-premise deployment and security-conscious development.
• Collaboration with data scientists and frontend engineers.

Responsibilities

• Architect orchestration layer and agent framework for AI workflows.
• Design secure API gateways and data access layers for SAP S/4HANA/Ariba.
• Ensure reliability with logs, tracing, monitoring, and governance.

Skills

Python

Distributed systems

RESTful APIs

gRPC

Security & RBAC

Tools

Docker

Kubernetes

Weaviate

Milvus

SAP S/4HANA

Ariba

Kong

NGINX

Job description

GCS Recruitment is seeking a Senior Back-end Engineer to architect production-grade backend services for a large-scale AI transformation programme. You will design secure API gateways, orchestration layers, and on-premise microservices that enable LLMs to interact with ERP systems and engineering data.

The role emphasizes governance, Stage Gate reviews, and high-availability engineering, with responsibilities spanning agent orchestration, enterprise integration, and robust monitoring.