Senior Backend Architect for AI Orchestration & On-Prem

GCS Recruitment; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

GCS Recruitment seeks a Senior Backend Engineer to architect an on-premise AI orchestration platform, building secure API gateways and robust microservices for enterprise ERP and engineering data access.

You will work with Data Scientists and Platform Engineers to deliver scalable, auditable systems in regulated environments, ensuring high availability and strong security across critical workflows.

Qualifications

• 5+ years of Backend Engineering experience in distributed systems or AI/ML model deployment.
• Experience delivering governance-heavy, Stage Gate compliant projects in regulated sectors.
• Proven ability to build secure, scalable on-premise microservices and API gateways.

Responsibilities

• Architect the orchestration layer coordinating AI workers and agents.
• Design the Task Router and Intent Classifier for deterministic workflows.
• Develop API gateways and data access layers for SAP S/4HANA, Ariba, and ERP systems.
• Implement secure, observable, low-latency microservices for real-time decisions.

Skills

Python

Go

FastAPI/Django

Kubernetes

Security RBAC

APIs REST/gRPC

SQL PostgreSQL

Vector DBs Weaviate/Milvus

ERP protocols OData/SOAP

Tools

Docker

Kubernetes

NGINX

Kong

Weaviate

Milvus

Git

Job description

GCS Recruitment seeks a Senior Backend Engineer to architect an on-premise AI orchestration platform, building secure API gateways and robust microservices for enterprise ERP and engineering data access.

You will work with Data Scientists and Platform Engineers to deliver scalable, auditable systems in regulated environments, ensuring high availability and strong security across critical workflows.