Backend Engineer_AI Gateway

SBT Global, Inc.; Englewood Cliffs (NJ); On-site; USD 140,000 - 180,000; Full time

Job summary

SBT Global, Inc. is seeking an experienced backend engineer in New Jersey to develop and maintain large-scale, real-time systems. You will work with Async Python, FastAPI, and streaming data paths to support real-time AI inference and secure cloud deployments.

The role involves API design, container orchestration, and implementing robust security and observability practices. The ideal candidate has hands-on experience with HTTP/2/3, gRPC, messaging systems, and cloud networking, to ensure

Qualifications

• Experience with enterprise security gateways, CASB/DLP or similar edge security.
• IAM & SSO configurations (Azure AD/Entra ID, Okta, SAML/OIDC).
• AI/LLM pipelines: prompt engineering, PII anonymisation, Azure OpenAI usage.
• API gateway operations: webhooks, rate limiting, circuit breakers.
• Observability & FinOps: Datadog/Prometheus/Grafana, cost optimisation and 24/7 incident response.

Skills

Async programming

Streaming data handling

Real-time AI pipelines

API design & testing

Security & FinOps

Education

Bachelor's degree or higher

Tools

Python (asyncio)

FastAPI

Docker

Kubernetes

Redis Streams

RabbitMQ / Kafka

PostgreSQL

HashiCorp Vault

Terraform

NGINX / Envoy

Istio

GitHub Actions / GitLab CI

Job description

Job Description

• Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
• Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
• Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
• FastAPI‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
• Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
• Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
• PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
• Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’s Encrypt).
• IaC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.

Qualifications:

Qualifications

• Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
• IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
• AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
• API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
• Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).

Additional Information

All your information will be kept confidential according to EEO guidelines.