Backend Engineer - AI Gateway & Real-Time Inference

SBT Global, Inc.

Englewood Cliffs (NJ)

On-site

USD 140,000 - 180,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

SBT Global, Inc. is seeking an experienced backend engineer in New Jersey to develop and maintain large-scale, real-time systems. You will work with Async Python, FastAPI, and streaming data paths to support real-time AI inference and secure cloud deployments.

The role involves API design, container orchestration, and implementing robust security and observability practices. The ideal candidate has hands-on experience with HTTP/2/3, gRPC, messaging systems, and cloud networking, to ensure

Qualifications

  • Experience with enterprise security gateways, CASB/DLP or similar edge security.
  • IAM & SSO configurations (Azure AD/Entra ID, Okta, SAML/OIDC).
  • AI/LLM pipelines: prompt engineering, PII anonymisation, Azure OpenAI usage.
  • API gateway operations: webhooks, rate limiting, circuit breakers.
  • Observability & FinOps: Datadog/Prometheus/Grafana, cost optimisation and 24/7 incident response.

Skills

Async programming
Streaming data handling
Real-time AI pipelines
API design & testing
Security & FinOps

Education

Bachelor's degree or higher

Tools

Python (asyncio)
FastAPI
Docker
Kubernetes
Redis Streams
RabbitMQ / Kafka
PostgreSQL
HashiCorp Vault
Terraform
NGINX / Envoy
Istio
GitHub Actions / GitLab CI

Job description

SBT Global, Inc. is seeking an experienced backend engineer in New Jersey to develop and maintain large-scale, real-time systems. You will work with Async Python, FastAPI, and streaming data paths to support real-time AI inference and secure cloud deployments.

The role involves API design, container orchestration, and implementing robust security and observability practices. The ideal candidate has hands-on experience with HTTP/2/3, gRPC, messaging systems, and cloud networking, to ensure

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Backend Engineer for AI Gateway (Korean Req)
Senior Backend Engineer for AI Gateway (Korean Req)

SBT Global, Inc. • Plano (TX)

On-site
USD 120,000 - 160,000
Backend Engineer _ AI Gateway
Backend Engineer _ AI Gateway

Woongjin, Inc • Englewood Cliffs (NJ)

On-site
USD 110,000
Backend Engineer — AI Gateway, Streaming & Cloud
Backend Engineer — AI Gateway, Streaming & Cloud

Woongjin, Inc • Englewood Cliffs (NJ)

On-site
USD 110,000
Backend Engineer - AI Gateway (Bilingual Korean)
Backend Engineer - AI Gateway (Bilingual Korean)

Cinter-Networks • Plano (TX)

On-site
USD 100,000 - 130,000
Insurance
401K
Backend Engineer - AI Gateway (Bilingual Korean)
Backend Engineer - AI Gateway (Bilingual Korean)

Cinter Technology Services • Plano (TX)

On-site
USD 100,000 - 130,000
Insurance
401K
Backend Engineer_AI Gateway
Backend Engineer_AI Gateway

SBT Global, Inc. • Englewood Cliffs (NJ)

On-site
USD 140,000 - 180,000
Backend Engineer - Real-Time AI Infra (Go)
Backend Engineer - Real-Time AI Infra (Go)

HappyRobot • San Francisco (CA)

On-site
USD 120,000 - 160,000
AI Backend Engineer: Build Scalable Inference Pipelines
AI Backend Engineer: Build Scalable Inference Pipelines

NTIATIVE IT Recruitment • Town of Poland (NY)

On-site
USD 120,000 - 190,000
Autonomy from day one
Work with AI technologies
High ownership and impact
+1
Senior Platform Engineer - AI Gateways & Scalability
Senior Platform Engineer - AI Gateways & Scalability

United States Digital Space LLC • Brownsville (CA)

On-site
USD 170,000 - 235,000
Stock options
Medical/Vision/Dental coverage
401(k) retirement plan
+1
Inference Platform Backend Engineer (Equity & Benefits)
Inference Platform Backend Engineer (Equity & Benefits)

Together • San Francisco (CA)

On-site
USD 160,000 - 250,000
Equity
Health insurance
Competitive compensation