Backend Engineer_AI Gateway (Korean Required)

SBT Global, Inc.; Plano (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

SBT Global, Inc. in Plano, TX seeks a seasoned backend engineer for a 1-year contract on-site.

You will own the full-stack lifecycle of a high-performance AI gateway, from core Python API service design to containerization, deployment, monitoring, and day-to-day operations. You will work solo on the application code, tests, CI/CD pipelines, and production operations with autonomy, shaping a production-grade system to route, inspect, and govern traffic between enterprise clients and AI service

Qualifications

• Around 5 years of professional backend development experience building and operating production-grade services.
• Deep understanding of asyncio and production experience with FastAPI (Pydantic, DI, OpenAPI).
• Strong grasp of HTTP/1.1, HTTP/2, and Server-Sent Events for real-time LLM inference streaming.
• Practical understanding of TCP/IP lifecycle, connection pooling, keep-alive, and back-pressure management.
• Proficiency in PostgreSQL and query tuning, including pooling via PgBouncer.
• Experience with message queues or event streams (Redis Streams, RabbitMQ, or Kafka).
• Containerization & CI/CD: Docker, Kubernetes, and setting up CI/CD pipelines (GitHub Actions / GitLab CI).
• Collaborative security and Infra awareness: NGINX/Envoy reverse-proxy setup, mTLS, IAM/SSO integrations.
• AI/LLM integration: handling LLM API payloads and rate limits, proxy/gateway patterns for AI services.
• Infrastructure as Code: basic familiarity with Terraform for multi-env infra management.

Responsibilities

• Own the full-stack lifecycle of the AI gateway from core Python API service design to containerization, deployment, monitoring, and day-to-day operations.
• Develop, test, and maintain the application code, tests, and CI/CD pipelines with minimal external dependencies.
• Manage production deployment, observability, and operations to ensure reliability at scale.
• Collaborate with security/network teams on architecture reviews, threat modeling, and policy definitions.
• Scale a robust, production-grade system for real-time LLM inference streaming and high-throughput traffic routing.

Skills

Async Python

FastAPI

HTTP/2

PostgreSQL

Docker

Kubernetes

CI/CD

Redis Streams

NGINX / Envoy

mTLS

Terraform

OpenAPI

Tools

GitHub Actions

CI/CD Pipelines

PgBouncer

Job description

• Contract

Company Description

1 yr Contract

Full-Time, On Site

Job Description

We are building an AI Gateway—a high‑performance intermediary that routes, inspects, and governs traffic between enterprise clients and LLM/AI service providers. In this role you will own the entire full‑stack lifecycle of the gateway, from core Python API service design and implementation to containerization, deployment, monitoring, and day‑to‑day operations.

While you can consult network and security specialists for architecture reviews, threat modeling, and policy definition, the application code, testing, CI/CD pipeline, and production operations will be developed and maintained solely by you. You’ll have full technical autonomy to design, build, and scale a robust, production‑grade system.

Qualifications

What we are looking for

• Experience:Around 5 yearsof professional backend development experience, with a solid track record of building and operating production‑grade services.
• Async Python & Core Web Frameworks (3+ yrs):Deep understanding ofasyncioand hands‑on production experience withFastAPI(Pydantic, dependency injection, OpenAPI).
• Strong grasp ofHTTP/1.1, HTTP/2, and SSE (Server‑Sent Events) / Chunked transfer encodingessential for real‑time LLM inference streaming.
• Practical understanding of the TCP/IP lifecycle, connection pooling, keep‑alive, and managing back‑pressure.
• Proficiency in PostgreSQL (query tuning, connection pooling via PgBouncer).
• Experience with message queues or event streams (e.g., Redis Streams, RabbitMQ, or Kafka) for decoupled task processing.
• Containerization & CI/CD:
  • Docker, Kubernetes (basic workload management, deployment, HPA), and setting up CI/CD pipelines (GitHub Actions / GitLab CI).
• Collaborative Security & Infra Awareness:Willingness to work with internal security/network teams on NGINX/Envoy reverse‑proxy setup, mTLS, or IAM/SSO (OIDC/SAML) integrations.
• AI/LLM Integration:Experience handling LLM API payloads, managing rate limits, or implementing simple proxy/gateway patterns for AI services.
• Infrastructure as Code:Basic familiarity with Terraform for multi‑env infrastructure management.

Additional Information

All your information will be kept confidential according to EEO guidelines.

By clicking the link above or any third‑party link within this posting, you are leaving this site and going to a third‑party website where the third‑party website's terms and privacy policy apply