Backend Engineer_AI Gateway (Korean Required)

Sbtglobalinc; Plano (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Sbtglobalinc in Plano, TX is building an AI Gateway—a high-performance intermediary that routes, inspects, and governs traffic between enterprise clients and LLM/AI service providers. You will own the full-stack lifecycle of the gateway, from core Python API design to containerization, deployment, monitoring, and day-to-day operations.

We seek a backend expert with ~5 years' production experience, strong asyncio and FastAPI skills, and solid knowledge of HTTP/2, SSE, PostgreSQL, and distributed

Qualifications

• 5 years of backend development experience in production-grade services.
• Strong experience with asyncio and FastAPI in production.
• Deep understanding of HTTP/1.1/HTTP/2 and SSE for real-time streaming.
• Experience with PostgreSQL and connection pooling.
• Experience with message queues or streaming (Redis Streams, Kafka, or RabbitMQ).
• Hands-on with Docker and Kubernetes for deployment and scaling.
• Familiarity with CI/CD pipelines (GitHub Actions or GitLab CI).
• Understanding of NGINX/Envoy reverse proxies and mTLS/IAM/SO integrations.

Responsibilities

• Own full-stack lifecycle of the gateway from design to production operations.
• Develop and maintain API services, tests, and CI/CD pipelines.
• Configure and operate streaming inference paths for real-time AI services.
• Collaborate with security/network teams on architecture reviews.
• Monitor, scale, and troubleshoot production-grade systems.

Skills

Async Python

FastAPI

HTTP/2 & SSE

TCP/IP basics

PostgreSQL

Distributed queues

CI/CD practices

Tools

Docker

Kubernetes

GitHub Actions

GitLab CI

Job description

We are building an AI Gateway-a high-performance intermediary that routes, inspects, and governs traffic between enterprise clients and LLM/AI service providers. In this role you will own the entire full-stack lifecycle of the gateway, from core Python API service design and implementation to containerization, deployment, monitoring, and day-to-day operations. While you can consult network and security specialists for architecture reviews, threat modeling, and policy definition, the application code, testing, CI/CD pipeline, and production operations will be developed and maintained solely by you. You'll have full technical autonomy to design, build, and scale a robust, production-grade system.

What we are looking for

• Experience: Around 5 years of professional backend development experience, with a solid track record of building and operating production-grade services.
• Async Python & Core Web Frameworks (3+ yrs): Deep understanding of asyncio and hands-on production experience with FastAPI (Pydantic, dependency injection, OpenAPI).
• Network Protocol & Streaming Fundamentals: Strong grasp of HTTP/1.1, HTTP/2, and SSE (Server-Sent Events) / Chunked transfer encoding essential for real-time LLM inference streaming.
• Practical understanding of the TCP/IP lifecycle, connection pooling, keep-alive, and managing back‑pressure.
• Database & Async Messaging: Proficiency in PostgreSQL (query tuning, connection pooling via PgBouncer).
• Experience with message queues or event streams (e.g., Redis Streams, RabbitMQ, or Kafka) for decoupled task processing.
• Containerization & CI/CD: Docker, Kubernetes (basic workload management, deployment, HPA), and setting up CI/CD pipelines (GitHub Actions / GitLab CI).

Work experience desired

• Collaborative Security & Infra Awareness: Willingness to work with internal security/network teams on NGINX/Envoy reverse-proxy setup, mTLS, or IAM/SSO (OIDC/SAML) integrations.
• AI/LLM Integration: Experience handling LLM API payloads, managing rate limits, or implementing simple proxy/gateway patterns for AI services.
• Infrastructure as Code: Basic familiarity with Terraform for multi-env infrastructure management.

All your information will be kept confidential according to EEO guidelines.