Senior Backend Engineer for AI Gateway (Korean Req)

SBT Global, Inc.

Plano (TX)

On-site

USD 120,000 - 160,000

Full time

4 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

SBT Global, Inc. in Plano, TX seeks a seasoned backend engineer for a 1-year contract on-site.

You will own the full-stack lifecycle of a high-performance AI gateway, from core Python API service design to containerization, deployment, monitoring, and day-to-day operations. You will work solo on the application code, tests, CI/CD pipelines, and production operations with autonomy, shaping a production-grade system to route, inspect, and govern traffic between enterprise clients and AI service

Qualifications

  • Around 5 years of professional backend development experience building and operating production-grade services.
  • Deep understanding of asyncio and production experience with FastAPI (Pydantic, DI, OpenAPI).
  • Strong grasp of HTTP/1.1, HTTP/2, and Server-Sent Events for real-time LLM inference streaming.
  • Practical understanding of TCP/IP lifecycle, connection pooling, keep-alive, and back-pressure management.
  • Proficiency in PostgreSQL and query tuning, including pooling via PgBouncer.
  • Experience with message queues or event streams (Redis Streams, RabbitMQ, or Kafka).
  • Containerization & CI/CD: Docker, Kubernetes, and setting up CI/CD pipelines (GitHub Actions / GitLab CI).
  • Collaborative security and Infra awareness: NGINX/Envoy reverse-proxy setup, mTLS, IAM/SSO integrations.
  • AI/LLM integration: handling LLM API payloads and rate limits, proxy/gateway patterns for AI services.
  • Infrastructure as Code: basic familiarity with Terraform for multi-env infra management.

Responsibilities

  • Own the full-stack lifecycle of the AI gateway from core Python API service design to containerization, deployment, monitoring, and day-to-day operations.
  • Develop, test, and maintain the application code, tests, and CI/CD pipelines with minimal external dependencies.
  • Manage production deployment, observability, and operations to ensure reliability at scale.
  • Collaborate with security/network teams on architecture reviews, threat modeling, and policy definitions.
  • Scale a robust, production-grade system for real-time LLM inference streaming and high-throughput traffic routing.

Skills

Async Python
FastAPI
HTTP/2
PostgreSQL
Docker
Kubernetes
CI/CD
Redis Streams
NGINX / Envoy
mTLS
Terraform
OpenAPI

Tools

GitHub Actions
CI/CD Pipelines
PgBouncer

Job description

SBT Global, Inc. in Plano, TX seeks a seasoned backend engineer for a 1-year contract on-site.

You will own the full-stack lifecycle of a high-performance AI gateway, from core Python API service design to containerization, deployment, monitoring, and day-to-day operations. You will work solo on the application code, tests, CI/CD pipelines, and production operations with autonomy, shaping a production-grade system to route, inspect, and govern traffic between enterprise clients and AI service

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Backend Engineer: AI Gateway (Korean Required)
Senior Backend Engineer: AI Gateway (Korean Required)

Sbtglobalinc • Plano (TX)

On-site
USD 120,000 - 180,000
Backend Engineer – AI Gateway (Bilingual Korean)
Backend Engineer – AI Gateway (Bilingual Korean)

Cinter Technology Services • Plano (TX)

On-site
USD 100,000 - 130,000
Insurance
401K
Backend Engineer: AI Gateway & High-Throughput APIs
Backend Engineer: AI Gateway & High-Throughput APIs

Cinter Technology Services • United States

On-site
USD 100,000 - 130,000
Insurance and 401K
Backend Engineer - AI Gateway (Bilingual Korean)
Backend Engineer - AI Gateway (Bilingual Korean)

Cinter Technology Services • Plano (TX)

On-site
USD 100,000 - 130,000
Insurance
401K
Backend Engineer - AI Gateway (Bilingual Korean)
Backend Engineer - AI Gateway (Bilingual Korean)

Cinter-Networks • Plano (TX)

On-site
USD 100,000 - 130,000
Insurance
401K
Bilingual Backend Engineer for AI Gateway (KR/EN)
Bilingual Backend Engineer for AI Gateway (KR/EN)

Crystal Equation Corporation • Plano (TX)

On-site
USD 76,000 - 83,000
Paid time off
Medical/dental/vision insurance
401K
+1
Backend Engineer - AI Gateway
Backend Engineer - AI Gateway

Cinter Technology Services • United States

On-site
USD 100,000 - 130,000
Insurance and 401K
Backend Engineer_AI Gateway (Korean Required)
Backend Engineer_AI Gateway (Korean Required)

SBT Global, Inc. • Plano (TX)

On-site
USD 120,000 - 160,000
Backend Engineer (Korean Bilingual) for AI Gateway
Backend Engineer (Korean Bilingual) for AI Gateway

Woongjin, Inc • Plano (TX)

On-site
USD 115,000 - 128,000
Backend Engineer _ AI Gateway- Bilingual (Korean/ English)
Backend Engineer _ AI Gateway- Bilingual (Korean/ English)

Woongjin, Inc • Plano (TX)

On-site
USD 115,000 - 128,000