Backend Engineer _ AI Gateway- Bilingual (Korean/ English)

Woongjin, Inc; Plano (TX); On-site; USD 115,000 - 128,000; Full time

Job summary

WOONGJIN INC. in Plano, Texas is building a high-performance AI gateway that routes, inspects, and governs traffic between enterprise clients and AI providers.

This role demands deep expertise in async Python, network programming, and cloud infrastructure to design a latency-sensitive gateway capable of handling massive streaming connections. You will work with FastAPI-based REST/Streaming APIs, Kubernetes and containerization, Redis/Kafka messaging, and secure inter-service communication with

Qualifications

• 3+ years in async Python and network programming.
• Experience with REST/Streaming APIs and FastAPI.
• Hands-on with Kubernetes and containerization.
• Experience with CI/CD and IaC tooling.
• Knowledge of cloud networking and security best practices.
• Korean language skills preferred.

Responsibilities

• Design and operate a latency-sensitive AI gateway for enterprise traffic.
• Route, inspect, and govern traffic between clients and AI services.
• Implement streaming and high-throughput data paths for real-time LLM use.
• Develop REST/Streaming APIs and ensure secure, scalable interfaces.
• Collaborate with DevOps for deployment, monitoring and incident response.

Skills

Async Python

Network Programming

FastAPI

Cloud Infrastructure

Kubernetes

Streaming Data

Security & TLS

CI/CD Pipelines

Tools

Docker

Kubernetes

Istio/Envoy

Redis Streams

RabbitMQ

Kafka

PostgreSQL

Vault

Terraform

GitHub Actions

OpenAPI/Swagger

Job description

• Contract
• Compensation: USD 115000 - USD 128000 - yearly

Company Description

For More Open Positions Visit us at:
http://recruiting.woongjininc.com/

Our Mission

WOONGJIN INC. is a rapidly growing team who provides a range of unique, exceptional, and enhanced services to our clients. We have a strong moral code that includes the service of goodness without expectations of reward. We are motivated by the sense of responsibility and servant leadership.

Job Description

We are building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs all traffic between enterprise clients and LLM/AI service providers. This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale.

What we are looking for

• AsyncPython & Network Programming (3+yrs) – Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
• Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
• Protocol Knowledge – Working familiarity with HTTP/2&HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
• FastAPI‑Based Backend (3+yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
• Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
• Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
• PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
• Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’sEncrypt).
• IaC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.

Qualifications

• Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
• IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
• AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
• Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).
• Bilingual Korean Highly Prefer

Additional Information

All your information will be kept confidential according to EEO guidelines.

*****NO C2C******

By clicking the link above or any third‑party link within this posting, you are leaving this site and going to a third‑party website where the third‑party website's terms and privacy policy apply