Backend Engineer — AI Gateway, Streaming & Cloud

Woongjin, Inc; Englewood Cliffs (NJ); On-site; USD 99,000 - 121,000; Full time

Job summary

Woongjin, Inc in Englewood Cliffs, NJ is building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs traffic between enterprise clients and LLM/AI service providers. The role demands deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive gateway handling massive concurrent streaming connections.

Candidates should be proficient with FastAPI, Docker/Kubernetes, Redis streams, gRPC, and

Qualifications

• 3+ years in async Python and network programming.
• Experience with streaming, chunked transfer, and real-time LLM inference.
• Familiarity with HTTP/2/HTTP/3, gRPC, and custom parsers.
• Backend API development with FastAPI and OpenAPI docs.
• Containerization and Kubernetes with scaling and canary deployments.
• Experience with Redis Streams, RabbitMQ or Kafka.
• Database experience with PostgreSQL and Vault for secrets management.
• Cloud networking, TLS termination, mTLS, and cert automation.
• IaC with Terraform and CI/CD pipelines (GitHub Actions/GitLab).

Skills

Async Python

Network Programming

Streaming data handling

Protocol knowledge

FastAPI

Observability & FinOps

Tools

Docker

Kubernetes

Istio/Envoy

Terraform

GitHub Actions

GitLab CI

PgBouncer

HashiCorp Vault

Redis

RabbitMQ

Kafka

Nginx/Envoy

Job description

Woongjin, Inc in Englewood Cliffs, NJ is building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs traffic between enterprise clients and LLM/AI service providers. The role demands deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive gateway handling massive concurrent streaming connections.

Candidates should be proficient with FastAPI, Docker/Kubernetes, Redis streams, gRPC, and