Backend Engineer: AI Gateway & High-Throughput APIs

Cinter Technology Services; United States; On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Insurance and 401K

Job summary

Korean IT Services and IT Consulting is seeking a Backend Engineer to build an AI Gateway. This onsite role involves designing a high-performance, secure intermediary layer between enterprise clients and AI service providers, with emphasis on latency-sensitive, scalable streaming workloads.

The candidate should have deep experience in async Python, FastAPI REST/Streaming APIs, and cloud infrastructure, plus proficiency with Kubernetes, CI/CD, and secure data handling for real-time LLM inference.

Qualifications

• 3+ years with Async Python and network programming, including asyncio, aiohttp/anyio, sockets, WebSocket/SSE, TLS handshakes, pooling, keep-alive, zero-copy buffering.

Skills

Async Python

Streaming

HTTP/2/3

FastAPI

Docker & Kubernetes

Messaging systems

PostgreSQL & Vault

Cloud networking

IaC & CI/CD

Job description

Korean IT Services and IT Consulting is seeking a Backend Engineer to build an AI Gateway. This onsite role involves designing a high-performance, secure intermediary layer between enterprise clients and AI service providers, with emphasis on latency-sensitive, scalable streaming workloads.

The candidate should have deep experience in async Python, FastAPI REST/Streaming APIs, and cloud infrastructure, plus proficiency with Kubernetes, CI/CD, and secure data handling for real-time LLM inference.