Python Developer

Marlabs

Englewood Cliffs (NJ)

On-site

USD 140,000 - 190,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Marlabs in Plano, TX is seeking a Python/backend engineer to design a latency-sensitive gateway handling massive concurrent streams. The role requires deep expertise in async Python, network programming, and cloud infrastructure to build scalable services.

You will work on HTTP/2/HTTP/3, gRPC, FastAPI APIs, and containerized deployments with Docker and Kubernetes, ensuring secure, observable operations with TLS, mTLS, Vault, and zero-downtime updates.

Qualifications

  • Experience with asyncio and low-level sockets for streaming APIs.
  • Proven track record in building scalable, latency-sensitive services.
  • Hands-on with FastAPI and REST/Streaming APIs.
  • Experience deploying with Docker and Kubernetes in cloud environments.
  • Familiarity with Redis, Kafka, and messaging queues.
  • Knowledge of TLS, mTLS, and secure service-to-service communication.
  • Experience with IaC and CI/CD pipelines.

Skills

Async Python
Network Programming
Streaming
HTTP/2 & HTTP/3
gRPC
FastAPI
Dependency Injection
CI/CD
Kubernetes
Redis Streams
Kafka
PostgreSQL
Vault
TLS/mTLS
Envoy/NGINX
Terraform
IaC
AI/LLM Pipelines

Tools

Docker
AKS/EKS/GKE
Istio/Envoy
PgBouncer
GitHub Actions

Job description

Hiring Python / Backend Engineer, Plano, TX- Fulltime role, NO C2C, Onsite 5 days a week.

This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale.

What we are looking for
  • Async Python & Network Programming (3 + yrs) – Strong hands on experience with asyncio, aiohttp/anyio, low level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection pooling, keep alive, and zero copy buffering.
  • Streaming & Large Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back pressure and high throughput data paths for real time LLM inference.
  • Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
  • FastAPI Based Backend (3 + yrs) – Design, develop and test production grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
  • Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service mesh (e.g., Istio/Envoy) basics.
  • Async Messaging & Event Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back off logic.
  • PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
  • Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’s Encrypt).
  • IaC & CI/CD – Terraform modules for multi env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue green deployments.
  • Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge security platforms; centralized logging & audit trails.
  • IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
  • AI/LLM Pipelines – Building prompt engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
  • API Gateway Operations – Custom webhook/REST integrations, circuit breaker patterns, rate limiting, auto retry and health checking.
  • Observability & FinOps – End to end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost optimisation and 24/7 incident response (SLA/SLO).
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Backend Engineer - AI Gateway
Backend Engineer - AI Gateway

Cinter Technology Services • United States

On-site
USD 100,000 - 130,000
Insurance and 401K
Backend Engineer _ AI Gateway
Backend Engineer _ AI Gateway

Woongjin, Inc • Englewood Cliffs (NJ)

On-site
USD 110,000
Backend Engineer_AI Gateway
Backend Engineer_AI Gateway

SBT Global, Inc. • Englewood Cliffs (NJ)

On-site
USD 140,000 - 180,000
Backend Engineer - AI Gateway (Bilingual Korean)
Backend Engineer - AI Gateway (Bilingual Korean)

Cinter Technology Services • Plano (TX)

On-site
USD 100,000 - 130,000
Insurance
401K
Backend Engineer - AI Gateway (Bilingual Korean)
Backend Engineer - AI Gateway (Bilingual Korean)

Cinter-Networks • Plano (TX)

On-site
USD 100,000 - 130,000
Insurance
401K
Python Backend Engineer
Python Backend Engineer

ClinDCast LLC • San Jose (CA)

On-site
USD 100,000 - 150,000
Python Engineer C2C contract at San Jose, CA
Python Engineer C2C contract at San Jose, CA

Tech Mirrors • San Jose (CA)

On-site
USD 100,000 - 130,000
Python Backend Engineer
Python Backend Engineer

TechDigital Group • San Jose (CA)

On-site
USD 100,000 - 130,000
Backend Engineer_AI Gateway (Korean Required)
Backend Engineer_AI Gateway (Korean Required)

Sbtglobalinc • Plano (TX)

On-site
USD 120,000 - 180,000
Backend Engineer _ AI Gateway- Bilingual (Korean/ English)
Backend Engineer _ AI Gateway- Bilingual (Korean/ English)

Woongjin, Inc • Plano (TX)

On-site
USD 115,000 - 128,000