Senior Backend Engineer (AI Deployments)

Pengiklan Anonim

Tangerang

On-site

IDR 180,000,000 - 360,000,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Pengiklan Anonim seeks a capable Backend Engineer to own the real-time streaming backend for an AI avatar platform. You will drive the lipsync and voice-cloning pipelines, coordinate LLM and TTS/voice services, and deploy on GCP with GPU workloads.

You will excel in asynchronous Python, fast APIs, and scalable microservices, delivering low-latency, cost-aware solutions, and collaborating with frontend and infra teams to ensure robust state management.

Qualifications

  • 5+ years of backend experience with production systems.
  • Strong Python 3.10+ and asyncio expertise.
  • Experience with real-time streaming and low latency.

Responsibilities

  • Own the real-time streaming backend (WebSocket/Protobuf).
  • Develop AI orchestration services coordinating LLM, TTS/voice cloning.
  • Manage GPU inference pipelines with batching and concurrency.
  • Design a CPU-only path to reduce GPU costs when needed.
  • Build REST and WebSocket APIs and protobuf contracts.
  • Deploy with Docker on GCP and ensure reliability.

Skills

Proven Track Record
Python 3.10+
Asyncio
FastAPI
Real-Time Systems

Tools

Docker
GCP (Cloud Run, GCE)
Redis
Protobuf
WebSocket

Job description

About the Role

We are seeking an autonomous, highly skilled Backend Engineer with approximately 5 years of professional experience to drive our real-time AI avatar platform's backend. You'll own the systems that turn a user's voice into a GPU-rendered, lip-synced avatar video streamed back in real time — spanning the lipsync inference pipeline, the conversational orchestration server, and the voice-cloning/TTS service, plus their deployment across GCP.

You are a versatile backend engineer who thrives on asynchronous Python, real-time protocols, and GPU-backed inference services. You understand both the low-latency demands of streaming systems and the operational realities of running GPU workloads in production, allowing you to design services that are fast, resilient, and cost-aware.

Own the Real-Time Streaming Backend

Develop and scale the WebSocket/Protobuf streaming layer that carries audio in and lip-synced video out with tight latency budgets.

Build & Scale AI Orchestration Services

Extend the orchestration server (FastAPI, asyncio) that coordinates LLM, TTS/voice-cloning, and lipsync services per session.

Manage GPU Inference Pipelines

Work with PyTorch/CUDA-based lipsync and voice-conversion models — pipeline allocation, warm pools, batching, and multi-user concurrency on shared GPUs.

Develop a No-GPU Realistic Avatar Path

Design and build a CPU-only rendering path for realistic avatar output, so avatar sessions can run without dedicated GPU inference where full lipsync fidelity isn't required — reducing per-session cost and unlocking scale-to-zero / low-cost deployment tiers

Design & Integrate APIs

Build and evolve REST and WebSocket APIs, and Protocol Buffer message contracts shared across services and the frontend client.

Own Deployment & Reliability

Manage Docker-based deployments to GCP Cloud Run/GCE and GPU cloud providers (RunPod, Vast.ai), including config promotion, health/readiness checks, and cold-start/scaling tradeoffs.

Collaborate on System & API Design

Partner closely with the frontend engineer to co-design WebSocket/REST contracts and data flow between client and backend services.

Operate Session & State Infrastructure

Work with Redis for session/state management and GCS/Vertex AI for storage and RAG-backed retrieval.

What We're Looking For
  • Proven Track Record: 5+ years of professional software engineering experience, with a heavy emphasis on building complex, production-grade backend/distributed systems.
  • Modern Python Mastery: Deep, production-tested expertise in Python 3.10+, asyncio, type hints, and FastAPI or an equivalent async web framework.
  • Real-Time Systems Expertise: Practical experience implementing and debugging real-time communication — WebSockets, streaming protocols, and low-latency pipelines under concurrency.
  • API & Message Contract Literacy: Proven competence in REST API design and Protocol Buffers/gRPC-style message contracts shared across services.
  • Architectural Mindset: Experience designing multi-service/microservice architectures, including inter-service communication and session-state management (e.g., Redis).
  • Cloud & Infra Fluency: Hands-on experience with GCP (Cloud Run, GCE, Cloud Storage, Artifact Registry) and Docker-based deployment pipelines; comfortable with Linux server administration and troubleshooting.
  • GPU-Aware Engineering: Comfortable working alongside PyTorch/CUDA inference workloads — understanding GPU memory, batching, and concurrency constraints even if not training models yourself.
  • Independence & Ownership: A self-starter mindset with the ability to take backend services from concept to deployment independently in a fast-paced environment.
Nice to Have
  • Experience with ML inference serving (PyTorch, ONNX Runtime, model warm-loading/batching strategies).
  • Experience integrating LLM/genAI APIs (Vertex AI, Gemini, or equivalent) and RAG pipelines.
  • Familiarity with audio/video streaming concepts (encoding, real-time transport, buffering/backpressure).
  • Experience with GPU cloud providers beyond GCP (RunPod, Vast.ai) and cost/latency tradeoffs across them.
  • Firebase or equivalent auth/identity platform experience.
  • CI/CD pipeline design and implementation.
Cutting-Edge Impact:

Work directly on live, production-scale AI systems reshaping the retail industry.

True Ownership:

Lead front-end development with high autonomy, working within a fast-moving team that respects technical excellence.

A Culture of Innovation:

Join a collaborative environment where speed, creativity, and clean code are highly celebrated.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer (AI Deployments)
Senior Backend Engineer (AI Deployments)

Digital Place Vision Pte Ltd • Indonesia

On-site
IDR 360,000,000 - 720,000,000
Senior Front End Engineer (AI & Web Platform)
Senior Front End Engineer (AI & Web Platform)

Pengiklan Anonim • Tangerang

On-site
IDR 200,000,000 - 280,000,000
Senior Backend Engineer: Real-Time AI Deployments
Senior Backend Engineer: Real-Time AI Deployments

Digital Place Vision Pte Ltd • Indonesia

On-site
IDR 360,000,000 - 720,000,000
Real-Time AI Backend Engineer: GPU Inference
Real-Time AI Backend Engineer: GPU Inference

Pengiklan Anonim • Tangerang

On-site
IDR 180,000,000 - 360,000,000
AI Systems Architect
AI Systems Architect

UltaHost • Jakarta Pusat

On-site
IDR 600,000,000 - 900,000,000
Lead AI Engineer / AI Solutions Architect (Remote)
Lead AI Engineer / AI Solutions Architect (Remote)

Hipster (Private Limited) • Provinsi Bali

Remote
IDR 1,631,913,000 - 2,357,208,000
Remote work
Senior Backend Engineer
Senior Backend Engineer

Accelbyte, Inc. • Sleman

On-site
IDR 525,210,084 - 1,050,420,168
Forward Deployed Engineer
Forward Deployed Engineer

PT Sea Group • Indonesia

On-site
IDR 400,000,000 - 800,000,000
Front End Engineer
Front End Engineer

Digital Place Vision Pte Ltd • Indonesia

On-site
IDR 180,000,000 - 240,000,000
AI Engineer
AI Engineer

VentureSEA • Jakarta Pusat

On-site
IDR 300,000,000 - 600,000,000
null