Senior Backend & AI Platform Engineer (Low-Latency)

Pokee AI; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Pokee AI is building a scalable agentic AI workflow platform. You will design and maintain backend services powering APIs and infrastructure, focusing on low-latency inference and robust deployment.

You will drive end-to-end architecture, optimize model serving, and craft observability tooling to surface insights across complex AI pipelines while creating automated tests to ensure reliability as features ship.

Qualifications

• 3+ years backend or systems engineering experience shipping end-to-end products.
• Strong Python proficiency; experience with Go, C++, or Java is a strong plus.
• Deep understanding of RESTful APIs, microservices architecture, and distributed systems.
• Hands-on experience with ML frameworks and model deployment.

Responsibilities

• Design, develop, and maintain backend services that power agentic AI products, from API layer through infrastructure.
• Drive end-to-end architecture decisions, taking solutions from design through deployment and iteration.
• Build and optimize model serving infrastructure to support low-latency, high-throughput inference at scale.
• Develop observability tooling, including distributed tracing, to surface insights across complex AI workflows.
• Create automated testing frameworks that keep systems reliable as the team ships rapidly.
• Diagnose and resolve performance bottlenecks and complex production issues.

Skills

Python

RESTful APIs

Distributed systems

Microservices

ML frameworks

Education

Bachelor's or Master's in Computer Science or related field

Job description

Pokee AI is building a scalable agentic AI workflow platform. You will design and maintain backend services powering APIs and infrastructure, focusing on low-latency inference and robust deployment.

You will drive end-to-end architecture, optimize model serving, and craft observability tooling to surface insights across complex AI pipelines while creating automated tests to ensure reliability as features ship.