Senior AI Orchestrator — Remote, LLM & Python

Jobgether; United States; Remote; USD 140,000 - 230,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Meal and food allowances

Childcare assistance

Extended parental leave

Wellness benefits

Profit-sharing program (PLR)

Life insurance

Continuous learning

Online learning opportunities

Language learning

Discount club

Physical and mental well-being

Parental support

Inclusive workplace

Remote work

Job summary

Jobgether is seeking an experienced Python-based AI orchestration engineer to design, develop, and maintain AI agent orchestration services for voice and chat channels. You will build low-latency conversational workflows, integrate LangChain/LlamaIndex, and collaborate with SREs on OCI and Kubernetes deployments.

You will apply prompt engineering, secure REST APIs with mTLS, monitor latency and costs with Langfuse, and work with data scientists to improve model quality and safety.

Qualifications

• Advanced Python development skills with reliable backend services.
• Experience orchestrating LLM-powered apps using LangChain or LlamaIndex.
• Knowledge of observability, tracing, and cost monitoring using Langfuse.
• Experience with secure REST APIs and mutual TLS (mTLS).

Responsibilities

• Design, develop, and maintain Python-based AI orchestration services.
• Build conversational workflows with low latency and high accuracy.
• Integrate AI workflows with enterprise systems via APIs.
• Implement and manage LLM orchestration with LangChain/LlamaIndex.
• Apply prompt engineering to improve responses and relevance.
• Collaborate with SREs to deploy on OCI/OKE.

Skills

Python development

LLM orchestration

LangChain/LlamaIndex

Prompt engineering

API security (mTLS)

Observability (Langfuse)

SRE collaboration

Production troubleshooting

Tools

LangChain

LlamaIndex

Langfuse

MCP servers

OCI Generative AI SDK

Docker

Kubernetes

OKE

Redis

Job description

Jobgether is seeking an experienced Python-based AI orchestration engineer to design, develop, and maintain AI agent orchestration services for voice and chat channels. You will build low-latency conversational workflows, integrate LangChain/LlamaIndex, and collaborate with SREs on OCI and Kubernetes deployments.

You will apply prompt engineering, secure REST APIs with mTLS, monitor latency and costs with Langfuse, and work with data scientists to improve model quality and safety.