Senior AI Backend Engineer: AIOps & LLM Orchestration

Programmers.io

Austin (TX)

On-site

USD 140,000 - 200,000

Full time

34 hours ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Programm ers.io is seeking a Senior AI / AIOps engineer in Austin to design and implement scalable Python backends that integrate GenAI and enterprise AI platforms. You will build APIs, orchestration flows, and secure services for mission-critical applications.

Ideal candidates have deep Python backend skills, hands-on API design, and experience with AI workflows, OAuth/JWT security, and MCP-style integrations.

Qualifications

  • Strong backend development experience with Python.
  • Experience with FastAPI or similar Python API frameworks.
  • Understanding of REST APIs, middleware, routing, and session management.
  • Experience integrating backend services with GenAI, LLMs, AI agents and orchestration.
  • Knowledge of AI chat workflows including prompt handling, context injection, conversation history, and response processing.
  • Experience with MCP servers/connectors and AI workflow integrations.
  • Ability to build MCP-style backend services for application-specific data and actions.
  • Understanding of OAuth, OIDC, JWT, authentication, authorization, and token management.
  • Experience with mTLS and encrypted credential handling.
  • Strong debugging and troubleshooting across API, auth, connectivity, deployment, and AI workflows.

Responsibilities

  • Design, develop, and maintain Python-based backend services and APIs.
  • Integrate enterprise applications with AI/LLM platforms and agentic workflows.
  • Develop and support AI chat and orchestration solutions.
  • Build and maintain MCP-based integrations and backend connectors.
  • Collaborate with platform, security, architecture, UI, and application teams.
  • Troubleshoot and resolve application, API, authentication, and AI platform issues.
  • Follow engineering best practices for code quality, security, and maintainability.

Skills

Python
FastAPI
REST APIs
GenAI / LLMs
AI agents / orchestration
MCP servers / connectors
OAuth / OIDC / JWT
mTLS / secure credentials
API troubleshooting
Software architecture / modular design
Git / version control

Tools

Git

Job description

Programm ers.io is seeking a Senior AI / AIOps engineer in Austin to design and implement scalable Python backends that integrate GenAI and enterprise AI platforms. You will build APIs, orchestration flows, and secure services for mission-critical applications.

Ideal candidates have deep Python backend skills, hands-on API design, and experience with AI workflows, OAuth/JWT security, and MCP-style integrations.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI / AIOps engineer with Python
Senior AI / AIOps engineer with Python

Programmers.io • Austin (TX)

On-site
USD 140,000 - 200,000
Principal AI Systems Engineer (LLM Backend Architect)
Principal AI Systems Engineer (LLM Backend Architect)

Salesforce • San Francisco (CA)

On-site
USD 180,000 - 240,000
Paid Time Off
Medical Insurance
Dental Insurance
+7
Sr. AI Developer
Sr. AI Developer

SysTechCorp Inc • Moline (IL)

On-site
USD 100,000 - 130,000
Senior AI Architect: Python, LLMs & Microservices
Senior AI Architect: Python, LLMs & Microservices

InfoVision Inc. • Dallas (TX)

On-site
USD 140,000 - 190,000
Senior AI/ML Backend Engineer — LLM Agents & Cloud APIs
Senior AI/ML Backend Engineer — LLM Agents & Cloud APIs

Zohorecruit • San Francisco (CA)

On-site
USD 140,000 - 190,000
Senior AI Engineer: LLM & Generative AI Backend
Senior AI Engineer: LLM & Generative AI Backend

TechWize • New York (NY), Northern (KY)

Hybrid
USD 180,000 - 230,000
Senior AI Backend Architect – Python & APIs
Senior AI Backend Architect – Python & APIs

Jobgether SRL • United States

Remote
USD 21,000 - 37,000
Senior Backend Engineer - AI/LLM & Microservices
Senior Backend Engineer - AI/LLM & Microservices

Coinbase, Inc. • New York (NY)

On-site
USD 150,000 - 210,000
Medical Insurance
Dental Insurance
Vision Insurance
+3
AI Architect
AI Architect

Synchro • United States

On-site
USD 120,000 - 160,000
Senior AI Engineer: Multi-Agent LLM Orchestrator (Onsite)
Senior AI Engineer: Multi-Agent LLM Orchestrator (Onsite)

Visa Technology and Operations LLC • Austin (TX)

On-site
USD 111,000 - 172,000
Medical
Dental
Vision
+5