AI Gateway Architect: Secure Integrations & Observability

Strive Solutions; Chicago (IL); On-site; USD 120,000 - 180,000; Full time

Job summary

Strive Solutions in the United States is seeking a hands-on architect to lead the end-to-end design, development, deployment, and operational support of AI Gateway solutions for enterprise AI and LLM services.

You will architect secure integrations with multiple AI model providers, implement governance and observability, and drive reliability, performance, and cost efficiency in production environments. This role demands strong operational mindset and hands-on troubleshooting capability.

Qualifications

• Proven experience designing gateway architectures for AI/LLM systems.
• Experience securely integrating external model APIs/providers.
• Hands-on governance and observability in production environments.
• Strong reliability engineering, performance tuning, and cost optimization skills.
• Operational mindset with robust troubleshooting and support abilities.

Responsibilities

• Architect and deliver secure integrations with multiple AI model providers.
• Implement AI governance, including policy controls and safeguards.
• Build and maintain observability for AI services (monitoring, logging, tracing).
• Optimize gateway reliability and performance under production workloads.
• Reduce and manage cost through routing, usage controls, and performance tuning.
• Provide operational support to ensure stable, secure service delivery.

Skills

Gateway/AI LLM architecture

Secure API integrations

Governance and observability

Reliability engineering

Troubleshooting & support

Job description

Strive Solutions in the United States is seeking a hands-on architect to lead the end-to-end design, development, deployment, and operational support of AI Gateway solutions for enterprise AI and LLM services.

You will architect secure integrations with multiple AI model providers, implement governance and observability, and drive reliability, performance, and cost efficiency in production environments. This role demands strong operational mindset and hands-on troubleshooting capability.