AI Gateway Engineer

Strive Solutions; Chicago (IL); Presencial; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

Strive Solutions in the United States is seeking a hands-on architect to lead the end-to-end design, development, deployment, and operational support of AI Gateway solutions for enterprise AI and LLM services.

You will architect secure integrations with multiple AI model providers, implement governance and observability, and drive reliability, performance, and cost efficiency in production environments. This role demands strong operational mindset and hands-on troubleshooting capability.

Formación

• Proven experience designing gateway architectures for AI/LLM systems.
• Experience securely integrating external model APIs/providers.
• Hands-on governance and observability in production environments.
• Strong reliability engineering, performance tuning, and cost optimization skills.
• Operational mindset with robust troubleshooting and support abilities.

Responsabilidades

• Architect and deliver secure integrations with multiple AI model providers.
• Implement AI governance, including policy controls and safeguards.
• Build and maintain observability for AI services (monitoring, logging, tracing).
• Optimize gateway reliability and performance under production workloads.
• Reduce and manage cost through routing, usage controls, and performance tuning.
• Provide operational support to ensure stable, secure service delivery.

Conocimientos

Gateway/AI LLM architecture

Secure API integrations

Governance and observability

Reliability engineering

Troubleshooting & support

Descripción del empleo

Role Summary

Lead the end-to-end design, development, deployment, and operational support of AI Gateway solutions for enterprise AI and LLM services.

Role Summary

Lead the end-to-end design, development, deployment, and operational support of AI Gateway solutions for enterprise AI and LLM services.

Key Responsibilities

• Architect and deliver secure integrations with multiple AI model providers.
• Implement AI governance, including policy controls and compliance-oriented safeguards.
• Build and maintain observability for AI services (monitoring, logging, and tracing).
• Optimize gateway reliability and performance under production workloads.
• Reduce and manage cost through efficient routing, usage controls, and performance tuning.
• Provide operational support to ensure stable, secure service delivery.

Required Qualifications

• Strong experience with gateway/service architecture for AI/LLM systems.
• Expertise integrating with external model APIs/providers securely.
• Proven ability to implement governance and observability in production environments.
• Skilled in reliability engineering, performance optimization, and cost efficiency.
• Operational mindset with strong troubleshooting and support capabilities.