AI Architect

Solutionit Gmbh; San Jose (CA); Hybrid; USD 279,000 - 391,000; Full time

Job summary

Solution IT Inc. is seeking an AI Architect for a 6-month hybrid position in San Jose, CA. The role focuses on designing and implementing multi-agent orchestration, MCP-based data/tool connections, and scalable AI platform development.

You will write production-grade code and mentor engineers while standardizing architectural patterns across the organization. Strong communication is essential for collaborating with stakeholders.

Qualifications

• 10+ years of software architecture experience, with at least 3+ years building production-grade LLM apps.
• Deep knowledge of multi-agent frameworks (LangGraph, AutoGen, CrewAI) and prompt engineering.
• Experience with MCP or similar context-sharing and tool-calling protocols.
• Proficiency in Python, TypeScript, or Go, plus cloud native technologies (AWS/GCP/Azure), Kubernetes, Docker and AI SDKs.
• Excellent verbal and written communication; ability to lead technical discussions and RFCs.

Responsibilities

• Design and implement multi-agent orchestration frameworks with autonomous negotiation, task delegation, and secure inter-agent communication.
• Architect MCP servers/clients to connect LLMs to data sources and tools.
• Drive AI platform architecture for high throughput, low latency, developer workflows for training, testing, and deploying models.
• Write production-ready code, prototypes, and establish engineering best practices for AI application development.
• Provide technical leadership and communicate complex concepts across teams.

Skills

Software architecture

LLM apps

Multi-agent frameworks

Protocols & APIs

Tech stack: Python/TS/Go

Communication skills

Job description

Solution IT Inc. is looking forAI Architect forone of its clients in San Jose, CA

Job Title: AI Architect

Responsibilities:

• Agent-to-Agent Architecture: Design and implement multi-agent orchestration frameworks, focusing on autonomous negotiation, task delegation, state management, and secure inter-agent communication.
• MCP Integration: Architect and build scalable Model Context Protocol (MCP) servers and clients to securely connect LLMs to data sources, development tools, and enterprise environments.
• AI Platform Development: Drive the architectural vision for our internal AI development platform, ensuring high throughput, low latency, and seamless developer workflows for training, testing, and deploying models.
• Hands-on Engineering: Write high-quality, production-ready code, build prototypes, and establish engineering best practices for AI application development.
• Technical Leadership & Communication: Standardize architectural patterns across the organization. Mentor junior engineers and explain complex technical concepts to non-technical stakeholders clearly and effectively.

Required skills:

• Experience: 10+ years of software architecture experience, with at least 3+ years of dedicated, hands-on experience building and deploying production-grade LLM applications and AI systems.
• AI & Agentic Expertise: Deep understanding of multi-agent frameworks (e.g., LangGraph, AutoGen, CrewAI), prompt engineering, RAG pipelines, and vector databases.
• Protocol & API Mastery: Proven experience with Model Context Protocol (MCP) or designing similar context-sharing and tool-calling protocols for GenAI.
• Technical Stack: Proficiency in Python, TypeScript, or Go, along with cloud native technologies (AWS/GCP/Azure, Kubernetes, Docker) and modern AI SDKs.
• Communication: Outstanding verbal and written communication skills, with a proven ability to lead technical discussions and author comprehensive architecture RFCs.

Work Site: San Jose, CA (Hybrid 3 days in office)

Duration: 6 Months

Expected Start Date: 2 Weeks

Number of Positions: 01

Thanks

Recruiting Team

SOLUTION IT INC

Work: 781-503-1700 / Extn 139 / 155

URL: http://solutionit.com/