Principal AI Architect

GRP SCAN Group; City of Long Beach (NY); On-site; USD 147,900 - 254,798; Full time

Benefits offered by this job

Annual employee bonus program

Robust wellness program

Generous paid-time-off (PTO)

Excellent 401(k) Retirement Savings Plan with employer match

Tuition reimbursement

Job summary

GRP SCAN Group in Long Beach is seeking an AI & Cloud Architect to define and govern the architecture for AI and cloud solutions. The role focuses on creating scalable, secure cloud environments while leading architecture reviews aligned with compliance standards.

The ideal candidate will have deep expertise in the Azure ecosystem, strong communication skills, and a commitment to responsible AI design. A comprehensive benefits package includes a competitive salary range and various employee wellness programs.

Qualifications

• Proficiency in Azure AI Foundry, Azure AI Services, and Databricks.
• Familiarity with model registries and deployment frameworks.
• Commitment to secure and explainable AI design.

Responsibilities

• Define end-to-end reference architecture for AI systems.
• Build and maintain scalable cloud environments.
• Design pipelines for event-driven architectures using Azure services.

Skills

Deep expertise in the Azure ecosystem

Knowledge of LLM architectures

Strong understanding of network design

Proven ability to design scalable cloud architectures

Experience enabling RAG and multi-agent applications

Strong written and verbal communication skills

Job description

Job Overview

The AI & Cloud Architect defines and governs the architecture that powers SCAN’s AI and automation capabilities, from model hosting and vector databases to API orchestration and MCP servers. This role bridges infrastructure and innovation, ensuring that every AI and cloud solution is built on secure, performant, and reusable patterns.

Responsibilities

• Architectural Design & Strategy: Define the end‑to‑end reference architecture for AI and data/storage systems across Azure AI Foundry, Azure AI Services, Azure AI Search, Azure Databricks/Fabric, and Snowflake. Design integration blueprints for RAG workflows, data pipelines, agentic frameworks, and the enterprise GPT solution. Establish standards for model deployment, versioning, prompt management, and telemetry within Azure AI Foundry.
• Infrastructure & Platform Enablement: Build and maintain scalable cloud environments for model training, evaluation, and inference. Oversee vector database design (Azure AI Search or equivalent) and integration with Snowflake/Fabric data hubs. Implement high‑availability, cost‑optimized compute and storage strategies for AI workloads. Partner with IT Security to ensure alignment with HIPAA, Responsible AI, and internal compliance requirements.
• Orchestration & Automation Design: Design pipelines and event‑driven architectures using Azure Functions, Logic Apps, and API Management. Automate ingestion and evaluation processes for Document Intelligence, AI Search, and other Azure AI Services. Integrate monitoring, audit, and feedback loops to ensure operational transparency and continuous improvement.
• Governance & Collaboration: Lead architecture reviews and guide solution teams to adhere to Responsible AI and data‑management standards. Define metadata, lineage, and model registry conventions for consistent tracking and reuse. Collaborate with engineering, analytics, and business teams to align technical designs with strategic outcomes. Serve as a key contributor to the AI Architecture Review Board and cloud optimization initiatives.
• Innovation & Thought Leadership: Evaluate emerging Azure and open‑source technologies to extend SCAN’s AI capabilities (e.g., Foundry SDKs, agent frameworks, vector databases, knowledge graphs). Prototype new integration patterns for multi‑agent collaboration, knowledge management, and semantic data discovery. Coach engineers on architectural best practices and help shape the long‑term technical roadmap.

Qualifications

• Deep expertise in the Azure ecosystem, with proficiency in Azure AI Foundry, Azure AI Services, Azure AI Search, Azure ML, Databricks, and Fabric.
• Familiarity with model registries, MLOps, and deployment frameworks (CI/CD, containers, APIs).
• Proven ability to design scalable, secure, and modular cloud architectures for AI and data workloads.
• Strong understanding of network design, IAM, data governance, and enterprise integration patterns.
• Knowledge of LLM architectures, retrieval‑augmented generation, embedding pipelines, and evaluation frameworks.
• Experience enabling RAG and multi‑agent applications through Azure AI Foundry and related SDKs.
• Understanding of data modeling, knowledge graphs, and semantic search design; ability to define data contracts, metadata taxonomies, and lineage tracking for AI solutions.
• Commitment to secure, auditable, and explainable AI design; familiarity with healthcare data standards (HIPAA, CMS, PHI/PII protection) and SCAN’s Responsible AI framework.
• Adept at influencing cross‑functional stakeholders and translating architecture into actionable guidance; comfortable working in a fast‑evolving environment balancing experimentation with operational rigor.
• Strong written and verbal communication skills for technical and executive audiences.

Benefits

• Base Pay Range: $147,900 to $254,798 annually
• Annual employee bonus program
• Robust wellness program
• Generous paid‑time‑off (PTO)
• 11 paid holidays per year, 1 floating holiday, birthday off, and 2 volunteer days
• Excellent 401(k) Retirement Savings Plan with employer match
• Robust employee recognition program
• Tuition reimbursement

Equal Opportunity Employer

SCAN is proud to be an Equal Employment Opportunity and affirmative action workplace. Individuals seeking employment will receive consideration for employment without regard to race, color, national origin, religion, age, sex (including pregnancy, childbirth or related medical conditions), sexual orientation, gender identity or expression, marital status, disability, protected veteran status or any other status protected by law. A background check is required.

In compliance with 41 CFR 60‑1.35(c), the contractor will not discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Employees who have access to compensation information cannot disclose it to individuals who lack such access unless required by a formal complaint, investigation, or a legally consistent duty.