We are seeking an experienced Generative AI (GenAI) Architect to lead the design, architecture, and end-to-end delivery of enterprise-grade AI solutions. In this strategic role, you will partner closely with business stakeholders, data scientists, and engineering teams to translate high-impact business use cases into scalable, secure, and production-ready systems. You will define technical blueprints for LLM-based applications, Retrieval-Augmented Generation (RAG) pipelines, and autonomous agentic workflows across modern cloud platforms.
Key Responsibilities
- Solution Architecture: Design end-to-end architecture for enterprise GenAI applications, including foundation model selection, fine-tuning strategies, prompt engineering frameworks, and multi-agent orchestration.
- RAG & Data Pipelines: Architect high-performance RAG systems, encompassing document chunking, embedding models, vector databases, hybrid search, and semantic retrieval optimization.
- Agentic Workflows: Lead the design and implementation of complex, multi-step agentic workflows with tool use, memory management, and human-in-the-loop controls.
- Cloud & MLOps Integration: Build scalable, resilient, and cost-optimized AI infrastructure on major cloud platforms (AWS, Azure, or GCP), establishing LLMOps best practices for CI/CD, model versioning, and observability.
- Governance, Security & Compliance: Implement robust enterprise guardrails to ensure data privacy, security, hallucination mitigation, responsible AI compliance, and adherence to regulatory standards.
- Cross-Functional Leadership: Collaborate directly with product owners, business executives, and software engineering teams to evaluate use case feasibility, establish technical roadmaps, and mentor engineers through production deployment.
Required Qualifications
- Experience: 10+ years of overall experience in software engineering, data architecture, or AI/ML engineering, with at least 2–3+ years focused on deploying production LLM and Generative AI systems.
- GenAI Stack Expertise: Deep hands-on experience with LLM orchestration frameworks (e.g., LangChain, LlamaIndex, LangGraph, Semantic Kernel) and vector databases (e.g., Pinecone, Weaviate, Milvus, pgvector).
- Cloud Proficiency: Strong architectural background in at least one major cloud ecosystem and its native AI services (e.g., AWS Bedrock/SageMaker, Azure OpenAI/AI Studio, or GCP Vertex AI).
- Programming & APIs: Proficiency in Python and modern microservices architecture, REST/gRPC APIs, containerization (Docker, Kubernetes), and distributed systems.
- Production Readiness: Proven track record of moving AI prototypes into secure, low-latency, high-availability enterprise production environments, including implementing evaluation frameworks (e.g., RAGAS, TruLens) and monitoring tools.
- Communication: Exceptional stakeholder management skills with the ability to communicate complex architectural trade-offs to both technical teams and C-level executives.
Preferred Qualifications
- Experience in regulated industries (e.g., Financial Services, Healthcare, Insurance, or Life Sciences) common to the NY/NJ market.
- Familiarity with model fine-tuning techniques (LoRA, QLoRA, RLHF) and open-source model hosting (e.g., vLLM, Hugging Face TGI).
- Master’s degree or Ph.D. in Computer Science, Artificial Intelligence, Data Science, or a related quantitative field.