Generative AI Architect

Arka Innovate; New York (NY); On-site; USD 150,000 - 180,000; Full time

Job summary

A leading AI technology firm in New York is seeking a Generative AI Architect to design and implement cutting-edge AI solutions. The ideal candidate will have over 8 years of experience in software engineering and a strong background in Generative AI. Responsibilities include developing scalable AI architectures and mentoring engineering teams. This role is an excellent opportunity for someone passionate about AI and technology innovation in a dynamic environment.

Qualifications

• 8+ years of experience in software engineering, machine learning, or AI development.
• 2+ years of hands-on experience in Generative AI.
• Experience building RAG-based applications in production environments.

Responsibilities

• Design and implement end-to-end Generative AI architectures.
• Partner with stakeholders to identify high-value AI opportunities.
• Provide technical leadership and mentorship to engineering teams.

Skills

Software engineering

Generative AI

Machine learning

Cloud platforms

Tools

OpenAI

LangChain

Pinecone

Azure OpenAI

Google Vertex AI

Job description

ARKA INNOVATE is hiring on behalf of our client for aGenerative AI Architect.

Role:

Our Client - the world’s first AI-powered tech services company. Our Client has reimagined tech services from the ground up with AI by offering AI-vetted and matched talent, AI-accelerated development, and access to AI transformation experts who have built many of the most iconic Silicon Valley companies.

Arka Innovate is seeking aGenerative AI Architectwho brings a strong combination ofdeep technical expertise and strategic thinking. This individual will lead thedesign, development, and deployment of Generative AI solutionsthat address complex business problems.

Responsibilities

• Design and implementend-to-end Generative AI architecturesleveragingLLMs, Retrieval-Augmented Generation (RAG), vector databases, and agent-based workflows.
• Partner withproduct, engineering, and business stakeholdersto identify high-value AI opportunities and translate them into scalable solutions.
• Developprototypes and production-grade GenAI applicationsacross modalities such astext, code, speech, and vision.
• Establishbest practices for model governance, reliability, performance monitoring, and cost optimizationin deployed AI systems.
• Evaluate and integrateemerging AI models, frameworks, and toolsto continuously improve platform capabilities.
• Providetechnical leadership and mentorshipto engineering teams in areas such asprompt engineering, GenAI architecture, and responsible AI practices.

Qualifications & Requirements

• 8+ yearsof experience insoftware engineering, machine learning, or AI development.
• 2+ years of hands-on experience in Generative AI, working with platforms such asOpenAI, Anthropic, Azure OpenAI, or Google Vertex AI.
• Experience buildingRAG-based applications and LLM-powered systemsin production environments.
• Strong experience withLangChain, LlamaIndex, or similar GenAI orchestration frameworks.
• Hands-on experience withvector databasessuch asPinecone, Weaviate, Chroma, or similar technologies.
• Experience designingagent-based architectures, orchestration workflows, and fine-tuning pipelines.
• Strong background incloud platforms (AWS, Azure, or GCP)and modern AI development tools.

At Arka Innovate, we are proud to be anEqual Opportunity Employer. We are committed to creating an inclusive environment for all employees and do not discriminate on the basis of race, color, religion, gender, sexual orientation, national origin, age, disability, veteran status, or any other legally protected status.