Lead AI/ML Architect for Enterprise LLM/RAG Solutions

Ethereum Technologies; City of Albany (NY); On-site; USD 83,000 - 107,000; Full time

Job summary

Ethereum Technologies seeks an AI/ML Architect to design and deploy AI capabilities at enterprise scale. The role focuses on architecting AI solutions, building LLM workflows, and ensuring governance, security, and reliability across Finance and data platforms.

You will collaborate with data engineering, security, and Responsible AI teams to deliver trusted AI products and maintain high-quality, scalable systems.

Qualifications

• Bachelor's degree or equivalent experience in a technical field.
• Significant experience in software engineering, machine learning, or AI engineering.
• Hands-on experience building and deploying generative AI and LLM-based applications in production.
• Experience with prompt engineering, RAG architectures, AI agents, model evaluation, and governance.
• Strong understanding of cloud-native architectures, APIs, data platforms, and scalable software systems.
• Knowledge of responsible AI, security, privacy, and compliance practices.
• Proven ability to work effectively with technical and business stakeholders.

Responsibilities

• Design AI solution architectures aligned with business objectives and governance.
• Build and deploy LLM workflows, prompts, chains, and agent-based solutions.
• Develop grounding approaches, tool calls, guardrails, and fallback mechanisms.
• Collaborate with Data Engineering to access trusted data sources.
• Establish evaluation frameworks, datasets, scoring rubrics, and benchmarks.
• Monitor output quality, latency, cost, and hallucination risk.
• Perform failure-mode analysis and drive continuous improvements.
• Document AI behavior, controls, and monitoring requirements.
• Support production readiness with observability and drift detection.

Job description

Ethereum Technologies seeks an AI/ML Architect to design and deploy AI capabilities at enterprise scale. The role focuses on architecting AI solutions, building LLM workflows, and ensuring governance, security, and reliability across Finance and data platforms.

You will collaborate with data engineering, security, and Responsible AI teams to deliver trusted AI products and maintain high-quality, scalable systems.