Generative AI Engineer: RAG, LangChain & Safety

Ethereum Technologies; Columbus (OH); On-site; USD 120,000 - 180,000; Full time

Job summary

Ethereum Technologies is seeking a software engineer specializing in AI/ML to build scalable, secure AI solutions in a business-focused role in Columbus, OH. You will design prompts, guardrails, and evaluation frameworks while integrating multiple LLM providers and tools.

You will collaborate with product, data science, cloud, and security teams to deliver robust AI copilots, agents, and multi-modal experiences. 5+ years preferred; healthcare/finance exposure is a plus.

Qualifications

• Strong Python for app development, API integration, and AI workflows.
• Experience building REST APIs, microservices, and backend services.
• Solid software engineering practices: version control, automated testing, and CI/CD.
• Hands-on with LLM providers such as Azure OpenAI, OpenAI, Claude, Gemini.
• Experience implementing chat apps, AI copilots, agents, function calling, tool integration.
• Experience building RAG solutions with LangChain, LangGraph, LlamaIndex, Semantic Kernel.

Responsibilities

• Design prompts, instructions, templates, and evaluation-driven improvements.
• Implement AI guardrails, privacy practices, responsible AI workflows, and human-in-the-loop reviews.
• Establish evaluation frameworks to measure accuracy, latency, cost, and user satisfaction.
• Monitor production systems and optimize performance.
• Translate complex AI concepts into business-focused solutions.
• Collaborate with product managers, data scientists, cloud engineers, security, and stakeholders.

Skills

Python

REST APIs

Git & CI/CD

LLM platforms

Multi-modal AI

Prompt design

Tools

Azure OpenAI

OpenAI

Anthropic Claude

Google Gemini

LangChain

LlamaIndex

Semantic Kernel

Job description

Ethereum Technologies is seeking a software engineer specializing in AI/ML to build scalable, secure AI solutions in a business-focused role in Columbus, OH. You will design prompts, guardrails, and evaluation frameworks while integrating multiple LLM providers and tools.

You will collaborate with product, data science, cloud, and security teams to deliver robust AI copilots, agents, and multi-modal experiences. 5+ years preferred; healthcare/finance exposure is a plus.