Senior AI Guardrails & LLM Engineer

Ethereum Technologies; Charlotte (NC); On-site; USD 160,000 - 230,000; Full time

Job summary

Ethereum Technologies in Charlotte is seeking an AI Guardrails & AI/ML Engineer to design, build, and deploy scalable enterprise AI solutions, integrating OpenAI, Anthropic, and other frontier model providers across cloud and hybrid environments.

You will develop APIs, SDKs, guardrails, observability, and orchestration frameworks to support production workloads, optimize performance, latency, and cost, and collaborate with security, risk, and platform teams to establish governance and data

Qualifications

• Minimum 5+ years of hands-on experience with LLM-based applications and GenAI architecture.
• Extensive experience with prompt engineering for production-grade systems.
• Proven work with retrieval-augmented generation (RAG) and agentic workflows.
• Experience evaluating model performance, reliability, and governance in enterprise workloads.
• Strong background in scalable, cloud-native engineering practices.

Responsibilities

• Design, develop, and deploy enterprise AI solutions with direct model access to OpenAI, Anthropic, and other vendors.
• Build APIs, SDKs, guardrails, observability capabilities, and orchestration frameworks for production AI workloads.
• Collaborate with architecture, security, risk, and platform teams to establish standards for governance and data protection.
• Evaluate and integrate new model releases, optimize latency and cost, and drive technical innovation across the enterprise.

Skills

LLM-based applications

GenAI architecture

prompt engineering

retrieval-augmented generation

agentic workflow

model evaluation

cloud-native engineering

Job description

Ethereum Technologies in Charlotte is seeking an AI Guardrails & AI/ML Engineer to design, build, and deploy scalable enterprise AI solutions, integrating OpenAI, Anthropic, and other frontier model providers across cloud and hybrid environments.

You will develop APIs, SDKs, guardrails, observability, and orchestration frameworks to support production workloads, optimize performance, latency, and cost, and collaborate with security, risk, and platform teams to establish governance and data