AI Guardrails & AI/ML Engineer

Ethereum Technologies LLC; Charlotte (NC); On-site; USD 160,000 - 230,000; Full time

Job summary

Ethereum Technologies in Charlotte is seeking an AI Guardrails & AI/ML Engineer to design, build, and deploy scalable enterprise AI solutions, integrating OpenAI, Anthropic, and other frontier model providers across cloud and hybrid environments.

You will develop APIs, SDKs, guardrails, observability, and orchestration frameworks to support production workloads, optimize performance, latency, and cost, and collaborate with security, risk, and platform teams to establish governance and data

Qualifications

• Minimum 5+ years of hands-on experience with LLM-based applications and GenAI architecture.
• Extensive experience with prompt engineering for production-grade systems.
• Proven work with retrieval-augmented generation (RAG) and agentic workflows.
• Experience evaluating model performance, reliability, and governance in enterprise workloads.
• Strong background in scalable, cloud-native engineering practices.

Responsibilities

• Design, develop, and deploy enterprise AI solutions with direct model access to OpenAI, Anthropic, and other vendors.
• Build APIs, SDKs, guardrails, observability capabilities, and orchestration frameworks for production AI workloads.
• Collaborate with architecture, security, risk, and platform teams to establish standards for governance and data protection.
• Evaluate and integrate new model releases, optimize latency and cost, and drive technical innovation across the enterprise.

Skills

LLM-based applications

GenAI architecture

prompt engineering

retrieval-augmented generation

agentic workflow

model evaluation

cloud-native engineering

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Description

The AI Guardrails & AI/ML Engineer is responsible for designing, developing, and deploying scalable AI solutions within an enterprise environment. The AI Engineer will design, build, and operate enterprise-grade integrations with frontier AI model providers, including OpenAI, Anthropic, and other emerging foundation model vendors. This role is responsible for enabling secure, scalable, and compliant direct model access across cloud and hybrid environments, developing APIs, SDKs, guardrails, observability capabilities, and orchestration frameworks that support production AI workloads. The engineer will evaluate and integrate new model releases, optimize performance, latency, reliability, and cost, and partner with architecture, security, risk, and platform engineering teams to establish standards for model governance, data protection, and responsible AI.

Basic Qualifications

• Minimum 5+ years of experience of hands-on expertise in LLM-based applications, GenAI architecture, and modern cloud-native engineering practices, focusing on specific vendor direct consumption (i.e.OpenAI, Anthropic)
• Minimum 5+ years of experience in large language models (LLMs)
• Minimum 5+ years of experience in prompt engineering
• Minimum 5+ years of experience in retrieval-augmented generation (RAG)
• Minimum 5+ years of experience in agentic workflow
• Minimum 5+ years of experience in model evaluation
• Minimum 5+ years of experience in driving technical innovation and accelerating adoption of advanced AI capabilities across the enterprise

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.