AI Guardrails & AI/ML Engineer

Cloud Analytics Technologies, LLC; Charlotte (NC); On-site; USD 180,000 - 240,000; Full time

Job summary

Cloud Analytics Technologies, LLC seeks an AI Guardrails & AI/ML Engineer to design, deploy, and operate scalable AI solutions for enterprise use. You will build direct model access across cloud and hybrid environments with provider integrations, APIs, guardrails, and observability for production workloads.

You will evaluate model releases, optimize performance, latency, reliability, and cost while partnering with security and platform teams to uphold governance and responsible AI standards.

Qualifications

• 5+ years building LLM-based applications and GenAI architectures.
• 5+ years working with large language models and prompt engineering.
• Experience with retrieval-augmented generation and model evaluation.
• Proven ability to deploy secure, scalable AI solutions in cloud environments.
• Familiarity with governance, data protection, and responsible AI practices.

Responsibilities

• Design, develop, and deploy enterprise-grade AI solutions across cloud and hybrid environments.
• Build and operate integrations with OpenAI, Anthropic, and other foundation-model providers.
• Develop APIs, SDKs, guardrails, and observability for production AI workloads.
• Evaluate new model releases and optimize performance, latency, and cost.

Skills

LLM architecture

GenAI

Prompt engineering

RAG

Cloud-native

Model governance

Observability

OpenAI Anthropic

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Description:
The AI Guardrails & AI/ML Engineer is responsible for designing, developing, and deploying scalable AI solutions within an enterprise environment. The AI Engineer will design, build, and operate enterprise-grade integrations with frontier AI model providers, including OpenAI, Anthropic, and other emerging foundation model vendors. This role is responsible for enabling secure, scalable, and compliant direct model access across cloud and hybrid environments, developing APIs, SDKs, guardrails, observability capabilities, and orchestration frameworks that support production AI workloads. The engineer will evaluate and integrate new model releases, optimize performance, latency, reliability, and cost, and partner with architecture, security, risk, and platform engineering teams to establish standards for model governance, data protection, and responsible AI.

Basic Qualifications:

• Minimum 5+ years of experience of hands-on expertise in LLM-based applications, GenAI architecture, and modern cloud-native engineering practices, focusing on specific vendor direct consumption (i.e.OpenAI, Anthropic)
• Minimum 5+ years of experience in large language models (LLMs)
• Minimum 5+ years of experience in prompt engineering
• Minimum 5+ years of experience in retrieval-augmented generation (RAG)
• Minimum 5+ years of experience in agentic workflow
• Minimum 5+ years of experience in model evaluation
• Minimum 5+ years of experience in driving technical innovation and accelerating adoption of advanced AI capabilities across the enterprise

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Some of our Business Ventures - Knowledge Analytics

Do restrictive necessities, your capability for advanced analytics or your business model need custom-made applications and infrastructure configurations? opt for our hosted managed services to urge comprehensive analytics solutions supported industry-leading Cloud Analytics Technologies, LLC code - delivered by the Cloud Analytics Technologies, LLC consultants UN agency understand these solutions best. Through a mix of with-it technology and dedicated service and support, Cloud Analytics Technologies, LLC hosted managed services will facilitate you: