Get AI-powered advice on this job and more exclusive features.
This range is provided by Insight Global. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Base pay range
$77.47/hr - $84.51/hr
Location: Charlotte, NC (3 days a week onsite)
Pay Rate: 77.47/hr (mid-level), 84.51/hr (sr. level)
Job description
We’re scaling enterprise GenAI applications and need engineers who can operationalize, monitor, and improve LLM/RAG systems with strong guardrails and observability. You’ll work across annotation/fine‑tuning pipelines, evaluation with LLMs-as-Judges/SMLs, and orchestration with LangChain to keep models accurate, safe, and reliable in production.
What you’ll do
- Operationalize guardrails/observability for vendor-based LLM & RAG apps in production.
- Track quality and safety metrics (e.g., attribution/grounding, prompt-injection detection, tone, bias, PII).
- Build annotation + feedback loops; calibrate judge models via fine‑tuning/alignment.
- Orchestrate checks, prompt versioning, and scoring workflows with LangChain.
- Deploy and scale containerized AI services (OpenShift/Kubernetes) and create reliability dashboards (e.g., Grafana).
Must‑haves
- Data Science & AI Engineering background.
- Strong, practical LangChain experience.
- OpenAI API (chat completions, embeddings) expertise.
- Awareness of TensorRT and vLLM implementation.
- Advanced Python + data science libraries (NumPy, Pandas, scikit‑learn, PyTorch/TensorFlow).
- Proven guardrails & observability work on LLM/RAG apps.
- Experience with LLMs as Judges / SMLs for evaluation (attribution, adherence, bias, PII, etc.).
- OpenShift (or Kubernetes) for containerized AI workloads.
Seniority level
Associate
Employment type
Contract
Benefits
- Medical insurance
- Vision insurance
- 401(k)
Job function
Artificial Intelligence/ Machine Learning Engineer
Get notified about new Artificial Intelligence Engineer jobs in Charlotte Metro.