On-Site GenAI Deployment Engineer for Enterprise Banks

Crayon Data; Riyadh; On-site; SAR 300,000 - 520,000; Full time

Job summary

Crayon Data, now Tangram.ai, seeks a Forward Deployed AI Engineer to deploy and operationalize enterprise GenAI platforms in secure, on-premise banking environments. You will collaborate with client IT, security, and infrastructure teams to deliver production-ready deployments.

The role emphasizes hands-on MLOps, OpenShift/Kubernetes, NVIDIA GPUs, and CI/CD pipelines in air-gapped settings, with a focus on reliable, scalable AI platform implementations.

Qualifications

• 4+ years of experience in Software Engineering, DevOps, Platform Engineering or a related field.
• 2+ years of hands-on experience in MLOps / LLMOps.
• Strong experience with Red Hat OpenShift and Kubernetes.
• Hands-on experience with NVIDIA GPUs and NVIDIA GPU Operator.
• Experience deploying LLMs, NVIDIA NIM, Triton or enterprise AI platforms.
• Strong understanding of containerization, Docker/OCI images and Kubernetes workloads.
• Experience with Helm, Kustomize, Kubernetes Operators and GitOps.
• Experience with ArgoCD, OpenShift Pipelines or similar CI/CD tools.
• Understanding of air-gapped / disconnected environments and offline software deployment.
• Good understanding of enterprise authentication and security frameworks such as Active Directory, LDAP, Kerberos and OAuth.
• Experience with secure secrets management using HashiCorp Vault, OpenShift Secrets or similar technologies.
• Strong troubleshooting, communication and client-facing skills.

Responsibilities

• Deploy and configure NVIDIA NIMs, LLMs, DataRobot, Graph Databases, and related AI platforms.
• Install and manage AI workloads on Red Hat OpenShift and Kubernetes environments.
• Package and deploy container images, dependencies, and LLM model weights in air-gapped environments.
• Configure and optimize NVIDIA GPU Operator, GPU time-slicing and MIG for AI workloads.
• Optimize LLM inference performance, including TTFT, throughput, latency and GPU utilization.
• Build and manage CI/CD and GitOps pipelines using tools such as ArgoCD and OpenShift Pipelines.
• Develop and maintain Helm charts, Kustomize manifests and Kubernetes configurations.
• Troubleshoot deployment, infrastructure, networking and performance issues in secure client environments.
• Work directly with client IT, Security and Infrastructure teams to resolve technical blockers and ensure successful deployments.

Skills

OpenShift

Kubernetes

LLMOps

MLOps

NVIDIA GPUs

NVIDIA GPU Operator

ArgoCD

GitOps

CI/CD

Docker

Triton

Security

Tools

ArgoCD

OpenShift Pipelines

Helm

Kustomize

Docker

Neo4j

ArangoDB

Triton Inference Server

DataRobot

NVIDIA NIM

GPU Operator

Job description

Crayon Data, now Tangram.ai, seeks a Forward Deployed AI Engineer to deploy and operationalize enterprise GenAI platforms in secure, on-premise banking environments. You will collaborate with client IT, security, and infrastructure teams to deliver production-ready deployments.

The role emphasizes hands-on MLOps, OpenShift/Kubernetes, NVIDIA GPUs, and CI/CD pipelines in air-gapped settings, with a focus on reliable, scalable AI platform implementations.