Senior LLM Architect for On-Prem Enterprise AI

Oredata-Yaz; Fatih; On-site; TRY 550,000 - 900,000; Full time

Benefits offered by this job

Private Health Insurance

Birthday Leave Policy

Job summary

OREDATA YAZILIM A.Ş. seeks a senior Data Scientist (LLM) to design, deploy and optimize enterprise LLM/RAG solutions. You will lead architecture for on-premise AI platforms and collaborate across engineering, data, and product teams to deliver production-ready AI systems.

You will work on hands-on model selection, deployment, and governance, ensuring performance, security, and cost efficiency while advancing agentic AI capabilities and semantic routing across complex workflows.

Qualifications

• Minimum 7 years of professional experience in AI/ML, data science, software engineering, or related roles.
• Hands-on experience with Large Language Models (LLMs) and Generative AI solutions in production.
• Proven experience deploying, serving, or optimizing LLMs in on-premise/private cloud environments.
• Experience designing and scaling AI systems for high-traffic, low-latency environments.
• Understanding GPU-based LLM inference and memory/latency considerations.

Responsibilities

• Design, develop, test, and productionize LLM-based and Retrieval-Augmented Generation (RAG) solutions.
• Take an active hands-on role in building internal chatbot, conversational AI, and agentic AI products.
• Own the technical architecture for enterprise LLM solutions including model selection, deployment, and monitoring.
• Deploy and optimize open-weight and commercial LLMs with a focus on on-premise infrastructure.
• Collaborate with multiple teams to translate business requirements into scalable AI solutions.

Skills

LLMs

Generative AI

GPU inference

Python

Kubernetes

OpenShift

RAG

Model routing

Tool calling

AI FinOps

Tools

Kubernetes

OpenShift

Hugging Face

NVIDIA Triton

Red Hat OpenShift AI

Job description

OREDATA YAZILIM A.Ş. seeks a senior Data Scientist (LLM) to design, deploy and optimize enterprise LLM/RAG solutions. You will lead architecture for on-premise AI platforms and collaborate across engineering, data, and product teams to deliver production-ready AI systems.

You will work on hands-on model selection, deployment, and governance, ensuring performance, security, and cost efficiency while advancing agentic AI capabilities and semantic routing across complex workflows.