GenAI Engineer - On-Prem AI & Enterprise Integrations

SoftServe; As Sudiyah; On-site; OMR 14,000 - 26,000; Full time

Job summary

SoftServe is seeking an AI Engineer to design and deliver GenAI solutions on the on-premise Arthur platform. You will build production-ready AI applications and integrate enterprise data with leading LLM providers, including Anthropic, OpenAI and Google.

You will design robust workflows, implement guardrails, and collaborate with architects, platform engineers and business SMEs to ensure scalable, secure and observable solutions across the enterprise.

Qualifications

• Proficient Python and general software engineering skills.
• Hands-on GenAI/LLM development in production/enterprise.
• Experience with RAG, embeddings, vector search.
• Familiar with agentic AI, tool calls and MCP.
• Knowledge of multiple LLM providers (Anthropic, OpenAI, Google).
• Strong API and enterprise integration capabilities.
• Understanding of LLM evaluation, guardrails, observability and AI security.
• Experience with Docker/Kubernetes in on‑premise environments.
• Excellent problem‑solving, communication and stakeholder engagement skills.
• Model-agnostic engineering mindset across LLMs.

Responsibilities

• Design, develop and productionise GenAI/LLM applications and use cases.
• Build RAG, agentic AI and tool-enabled workflows using enterprise data and systems.
• Integrate AI solutions with APIs, databases, applications and external LLM providers.
• Develop effective prompt and context engineering approaches, including structured outputs and guardrails.
• Implement testing, LLM evaluation, monitoring and observability to ensure solution quality and reliability.
• Apply appropriate security, data privacy and Responsible AI controls.
• Collaborate with architects, platform engineers, business SMEs and other delivery teams.
• Contribute reusable components, integration patterns and engineering best practices.

Skills

Python

GenAI/LLM development

API integration

Problem solving

Communication

Stakeholder engagement

LLM evaluation and guardrails

Security awareness

Model-agnostic engineering mindset

Tools

Docker

Kubernetes

Job description

SoftServe is seeking an AI Engineer to design and deliver GenAI solutions on the on-premise Arthur platform. You will build production-ready AI applications and integrate enterprise data with leading LLM providers, including Anthropic, OpenAI and Google.

You will design robust workflows, implement guardrails, and collaborate with architects, platform engineers and business SMEs to ensure scalable, secure and observable solutions across the enterprise.