AI Engineer (RAG & On Prem LLMs) RAG, LLM, Python, PyTorch, LangChain, Neo4j, Docker, Kubernete[...]

DCG Poland; Warszawa; On-site; PLN 40,000 - 60,000; Full time

Job summary

DCG Poland is seeking an experienced Machine Learning Engineer in Warsaw to architect and implement advanced Retrieval Augmented Generation (RAG) pipelines for enterprise use. The role requires a strong understanding of working with generative models, vector databases, and robust deployment in on-prem environments.

Ideal candidates should have over 3 years of experience in ML/NLP, along with proficiency in Python and relevant AI frameworks. The role involves collaboration with DevOps teams and requires problem-solving skills to ensure high-performance AI applications.

.

Qualifications

• At least 3 years of professional experience in ML/NLP roles, including 2+ years with RAG systems.
• Experience deploying LLM-based solutions in on-prem or hybrid environments.
• Strong problem-solving and analytical skills.

Responsibilities

• Architect and implement end-to-end Retrieval Augmented Generation (RAG) pipelines.
• Design and integrate retrieval mechanisms with generative models.
• Monitor system performance and troubleshoot bottlenecks.

Skills

Machine Learning/Natural Language Processing

Python

vLLM

LiteLLM

Docker

Kubernetes

Neo4j

Performance optimization techniques

Education

Bachelor's, Master's, or Ph.D. in Computer Science, AI or related field

Job description

Job location: Warsaw

Responsibilities:

• Architect, implement, and optimize end-to-end Retrieval Augmented Generation (RAG) pipelines for enterprise use cases in on-premises environments
• Design and integrate retrieval mechanisms (e.g. vector databases such as Neo4j) with generative models (e.g. LLAMA 3.2, Mistral)
• Fine-tune and optimize retrieval and generation components to achieve high accuracy and low latency
• Implement and customize inference servers using vLLM and LiteLLM for efficient and scalable LLM serving
• Integrate open-source large language models with proprietary data sources and enterprise APIs
• Design GPU-optimized, scalable on-prem infrastructure for model training and inference, ensuring security and data governance compliance
• Collaborate with DevOps teams to containerize workflows using Docker and Kubernetes and automate MLOps pipelines
• Apply performance optimization techniques such as quantization, pruning, and dynamic batching
• Monitor system performance, troubleshoot bottlenecks, and ensure high availability
• Work closely with data engineers and business stakeholders to translate business requirements into technical AI solutions in telco environments

Requirements:

• At least 3 years of professional experience in ML/NLP roles, including 2+ years working with RAG systems
• Proven experience deploying and operating LLM‑based solutions in on‑prem or hybrid environments
• Hands‑on experience with vLLM, LiteLLM, and open‑source LLMs such as LLAMA 3.2, DeepSeek, or Mistral
• Strong Python skills and experience with frameworks such as PyTorch, Hugging Face Transformers, and LangChain
• Experience with vector databases (e.g. Neo4j)
• Familiarity with Linux‑based systems and Red Hat OpenShift
• Strong problem‑solving and analytical skills
• Ability to clearly communicate complex AI concepts to non‑technical stakeholders
• Bachelor's, Master's, or PhD degree in Computer Science, Artificial Intelligence, or a related field