Data Developer: AI & RAG Pipeline Architect

DRW Holdings, LLC.; Montreal (administrative region); On-site; CAD 75,000 - 95,000; Full time

Job summary

A leading trading firm in Montreal seeks a Data Developer to design and implement data pipelines for RAG systems. Ideal candidates will have 2-5 years of experience in building data systems, strong Python skills, and familiarity with RAG architectures. Responsibilities include optimizing data processing workflows and collaborating with ML engineers. This role offers the opportunity to work in a dynamic environment leveraging cutting-edge technology and techniques in data engineering and AI.

Qualifications

• 2-5 years building data systems and pipelines in production environments.
• Experience with RAG architectures and vector databases.
• Understanding of LLM inference optimization techniques.

Responsibilities

• Design and build data pipelines for RAG systems.
• Build ingestion pipelines for structured and unstructured data.
• Collaborate with ML engineers for data formats optimization.

Skills

RAG architectures

Data pipeline construction

Python proficiency

Distributed data processing

Embedding models

Education

Bachelor's or Master's degree in Computer Science, Data Engineering, or related field

Tools

Apache Spark

Docker

Airflow

Job description

A leading trading firm in Montreal seeks a Data Developer to design and implement data pipelines for RAG systems. Ideal candidates will have 2-5 years of experience in building data systems, strong Python skills, and familiarity with RAG architectures. Responsibilities include optimizing data processing workflows and collaborating with ML engineers. This role offers the opportunity to work in a dynamic environment leveraging cutting-edge technology and techniques in data engineering and AI.