Databricks LLMOps Advisor

Desjardins Group; Lévis; Hybrid; CAD 80,000 - 120,000; Full time

Job summary

A financial services organization based in Lévis, Canada, is seeking a Databricks LLMOps Advisor. This role focuses on designing and maintaining LLMOps pipelines for language models in a cloud environment. Ideal candidates will have a Bachelor's degree in a related field, a minimum of four years of experience in machine learning, and proficiency with Databricks and Azure. The position offers flexible vacation and a competitive salary.

Benefits

Competitive salary and annual bonus

4 weeks of flexible vacation

Defined benefit pension plan

Group insurance including telemedicine

Reimbursement of health and wellness expenses

Qualifications

• A minimum of four years of relevant experience in machine learning is required.
• Azure Databricks certification or equivalent experience is preferred.

Responsibilities

• Design, develop and maintain LLMOps pipelines for language models.
• Integrate models into Databricks while ensuring compliance with security standards.
• Automate processes for fine-tuning and monitoring LLMs.

Skills

Intermediate or advanced experience with cloud computing environments (Azure)

Intermediate or advanced experience with AI/LLM frameworks (Hugging Face, LangChain, OpenAI API)

Intermediate or advanced experience with MLOps/LLMOps tools (MLflow, Azure Machine Learning, CI/CD)

Intermediate or advanced experience in programming languages: PySpark, Python, Java or C#

Intermediate or advanced experience with Databricks (Delta Lake, MLflow, Feature Store)

Knowledge of French

Education

Bachelor's degree in computer science, software engineering, AI or related field

Job description

The Cybersecurity Monitoring Ecosystem Department is currently looking for a Databricks LLMOps Advisor to join its team dedicated to the industrialization and governance of language models (LLM) in a modern cloud environment. You’ll work in an environment where secure, compliant and high-performing AI solutions are critical to supporting our organization’s strategic activities. You’ll help set up and maintain MLOps/LLMOps pipelines using Databricks technologies and best practices to ensure models are robust, traceable and scalable. More specifically, you will be required to:

• Design, develop and maintain LLMOps pipelines to roll out, monitor and update language models.
• Integrate models into Databricks environments while ensuring they comply with security and governance standards.
• Automate processes for fine-tuning, evaluating and monitoring LLMs (quality, bias and drift).
• Develop scripts and workflows to manage training data and prompts in the data lake.
• Implement versioning, traceability and compliance mechanisms for models and their artifacts.
• Work with data engineering and cybersecurity teams to ensure our AI solutions are resilient and protect confidential information.

What we offer

• Competitive salary and annual bonus
• 4 weeks of flexible vacation starting in the first year
• Defined benefit pension plan that provides predictable, stable income throughout retirement
• Group insurance including telemedicine
• Reimbursement of health and wellness expenses and telework equipment

* Benefits apply based on eligibility criteria.

#LI-Hybrid

What you bring to the table

• Bachelor's degree in computer science, software engineering, AI or related field
• A minimum of four years of relevant experience in machine learning
• Please note that other combinations of qualifications and relevant experience may be considered
• Intermediate or advanced experience with rolling out AI models in cloud computing environments (Azure)
• Intermediate or advanced experience with AI/LLM frameworks (Hugging Face, LangChain, OpenAI API)
• Intermediate or advanced experience with MLOps/LLMOps tools (MLflow, Azure Machine Learning, CI/CD)
• Intermediate or advanced experience in one or more of the following languages: PySpark, Python, Java or C#
• Intermediate or advanced experience with Databricks (Delta Lake, MLflow, Feature Store).
• Azure Databricks certification or demonstrated equivalent
• Knowledge of French is required

Action oriented, Business insight, Complexity, Customer Focus, Differences, Nimble learning

Trade Union (If applicable)

At Desjardins, we believe in equity, diversity and inclusion. We're committed to welcoming, respecting and valuing people for who they are as individuals, learning from their differences, embracing their uniqueness, and providing a positive workplace for all. At Desjardins, we have zero tolerance for discrimination of any kind. We believe our teams should reflect the diversity of the members, clients and communities we serve.

If there's something we can do to help make the recruitment process or the job you're applying for more accessible, let us know. We can provide accommodations at any stage in the recruitment process. Just ask!

Job Family

Data (FG)