Senior DevOps Engineer, AI Infrastructure

Jobtailor; Toronto; On-site; CAD 130,000 - 145,000; Full time

Benefits offered by this job

Competitive pay

Hybrid work options

Medical, dental and vision

RRSP Matching

Wellness activities

Virtual events & team activities

Career learning

Job summary

Financeit is seeking a Senior DevOps Engineer, AI infrastructure to design, develop, and implement GenAI solutions for financial applications. The role emphasizes building AI agents, memory management, guardrails, and tool orchestration to ensure safe and reliable execution.

You will work with engineers to deploy GenAI models in production, manage containerized environments, and maintain cloud infrastructure across AWS, Azure, or GCP. Strong Python and MLOps skills are essential.

Qualifications

• Bachelor's degree in CS, Software Engineering or related field.
• 5+ years in DevOps, software development, or AI/ML with GenAI apps.
• Deep GenAI, LLMs, and agentic AI concepts knowledge.

Responsibilities

• Design, develop GenAI solutions for financial applications.
• Build AI Agents with guardrails and tool orchestration.
• Process large structured and unstructured data.
• Architect and scale RAG and semantic search systems; ground outputs in enterprise data.
• Develop prompting strategies for LLMs and evaluate models.
• Deploy GenAI models in production with CI/CD and cloud infra.

Skills

Problem solving

Communication

Education

Bachelor's degree in CS/Software Engineering or related field

Tools

Python

Docker

Kubernetes

CI/CD

AWS/Azure/GCP

LangGraph

LlamaIndex

Qdrant/Pinecone/pgvector

Job description

Who we are: Financeit is a point-of-sale financing provider serving some of the largest home improvement and retail organizations in Canada. Our platform helps businesses close more sales by offering customers affordable monthly payment options for their next big home improvement, vehicle or retail purchase. We are small enough that you can make an impact within the company and large enough to make an impact in the market. Financeit is a company where collaboration, inclusivity, fairness, and respect aren't just ideas that get talked about, but are part of who we are. If such a workplace intrigues you, we hope you'll join us.

About the role

We are seeking a highly skilled and passionate Senior DevOps Engineer, AI infrastructure to join our team! You will play a key role in designing, developing, and implementing cutting‑edge Generative AI (GenAI) solutions, including exploring and applying advanced concepts like Agentic AI, within our financial operations. This role offers a challenging opportunity to contribute to impactful projects, leveraging deep technical expertise in GenAI, LLMs, RAG pipelines, vector databases, chatbot development, and related technologies. You will collaborate with engineers and stakeholders and drive innovation by applying AI and automation to solve complex financial problems.

What you'll be doing

• Design, develop, and implement GenAI solutions for various financial applications, including personalized recommendations, risk assessment, fraud detection, and automated reporting.
• Design and implement AI Agents, utilizing rigorous harness engineering to build the necessary guardrails, memory management, and tool orchestration for safe and reliable execution.
• Process and analyze large datasets of structured and unstructured data.
• Architect and scale dynamic context retrieval systems (RAG) and semantic search infrastructures, leveraging tools like AWS Bedrock and LangGraph to securely ground AI outputs in enterprise data.
• Develop and refine advanced prompting strategies for LLMs.
• Test, evaluate, and analyze the performance of LLM and other GenAI models.
• Collaborate closely with engineering teams to deploy and maintain GenAI models in production environments, including containerization, CI/CD pipelines, and cloud infrastructure management.
• Communicate effectively with business stakeholders.
• Stay up-to-date with the latest advancements in GenAI research and development, including areas like Agentic AI.

Requirements

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• 5 years+ of experience in DevOps, Software Development, or AI/ML development, with a proven track record of building and deploying sophisticated GenAI applications.
• Deep understanding of GenAI models, architectures and agentic AI concepts.
• Extensive experience of LLM architectures, prompt engineering, fine‑tuning, evaluation, and deploying agents (Agentcore stack).
• Expert Python skills, Vector Databases (Qdrant, Pinecone, pgvector), and RAG pipelines using LlamaIndex and LangGraph.
• Experience in MLOps, containerization (Docker/Kubernetes), CI/CD, and cloud infrastructure (AWS, Azure, or GCP).
• Analytical problem‑solver with a proven ability to effectively communicate and collaborate across departments and drive projects forward.

Strongly Preferred

• Experience with financial data and applications.
• Familiarity with chatbot development frameworks and best practices, including conversational AI design and natural language understanding (NLU).
• Experience leading or contributing to complex data science or AI/ML projects in a fast‑paced environment.
• Experience with data visualization and reporting tools.Experience with SQL databases.
• Winner of Canada's Most Admired Corporate Cultures, twice.

Benefits and Perks

• Competitive pay and performance‑based bonus: Annual Base Salary: $130,000 - 145,000; Annual Bonus: 20%.
• Committed to flexible work arrangements, offering hybrid workplace options.
• Comprehensive medical, dental and vision coverage + Lifestyle Account.
• RRSP Matching and Parental Leave Top UP Program.
• In‑office massage, meditation & workout sessions.
• Virtual events such as Lunch & Learns, company parties, fun team activities and charity initiatives.
• Career learning and development programs.

Next Steps

What you'll find if you apply: If what you just read excites you, we'd like to hear from you! Please submit your application and we'll contact you if you are selected to move forward in the process.

Financeit is an equal opportunity employer. We celebrate diverse backgrounds and perspectives because we know they make our team stronger and our product better. We hire based on talent, potential, and culture – no matter your background, identity, or life experience, you are welcome here. We may use AI to support our hiring process. While these tools assist our team, applications are ultimately reviewed and assessed by our recruiters. If you require acc