AI Solution Architect

Roche; Mississauga; On-site; CAD 90,000 - 150,000; Full time

Job summary

An innovative firm is seeking a skilled Artificial Intelligence Solutions Architect to lead the design and implementation of cutting-edge AI applications. In this role, you will work with advanced technologies, including Large Language Models and cloud services like AWS and Azure, to create scalable solutions that transform healthcare. Collaborating with a diverse team, you will ensure seamless integration of AI capabilities into enterprise systems while adhering to best practices in software engineering. If you're passionate about leveraging AI to make a global impact, this opportunity is for you!

Qualifications

• 7+ years in software architecture, including 3 years in AI/ML projects.
• Expertise in AWS and Azure cloud services.
• Strong background in Python and software engineering best practices.

Responsibilities

• Define and design AI and non-AI components of software applications.
• Architect solutions that integrate GenAI capabilities into enterprise systems.
• Ensure adherence to cloud-native best practices across AWS and Azure.

Skills

Software Architecture

Artificial Intelligence

Machine Learning

Cloud Services (AWS, Azure)

Python

Data Pipelines

APIs

Containerization (Docker, Kubernetes)

MLOps

Education

Bachelor's Degree in Computer Science

Tools

Docker

Kubernetes

Terraform

CloudFormation

Job description

At Roche you can show up as yourself, embraced for the unique qualities you bring. Our culture encourages personal expression, open dialogue, and genuine connections, where you are valued, accepted and respected for who you are, allowing you to thrive both personally and professionally. This is how we aim to prevent, stop and cure diseases and ensure everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters.

The Position

Always innovating, we bring together dedicated people and diverse perspectives from across our global network, empowering each other keep breaking new ground.

The Galileo team is looking for an Artificial Intelligence Solutions Architect.

Galileo is a strategic Roche Informatics program aiming to enable high-value AI (initial focus: Generative AI - GenAI) use cases at Roche through fit-for-purpose platforms and services, establishing a foundation for a Center of Excellence in AI.

We are looking for a highly skilled AI Software Architect to design and help implement end-to-end GenAI and non-GenAI applications. This role will involve working with Large Language Models (LLMs), multimodal models, Retrieval-Augmented Generation (RAG) pipelines, agentic workflows, vector and traditional databases, APIs, and other solution components also including those not related to AI, utilizing cloud services (AWS, Azure) to develop scalable and robust AI solutions.

The Opportunity:

• End-to-End System Architecture:

  • Define and design AI and non-AI components of software applications, ensuring modularity, scalability, and security

  • Architect solutions that integrate GenAI capabilities into enterprise systems while ensuring seamless interoperability with backend services, APIs, databases, and user interfaces

  • Ensure adherence to cloud-native best practices across AWS and Azure deployments, including containerization, orchestration, and infrastructure as code

• AI Model Integration & Optimization:

  • Define robust patterns for utilizing LLMs, multimodal models, and RAG and agentic systems

  • Design efficient model-serving pipelines, integrating AI capabilities into existing business workflows

• Enterprise-Grade Software Engineering:

  • Ensure that AI applications follow software engineering best practices, including version control, CI/CD, automated testing, and code quality assurance

  • Architect secure and scalable APIs to facilitate seamless communication between AI models, databases, and user interfaces

  • Design data pipelines that efficiently handle structured and unstructured data, ensuring AI models receive high-quality input data

• Observability, Performance & Security:

  • Define monitoring and logging strategies for AI-driven applications to ensure model performance, API health, and data integrity

  • Implement AI observability practices, ensuring visibility into model behavior, drift detection, and anomaly identification

  • Design architectures that adhere to data governance, security, compliance, and ethical AI guidelines

• Collaboration & Governance:

  • Work closely with ML Engineers, Data Scientists, Software Engineers, Business Analysts, Product Owners and other members of Agile development teams to translate business requirements into AI-driven architectures

  • Provide technical leadership in AI architecture reviews, design discussions, and solution validation

Who you are:

• 7+ years of experience in software architecture and engineering, including at least 3 years in AI/ML-related projects.

• Minimum Bachelors Degree or related experience.

• Expertise in AWS and Azure cloud services, including compute, storage, networking, security, and AI/ML services.

• Proven ability to design and implement cloud-native architectures using containerization (Docker, Kubernetes), orchestration, and IaC tools (Terraform, CloudFormation).

• Demonstrated track record of designing and deploying large-scale, cloud-based AI and non-AI applications in enterprise environments.

• Deep understanding of AI/ML concepts, including LLMs, multimodal models, RAG, agentic systems, model training, and evaluation metrics.

• Experience in designing and implementing AI model integration, optimization strategies, and model-serving pipelines.

• Strong software engineering background with proficiency in Python, backend development, APIs, data pipelines, and integration patterns.

• Knowledge of databases, including vector databases, SQL, NoSQL, and data storage solutions, along with experience in data governance and security.

• Experience with MLOps principles, CI/CD pipelines, DevOps, Infrastructure as Code, microservices, and software engineering best practices.

• Ability to define end-to-end system architectures, integrating AI and non-AI components, and designing monitoring, logging, and observability strategies.

Relocation benefits are not available for this job posting.

Who we are

A healthier future drives us to innovate. Together, more than 100’000 employees across the globe are dedicated to advance science, ensuring everyone has access to healthcare today and for generations to come. Our efforts result in more than 26 million people treated with our medicines and over 30 billion tests conducted using our Diagnostics products. We empower each other to explore new possibilities, foster creativity, and keep our ambitions high, so we can deliver life-changing healthcare solutions that make a global impact.

Let’s build a healthier future, together.

Roche is an Equal Opportunity Employer.