Staff Machine Learning Engineer, Generative AI (Auth0)

Okta; Toronto; On-site; CAD 154,000 - 230,000; Full time

Benefits offered by this job

Health insurance

Equity options

Paid leave

Job summary

A technology firm specializing in identity solutions is seeking a Staff Machine Learning Engineer to drive the development of scalable AI systems. This role involves designing and implementing AI infrastructure, optimizing machine learning systems, and collaborating with cross-functional teams to deliver innovative solutions. Candidates should have strong programming skills in Python and experience with container technologies. The position offers a competitive salary of $154,000—$230,000 CAD plus benefits.

Qualifications

• Strong experience in building and deploying scalable AI/ML systems.
• Hands-on knowledge of modern generative AI technologies.
• Proven track record of working with cross-functional teams.

Responsibilities

• Design and implement scalable AI platform services.
• Drive technical decision-making for AI/ML applications.
• Collaborate with product teams to enhance AI-driven features.

Skills

Programming in Python

Building AI/ML systems

Containerization with Docker

Kubernetes orchestration

Familiarity with Generative AI platforms

Collaboration with product and engineering teams

Tools

AWS

OpenAI

PyTorch

TensorFlow

Job description

Staff Machine Learning Engineer, AIFS (Auth0)

Join to apply for the Staff Machine Learning Engineer, AIFS (Auth0) role at Okta.

The Team

The AI Frameworks and Services team is at the forefront of enabling AI-driven innovation across our organization. We build the foundational frameworks and essential services that empower engineering teams to integrate cutting-edge AI capabilities into our products, transforming how our users interact with them. We collaborate closely with the Machine Learning team and various product teams to ensure the seamless and secure delivery of AI-enhanced features that provide real value to our users.

The Opportunity

As a Staff Machine Learning Engineer on the Generative AI team, you will help shape and accelerate our Generative AI strategy by contributing across the stack of model development, infrastructure, and platform services. You’ll drive design and implementation of production-ready AI/ML systems at scale—ranging from LLM-powered features to reusable platform components that other teams across Okta can build on.

• Design and implement scalable infrastructure and platform services for large-scale Generative AI use cases.
• Drive technical decision making while balancing simplicity, flexibility, reliability, and performance.
• Architect, design, and deploy robust Machine Learning & GenAI systems, ensuring seamless integration with diverse platform services and scalable LLMOps pipelines in production.
• Lead initiatives to tune, optimize, and deploy agentic applications in production with a focus on performance, reliability, and security.
• Collaborate with product, platform engineering, and security teams to ensure solutions are production-ready, resilient, and aligned with enterprise needs.

What you will do

• Design and implement components across different layers of the stack using technologies such as Python, LangGraph, DSPy, and MCP.
• Collaborate with product teams to shape the future of Agentic AI and Auth for GenAI.
• Build reliable and scalable systems to run data processing pipelines, LLMOps infrastructure, and model inference systems.
• Utilize containerization technologies like Docker and orchestration tools like Kubernetes to manage and deploy these systems efficiently.
• Collaborate cross-functionally with product managers, researchers, and engineers to deliver secure, high-quality, and scalable AI/ML systems.
• Mentor and coach engineers, contributing to the growth of the team and the larger engineering community.

What you bring

• Strong programming expertise in Python (and familiarity with Go or Typescript a plus).
• Proven experience building and deploying AI/ML systems at scale, including LLMOps, CI/CD, and infrastructure-as-code.
• Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
• Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
• Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
• Experience with LiteLLM, LangGraph, LangChain, DSPy, LlamaIndex, MCP, or other related AI agent frameworks.
• Experience with containerized applications (Docker, Kubernetes) and cloud-native environments.
• Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
• Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.

Nice To Haves

• Experience with identity and auth products.
• Experience creating tools that integrate with AI-based coding platforms.
• Experience with packaging and distributing containerized applications using Docker and Kubernetes.
• Familiarity with identity/authentication products and how they intersect with AI.
• Background in building AI-native developer tools or SDKs.

Please note that we encourage candidates to apply even if you do not have experience with all of the criteria or technologies listed above; these are provided to give insight into the tech stack and general responsibilities for the role.

The annual base salary range for this position for candidates located in Canada is between: $154,000—$230,000 CAD. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental, and vision insurance, RRSP with a match, healthcare spending, telemedicine, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program, please visit: https://rewards.okta.com/can.

What you can look forward to as a Full-Time Okta employee

• Amazing Benefits
• Making Social Impact
• Developing Talent and Fostering Connection + Community at Okta

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.

If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation.

Okta is committed to complying with applicable data privacy and security laws and regulations. For more information, please see our Personnel and Job Candidate Privacy Notice at https://www.okta.com/legal/personnel-policy/.

Okta is The World’s Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and automation, placing identity at the core of business security and growth.

Some roles may require travel to one of our office locations for in-person onboarding.

Referrals increase your chances of interviewing at Okta by 2x

Find your place at Okta today! https://www.okta.com/company/careers/

Seniority level: Not Applicable

Employment type: Full-time

Job function: Engineering and Information Technology

Industries: Computer and Network Security, Software Development, and IT Services and IT Consulting