Senior Machine Learning Engineer, Generative AI (Customer Identity)

Okta; San Francisco (CA); Remote; USD 169,000 - 253,000; Full time

Job summary

Join a forward-thinking company that prioritizes identity and security in the digital world. As a Machine Learning Engineer, you will work on building and scaling Generative AI use cases, integrating cutting-edge Large Language Models, and developing robust platform components. This role offers a unique opportunity to contribute to innovative AI/ML solutions while collaborating with diverse teams across the organization. Embrace a flexible work environment that fosters creativity and productivity, and be part of a team that values your insights and experiences. If you are passionate about applied AI/ML and eager to make a difference, this is the perfect role for you.

Benefits

Health insurance

401(k)

Paid leave

Flexible work environment

Talent Development

Community Building

Social Impact

Qualifications

• Proficiency in programming languages like Python, Scala, or Java.
• Experience in developing scalable AI/ML systems and LLMOps.

Responsibilities

• Design and implement infrastructure for leveraging LLMs in production.
• Collaborate with teams to ensure successful integration of AI/ML systems.

Skills

Python

Scala

C++

Java

AWS Bedrock

OpenAI

AI/ML systems

LLMOps

CI/CD

Infrastructure as Code (IaC)

prompt engineering

troubleshooting

problem-solving

Education

Bachelor's degree in Computer Science

Bachelor's degree in Engineering

Tools

TensorFlow

PyTorch

Airflow

Docker

Kubernetes

LangChain

FastAPI

Job description

Get to know Okta

Okta is The World's Identity Company. We enable everyone to safely use any technology, anywhere, on any device or app. Our Workforce and Customer Identity Clouds provide secure, flexible access, authentication, and automation, transforming how people navigate the digital world. We prioritize identity as a core element of business security and growth.

At Okta, we celebrate diverse perspectives and experiences. We are not looking for someone who checks every box but for lifelong learners and individuals who can bring unique insights to make us better.

Join our team! We're building a world where Identity belongs to you.

The Auth0 Engineering Team

Auth0 is an easy-to-implement authentication and authorization platform designed by developers for developers. We facilitate safe, secure, and seamless access for over 100 million daily logins worldwide. Our modern identity approach delivers convenience, privacy, and security, enabling our customers to focus on innovation.

Machine Learning Engineer

The Machine Learning team develops ML models, leverages Generative AI, and builds infrastructure and platform components to scale AI/ML operations.

This role involves building and scaling Generative AI use cases, including integrating Large Language Models (LLMs) and developing reusable platform components. The ideal candidate will have a strong technical background, hands-on experience in deploying AI/ML systems, and a passion for applied AI/ML. They should be comfortable working with data, promoting a data-driven culture, and interested in open source AI/ML technologies.

Responsibilities

• Design and implement infrastructure and platform components for leveraging LLMs in production.
• Optimize LLMs to improve response quality and performance.
• Create workflows and pipelines for processing data into knowledge bases for various use cases.
• Collaborate with platform engineering teams to ensure successful integration of AI/ML systems into production, meeting performance and availability standards.
• Participate in planning, design, development, and code reviews.
• Communicate effectively with business stakeholders and leadership, educating them about systems and sharing insights.
• Work across Engineering, Product Management, Security, and Design teams to address challenges.

Basic Qualifications

• Proficiency in programming languages such as Python, Scala, C++, or Java.
• Knowledge of AWS Bedrock, OpenAI, or similar Generative AI platforms.
• Experience in developing scalable AI/ML systems, including RAG and embedding workflows.
• Experience with LLMOps, CI/CD, and Infrastructure as Code (IaC).
• Understanding of the full AI/ML lifecycle.
• Knowledge of prompt engineering and safety guardrails.
• Excellent communication skills.
• Strong troubleshooting and problem-solving skills, with the ability to thrive in a fast-paced environment.

Preferred Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• Experience with training and fine-tuning models at scale, including LLM evaluation.
• Familiarity with ML frameworks (TensorFlow, PyTorch), data platforms (Airflow), and containerization (Docker, Kubernetes).
• Proficiency in Python and AI/ML libraries such as LangChain and FastAPI.
• Ability to work independently, prioritize tasks, and adapt in a dynamic environment.
• Combination of technical expertise and business acumen to collaborate effectively across teams.

#LI-Remote

#LI-SH1

The annual base salary range for candidates in the San Francisco Bay Area is $169,000—$253,000 USD. For candidates in California (excluding SF Bay Area), Colorado, New York, and Washington, the range is $150,000—$226,000 USD. Actual salary depends on skills, experience, and location. Benefits include health insurance, 401(k), paid leave, and more. For details, visit https://rewards.okta.com/us.

What you can look forward to as a Full-Time Okta employee

• Great Benefits
• Social Impact
• Talent Development and Community Building

We offer a flexible work environment with tools and benefits to support productivity and creativity. Some roles may require travel for onboarding. Learn more at https://www.okta.com/company/careers/.

Okta is an Equal Opportunity Employer. We consider all applicants regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. We accommodate applicants with disabilities upon request. For privacy information, see our Privacy Policy at https://www.okta.com/privacy-policy/.