MLOps Engineer (AI and DevOps) - USA

Cogniify, Inc.

Santa Clara (CA)

Sur place

USD 180 000 - 210 000

Plein temps

Il y a 4 jours
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Unlimited PTO
Generous parental leave
Medical, dental, and vision coverage
Disability and life insurance
Mental health and wellbeing support
Employee Stock Purchase Plan(ESPP)
Yearly team-building experiences
Mentorship and sponsorship
Manager resources and support
Small teams where your work makes aリア

Résumé du poste

Cogniify, Inc. is hiring an MLOps Engineer with 3 to 6 years of experience to run and scale our AI and machine learning systems in production. You will deploy open-source language models on GPU clusters, build CI/CD pipelines, and ensure fast, reliable AI services.

You will write Python, work with Kubernetes, Ray or Slurm, and set up GitLab pipelines that test and secure our code on every merge. You will collaborate with engineers, data scientists and product managers from idea to production.

Qualifications

  • 3 to 6 years of professional experience in MLOps, DevOps or software engineering, with at least 3 years of production Python, including asynchronous code with asyncio.
  • Hands-on experience deploying,monitoring and scaling models or AI services in production on at least one of Kubernetes, Ray or Slurm.
  • Working knowledge of GitLabCI/CD, including automated test jobs and vulnerability scanning on mergerequests.
  • Good understanding of GPU memory use and tuning for fast, low-latency AI inference.
  • Hands-on experience with at leasttwo of LangChain, Hugging Face libraries, vLLM and SGLang.
  • Experience with promptengineering, and with running structured LLM evaluations and benchmarks.
  • Good data analysis skills inPython with pandas, NumPy or similar, and the ability to explain resultsclearly to both technical and non-technical people.
  • Strong command of PyTest andmocking libraries, and experience writing tests for AI workloads.
  • Good Git skills, including rebaseworkflows, commit signing and repository mirroring.
  • A BS or higher in ComputerScience, Engineering or a related field, or equivalent practical experience.
  • Links to accepted pull requests,resolved issues or documentation you wrote in public AI repositories such asLangChain, Hugging Face, vLLM or SGLang are a big plus.
  • A short write-up or repositorylink for an AI agent or multi-agent system you built, with accuracy numbersfrom your own benchmarks or gap analysis, is a plus.
  • A GitLab or GitHub pipeline youdesigned to fix a testing, automation or security scanning problem is a plus.

Responsabilités

  • Deploy and scale open-sourcelanguage models on Kubernetes, Ray or Slurm, so AI workloads stay available andrecover on their own when something fails.
  • Manage GPU memory and tuneinference settings with tools such as vLLM and SGLang, so responses are fastand throughput is high.
  • Build and maintain GitLab CI/CDpipelines that run automated tests and vulnerability scans on every mergerequest, and fix security findings quickly.
  • Monitor model and serviceperformance in production, and track speed, cost and errors.
  • Write clean, asynchronous Pythonfor AI applications and agents, using simple designs that are easy to test andchange.
  • Prompt-tune models and agents,and build an easy way to compare models and swap one for another withoutrewriting the application.
  • Run model benchmarks, study thewrong outputs to find gaps, and build dashboards that explain the findings inplain language.
  • Write automated tests with PyTestand mocking libraries, and raise test coverage for both regular code and AIoutputs that change from run to run.
  • Take features from idea toproduction, make sound design choices, and keep clear notes on how things work.
  • Keep Git history tidy with rebaseand signed commits, and mirror code between internal and public repositorieswhen needed.

Connaissances

MLOps
DevOps
Python
asyncio
Kubernetes
Ray
Slurm
GPU inference
vLLM
SGLang
LangChain
Hugging Face
GitLab CI/CD
DevSecOps
vulnerability scanning
PyTest
LLM evaluation

Formation

BS or higher in Computer Science, Engineering or related field

Outils

Git
Pandas
NumPy
GitLab CI/CD

Description du poste

The Role

Cogniify is hiring an MLOpsEngineer with 3 to 6 years of experience to run and scale our AI and machinelearning systems. You will deploy open-source language models on GPU clusters,build the CI/CD pipelines that test and secure our code, and keep our AIapplications fast and reliable.

Day to day, you will writePython, work with Kubernetes, Ray or Slurm, and set up GitLab pipelines thatrun tests and security scans on every merge request. You will also benchmarkmodels, find where they go wrong and share the results in simple dashboards.

You will work with softwareengineers, data scientists and product managers, and you will own features fromthe first idea to production.

Core skills for this role includeMLOps, DevOps, Python, asyncio, Kubernetes, Ray, Slurm, GPU inference, vLLM,SGLang, LangChain, Hugging Face, GitLab CI/CD, DevSecOps, vulnerabilityscanning, PyTest and LLM evaluation.

What You Will Do

  • Deploy and scale open-sourcelanguage models on Kubernetes, Ray or Slurm, so AI workloads stay available andrecover on their own when something fails.
  • Manage GPU memory and tuneinference settings with tools such as vLLM and SGLang, so responses are fastand throughput is high.
  • Build and maintain GitLab CI/CDpipelines that run automated tests and vulnerability scans on every mergerequest, and fix security findings quickly.
  • Monitor model and serviceperformance in production, and track speed, cost and errors.
  • Write clean, asynchronous Pythonfor AI applications and agents, using simple designs that are easy to test andchange.
  • Prompt-tune models and agents,and build an easy way to compare models and swap one for another withoutrewriting the application.
  • Run model benchmarks, study thewrong outputs to find gaps, and build dashboards that explain the findings inplain language.
  • Write automated tests with PyTestand mocking libraries, and raise test coverage for both regular code and AIoutputs that change from run to run.
  • Take features from idea toproduction, make sound design choices, and keep clear notes on how things work.
  • Keep Git history tidy with rebaseand signed commits, and mirror code between internal and public repositorieswhen needed.
WhatWe Are Looking For
  • 3 to 6 years of professionalexperience in MLOps, DevOps or software engineering, with at least 3 years ofproduction Python, including asynchronous code with asyncio.
  • Hands-on experience deploying,monitoring and scaling models or AI services in production on at least one ofKubernetes, Ray or Slurm.
  • Working knowledge of GitLabCI/CD, including automated test jobs and vulnerability scanning on mergerequests.
  • Good understanding of GPU memoryuse and tuning for fast, low-latency AI inference.
  • Hands-on experience with at leasttwo of LangChain, Hugging Face libraries, vLLM and SGLang.
  • Experience with promptengineering, and with running structured LLM evaluations and benchmarks.
  • Good data analysis skills inPython with pandas, NumPy or similar, and the ability to explain resultsclearly to both technical and non-technical people.
  • Strong command of PyTest andmocking libraries, and experience writing tests for AI workloads.
  • Good Git skills, including rebaseworkflows, commit signing and repository mirroring.
  • A BS or higher in ComputerScience, Engineering or a related field, or equivalent practical experience.
  • Links to accepted pull requests,resolved issues or documentation you wrote in public AI repositories such asLangChain, Hugging Face, vLLM or SGLang are a big plus.
  • A short write-up or repositorylink for an AI agent or multi-agent system you built, with accuracy numbersfrom your own benchmarks or gap analysis, is a plus.
  • A GitLab or GitHub pipeline youdesigned to fix a testing, automation or security scanning problem is a plus.
Perks and Benefits of WorkingWith Us
  • Unlimited PTO
  • Generous parental leave, wellabove industry standards
  • Medical, dental, and visioncoverage for employees
  • Disability and life insurance
  • Mental health and wellbeingsupport
  • Employee Stock Purchase Plan(ESPP)
  • Yearly team-building experiences
  • Mentorship and sponsorshipopportunities
  • Manager resources and support
  • Small teams where your work makesa real difference
  • Open communication withmanagement and company leadership
  • An entrepreneurial culture wheretaking initiative is part of everyday work

Cogniify is an equal opportunity employer. We celebratediversity and are committed to creating an inclusive environment for allemployees. All qualified applicants will receive consideration for employmentwithout regard to race, color, religion, sex, sexual orientation, genderidentity, national origin, disability, veteran status, or any other protectedcharacteristic.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Production AI/ML Systems Engineer (Python, GPU/Kubernetes)
Production AI/ML Systems Engineer (Python, GPU/Kubernetes)

Cogniify, Inc. • Santa Clara (CA)

Hybride
USD 150 000 - 230 000
Unlimited PTO
Generous parental leave
Open communication with management
+6
Machine Learning Engineer - USA (Remote)
Machine Learning Engineer - USA (Remote)

Cogniify, Inc. • États-Unis

À distance
USD 119 000 - 132 000
Unlimited PTO
Parental leave
Medical, dental, and vision coverage
+6
Machine Learning Engineer - USA (Remote)
Machine Learning Engineer - USA (Remote)

Cogniify • États-Unis

À distance
USD 120 000 - 180 000
Unlimited PTO
Parental leave
Medical, Dental, Vision insurance
+6
MLOps Engineer — AI Production & CI/CD Lead
MLOps Engineer — AI Production & CI/CD Lead

Cogniify, Inc. • Santa Clara (CA)

Sur place
USD 180 000 - 210 000
Unlimited PTO
Generous parental leave
Medical, dental, and vision coverage
+7
MLOPS Engineer- Remote
MLOPS Engineer- Remote

Innova Solutions • États-Unis

À distance
USD 120 000 - 180 000
Senior AI/ML Engineer | ML & MLOps Leader
Senior AI/ML Engineer | ML & MLOps Leader

Cogniify, Inc. • Santa Clara (CA)

Hybride
USD 150 000 - 170 000
Unlimited PTO
Parental leave (generous)
Medical insurance
+3
AIML Engineer
AIML Engineer

Qubeaxis • San Francisco (CA)

Sur place
USD 180 000 - 260 000
Performance bonus (up to 20% of base)
Equity participation
Health, dental, and vision insurance
+3
AI Data Scientist - USA
AI Data Scientist - USA

Cogniify • Santa Clara (CA)

À distance
USD 120 000 - 180 000
Unlimited PTO
Parental leave
Medical, dental, and vision coverage
+3
ML Ops Infrastructure Engineer
ML Ops Infrastructure Engineer

Deepgram • États-Unis

Sur place
USD 140 000 - 180 000
Medical, dental, vision benefits
Unlimited PTO
401(k) plan with company match
+1
Senior ML OPs Engineer
Senior ML OPs Engineer

Glocomms • California

Hybride
USD 198 000 - 230 000
Meal stipends for remote work days
Generous paid time off
Comprehensive health coverage
+1