MLOps Engineer — AI Production & CI/CD Lead

Cogniify, Inc.

Santa Clara (CA)

On-site

USD 180,000 - 210,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Unlimited PTO
Generous parental leave
Medical, dental, and vision coverage
Disability and life insurance
Mental health and wellbeing support
Employee Stock Purchase Plan(ESPP)
Yearly team-building experiences
Mentorship and sponsorship
Manager resources and support
Small teams where your work makes aリア

Job summary

Cogniify, Inc. is hiring an MLOps Engineer with 3 to 6 years of experience to run and scale our AI and machine learning systems in production. You will deploy open-source language models on GPU clusters, build CI/CD pipelines, and ensure fast, reliable AI services.

You will write Python, work with Kubernetes, Ray or Slurm, and set up GitLab pipelines that test and secure our code on every merge. You will collaborate with engineers, data scientists and product managers from idea to production.

Qualifications

  • 3 to 6 years of professional experience in MLOps, DevOps or software engineering, with at least 3 years of production Python, including asynchronous code with asyncio.
  • Hands-on experience deploying,monitoring and scaling models or AI services in production on at least one of Kubernetes, Ray or Slurm.
  • Working knowledge of GitLabCI/CD, including automated test jobs and vulnerability scanning on mergerequests.
  • Good understanding of GPU memory use and tuning for fast, low-latency AI inference.
  • Hands-on experience with at leasttwo of LangChain, Hugging Face libraries, vLLM and SGLang.
  • Experience with promptengineering, and with running structured LLM evaluations and benchmarks.
  • Good data analysis skills inPython with pandas, NumPy or similar, and the ability to explain resultsclearly to both technical and non-technical people.
  • Strong command of PyTest andmocking libraries, and experience writing tests for AI workloads.
  • Good Git skills, including rebaseworkflows, commit signing and repository mirroring.
  • A BS or higher in ComputerScience, Engineering or a related field, or equivalent practical experience.
  • Links to accepted pull requests,resolved issues or documentation you wrote in public AI repositories such asLangChain, Hugging Face, vLLM or SGLang are a big plus.
  • A short write-up or repositorylink for an AI agent or multi-agent system you built, with accuracy numbersfrom your own benchmarks or gap analysis, is a plus.
  • A GitLab or GitHub pipeline youdesigned to fix a testing, automation or security scanning problem is a plus.

Responsibilities

  • Deploy and scale open-sourcelanguage models on Kubernetes, Ray or Slurm, so AI workloads stay available andrecover on their own when something fails.
  • Manage GPU memory and tuneinference settings with tools such as vLLM and SGLang, so responses are fastand throughput is high.
  • Build and maintain GitLab CI/CDpipelines that run automated tests and vulnerability scans on every mergerequest, and fix security findings quickly.
  • Monitor model and serviceperformance in production, and track speed, cost and errors.
  • Write clean, asynchronous Pythonfor AI applications and agents, using simple designs that are easy to test andchange.
  • Prompt-tune models and agents,and build an easy way to compare models and swap one for another withoutrewriting the application.
  • Run model benchmarks, study thewrong outputs to find gaps, and build dashboards that explain the findings inplain language.
  • Write automated tests with PyTestand mocking libraries, and raise test coverage for both regular code and AIoutputs that change from run to run.
  • Take features from idea toproduction, make sound design choices, and keep clear notes on how things work.
  • Keep Git history tidy with rebaseand signed commits, and mirror code between internal and public repositorieswhen needed.

Skills

MLOps
DevOps
Python
asyncio
Kubernetes
Ray
Slurm
GPU inference
vLLM
SGLang
LangChain
Hugging Face
GitLab CI/CD
DevSecOps
vulnerability scanning
PyTest
LLM evaluation

Education

BS or higher in Computer Science, Engineering or related field

Tools

Git
Pandas
NumPy
GitLab CI/CD

Job description

Cogniify, Inc. is hiring an MLOps Engineer with 3 to 6 years of experience to run and scale our AI and machine learning systems in production. You will deploy open-source language models on GPU clusters, build CI/CD pipelines, and ensure fast, reliable AI services.

You will write Python, work with Kubernetes, Ray or Slurm, and set up GitLab pipelines that test and secure our code on every merge. You will collaborate with engineers, data scientists and product managers from idea to production.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

MLOps Engineer: GenAI & LLM Production
MLOps Engineer: GenAI & LLM Production

InfoVision Inc. • Irving (TX)

On-site
USD 100,000 - 130,000
MLOps Engineer (AI and DevOps) - USA
MLOps Engineer (AI and DevOps) - USA

Cogniify, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 210,000
Unlimited PTO
Generous parental leave
Medical, dental, and vision coverage
+7
MLOps Engineer — Scalable AI Infra & Deployment, Equity
MLOps Engineer — Scalable AI Infra & Deployment, Equity

Fundamental • United States

Remote
USD 180,000 - 260,000
Salary + equity
Health coverage for you and dependents
Parental leave for all
+2
MLOps Engineer: AWS, CI/CD & Production AI
MLOps Engineer: AWS, CI/CD & Production AI

Motion Recruitment • Chicago (IL)

On-site
USD 125,000 - 160,000
MLOps Engineer: GPU Infra for Production AI
MLOps Engineer: GPU Infra for Production AI

Woven Solutions, LLC • Reston (VA)

Hybrid
USD 140,000 - 190,000
MLOps & Inference Engineer - Deploy, Optimize, Monitor AI
MLOps & Inference Engineer - Deploy, Optimize, Monitor AI

CAMB.AI Ltd. • United States

Remote
USD 140,000 - 190,000
Innovative Environment
Growth Opportunities
Competitive Compensation
MLOps Engineer - Remote, Productionize AI Models
MLOps Engineer - Remote, Productionize AI Models

Innova Solutions • United States

Remote
USD 120,000 - 180,000
MLOps Engineer
MLOps Engineer

Sierracorp • San Francisco (CA)

On-site
USD 100,000 - 150,000
MLOps Engineer — Production AI & Cloud Pipelines
MLOps Engineer — Production AI & Cloud Pipelines

Atlass Partners Consulting • United States

Remote
USD 120,000 - 180,000
MLOps Engineer
MLOps Engineer

BrothersTech • United States

On-site
USD 120,000 - 190,000