Software Engineer – AI/ML Systems

Cogniify, Inc.; Santa Clara, Northern (CA, KY); Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Unlimited PTO

Generous parental leave

Open communication with management

Small, dynamic teams = massive impact

Medical, Dental and Vision coverage

Disability & Life insurance

ESPP

Yearly team building experiences

Mentorship and sponsorship

Job summary

Cogniify, Inc. is seeking a Software Engineer, AI/ML Systems to build, evaluate and deploy AI-powered applications and services.

This hands-on role combines production Python development, AI model evaluation, distributed deployment and automated testing. We are looking for someone who can take ownership of AI features from design through production, work with open-source models and AI agents, and improve system quality through reliable CI/CD pipelines and security automation.

Qualifications

• 4+ years of professional experience developing production-grade Python applications.
• Experience deploying, monitoring and scaling AI/ML models in production using Kubernetes, Ray, Slurm or similar orchestration tools.
• Experience with LLM development and evaluation tools such as Hugging Face, LangChain, vLLM or SG Lang, including prompt engineering and systematic benchmarking.
• Strong understanding of GPU-backed model serving, memory considerations and performance optimisation for high-throughput, low-latency inference.
• Experience analysing model and application results using Python libraries such as pandas and NumPy.
• Strong GitLab CI/CD experience, including automated testing, merge request workflows and integration of vulnerability scanning.
• Experience with PyTest, mocking tools and automated tests for APIs, services and AI applications.
• Good working knowledge of Git, including branching, rebasing, code review and secure collaboration practices.
• Ability to work independently, explain technical findings clearly and take responsibility for production quality.

Responsibilities

• Build and maintain production AI/ML applications and Python services, with clean architecture and asynchronous programming.
• Deploy and scale AI models and workloads using Kubernetes, Ray or Slurm across distributed infrastructure.
• Design and evaluate AI agents and LLM workflows, including prompt tuning, model comparisons and performance benchmarking.
• Analyze model outputs, identify errors and quality gaps, and build clear reports or dashboards for stakeholders.
• Develop automated unit, integration and end-to-end tests for software components and AI workflows.
• Build and improve GitLab CI/CD pipelines for automated testing, code quality checks, and vulnerability scanning.
• Work on GPU memory usage, inference throughput and latency to improve model serving efficiency.
• Maintain sound Git practices and collaborate across code repositories, including public/private projects when required.
• Own assigned features from requirements and design through deployment, monitoring and troubleshooting.

Skills

Async programming

Software architecture

Design patterns

Model evaluation

Performance benchmarking

Independent work

Tools

Kubernetes

Ray

Slurm

Hugging Face

LangChain

vLLM

SGLang

GitLab CI/CD

PyTest

NumPy

pandas

Git

Job description

The Role

Cogniify ishiring a Software Engineer, AI/ML Systems to build, evaluate and deployAI-powered applications and services. This is a hands-on engineering rolecombining production Python development, AI model evaluation, distributeddeployment and automated testing.

We are lookingfor someone who can take ownership of AI features from design throughproduction, work with open-source models and AI agents, and improve systemquality through reliable CI/CD pipelines and security automation. The role alsoinvolves GPU-enabled infrastructure, performance tuning and practicalevaluation of model outputs.

What You Will Do

• Build and maintain production AI/ML applications andPython services, with clean architecture, reusable components and asynchronousprogramming where needed.
• Deploy and scale AI models and workloads usingKubernetes, Ray or Slurm, supporting reliable operation across distributedinfrastructure.
• Design and evaluate AI agents and LLM workflows,including prompt tuning, model comparisons and performance benchmarking.
• Analyse model outputs, identify errors and quality gaps,and build clear reports or dashboards to share results with engineering andbusiness stakeholders.
• Develop automated unit, integration and end-to-end testsfor software components and AI workflows, including tests for variable modeloutputs.
• Build and improve GitLab CI/CD pipelines for automatedtesting, code quality checks, vulnerability scanning and faster remediation.
• Work on GPU memory usage, inference throughput andlatency to improve model serving efficiency.
• Maintain sound Git practices and support collaborationacross code repositories, including public and private projects when required.
• Own assigned features from requirements and technicaldesign through deployment, monitoring and troubleshooting.

What We Are LookingFor

• 4+ years of professional experience developingproduction-grade Python applications, including asynchronous programming,software architecture and design patterns.
• Hands-on experience deploying, monitoring and scalingAI/ML models in production using Kubernetes, Ray, Slurm or similarorchestration tools.
• Experience with LLM development and evaluation toolssuch as Hugging Face, LangChain, vLLM or SGLang, including prompt engineeringand systematic benchmarking.
• Strong understanding of GPU-backed model serving, memoryconsiderations and performance optimisation for high-throughput, low-latencyinference.
• Experience analysing model and application results usingPython libraries such as pandas and NumPy.
• Strong GitLab CI/CD experience, including automatedtesting, merge request workflows and integration of vulnerability scanning.
• Experience with PyTest, mocking tools and automatedtests for APIs, services and AI applications.
• Good working knowledge of Git, including branching,rebasing, code review and secure collaboration practices.
• Ability to work independently, explain technicalfindings clearly and take responsibility for production quality.

PreferredExperience

• Contributions to open-source AI projects, such asaccepted pull requests, issue fixes or technical documentation.
• Experience developing AI agents or multi-agentapplications, with measurable evaluation results or performance improvements.
• Experience designing custom CI/CD workflows for testing,security scanning or deployment automation.
• Experience with advanced Git repository workflows,including commit signing and public/private repository synchronization.

Perks AndBenefits Of Working With Us

• Unlimited PTO.
• Please ask us about our very generous parental leave,much above industry standards!.
• Entrepreneurial culture where pushing limits and takingrisks is everyday business.
• Open communication with management and companyleadership.
• Small, dynamic teams = massive impact.
• Medical, Dental and Vision coverage for employees.
• Access to Disability & Life insurance.
• Mental health and wellbeing support
• Employer Stock Purchase Program (ESPP)
• Yearly Team building experiences
• Mentorship and sponsorship opportunities
• Manager resources and support

We are anequal opportunity employer. We celebrate diversity and are committed tocreating an inclusive environment for all employees. All qualified applicantswill receive consideration for employment without regard to race, color,religion, sex, sexual orientation, gender identity, national origin,disability, or any other protected characteristic.