AI Engineer with Linux | VY Systems | New York / New Jersey

VY Systems; New York (NY, NJ); Hybrid; USD 165,000 - 248,000; Part time

Job summary

VY Systems is seeking an experienced AI Engineer with strong Linux administration, ML model deployment, and AI pipeline engineering expertise. You will own deployment, scaling, and maintenance of AI workloads, model serving environments, and Linux compute clusters across NY/NJ.

You will design and implement high-performance inference pipelines using Python and C++, leveraging Docker, Kubernetes, and NVIDIA tooling, while collaborating with data scientists, software engineers, and DevOps in Agile

Qualifications

• Bachelor's degree or higher in a technical field such as CS/AI/Software Engineering.
• 5–7+ years of progressive professional experience in software engineering, machine learning engineering, and Linux administration.
• Hands-on experience with Python, ML frameworks (PyTorch, TensorFlow), and AI model deployment.
• Proficiency with Linux OS installation, configuration, and shell scripting.
• Experience with Docker, Kubernetes, and GPU resource management.
• CI/CD pipelines and MLOps workflow automation.

Responsibilities

• Develop, deploy, scale, and maintain AI inference pipelines and APIs.
• Administer Linux OS and GPU compute clusters for enterprise workloads.
• Implement containerization and model serving with Docker and Kubernetes.
• Build automated MLOps pipelines and CI/CD workflows for model deployment.
• Optimize AI performance, memory, latency, and throughput in Linux environments.
• Provide advanced debugging and RCA for AI pipeline issues.
• Collaborate with data science, software, and DevOps teams in Agile sprints.
• Maintain documentation of deployment runbooks and system topologies.

Skills

Python

PyTorch

TensorFlow

Linux administration

Docker

Kubernetes

API development

CI/CD pipelines

Education

Bachelor's degree in Computer Science, AI, or related field

Tools

NVIDIA CUDA runtimes

Job description

Position Summary

VY Systems is actively seeking an experienced, high-caliber, and technical AI Engineer with strong expertise in Linux systems administration, machine learning model deployment, and AI pipeline engineering to join our client project on a contract C2C hybrid basis across New York and New Jersey (local candidates only). In this critical artificial intelligence engineering and infrastructure role, you will be responsible for developing, deploying, scaling, and maintaining AI workloads, model serving environments, and Linux compute clusters. You will leverage your deep specialist expertise in machine learning frameworks, Linux server administration, container orchestration, and MLOps pipelines to deliver uncompromised system performance, high availability, and operational excellence. This opportunity offers competitive compensation, executive technical visibility, and exceptional career growth prospects within a premier global IT recruitment and staffing enterprise.

Detailed Job Description

As an AI Engineer with Linux supporting VY Systems across NY/NJ, you will take full operational, tactical, and technical ownership of AI model deployment, Linux infrastructure optimization, containerized model serving, and pipeline automation across mission-critical enterprise systems. Your day-to-day responsibilities include designing, building, and maintaining high-performance machine learning inference pipelines and RESTful APIs utilizing Python and C++, provisioning, hardening, and administering enterprise Linux operating systems and GPU compute nodes, implementing containerized deployment frameworks utilizing Docker, Kubernetes, and NVIDIA Container Toolkit, collaborating closely with data science squads, software engineers, and DevOps teams in Agile sprint cycles, conducting rigorous performance profiling, GPU utilization tuning, and root cause analysis (RCA) for AI inference bottlenecks, preparing comprehensive technical documentation of deployment runbooks, system topologies, and operational guides, and managing application requirements. You will utilize your proactive troubleshooting and analytical problem-solving skills to resolve complex AI model serving and Linux kernel anomalies under strict service level agreements. Furthermore, you will manage application requirements ensuring strict compliance with local candidate presence in NY/NJ and C2C terms.

Key Responsibilities

• Develop, deploy, scale, and maintain high-performance artificial intelligence and machine learning inference pipelines.
• Administer, configure, and optimize enterprise Linux operating systems and GPU-accelerated compute clusters.
• Implement robust containerization and model serving architectures utilizing Docker, Kubernetes, and NVIDIA CUDA runtimes.
• Build and maintain automated MLOps pipelines, continuous integration workflows, and model deployment scripts.
• Optimize AI model performance, memory footprint, inference latency, and throughput on Linux environments.
• Provide expert level-3 technical troubleshooting, debugging, and rapid root cause analysis (RCA) for AI pipeline anomalies.
• Collaborate seamlessly with cross-functional data science, software engineering, and DevOps squads.
• Maintain accurate, comprehensive technical documentation of model serving architectures, deployment scripts, and operational runbooks.

Required Qualifications & Skills

• Bachelor's degree in Computer Science, Artificial Intelligence, Software Engineering, or a related technical discipline.
• Minimum of 5 to 7+ years of progressive professional experience in software engineering, machine learning engineering, and Linux administration.
• Strong, demonstrable hands-on professional expertise in Python programming, machine learning frameworks (PyTorch, TensorFlow), and AI model deployment.
• Comprehensive working knowledge and practical proficiency in enterprise Linux operating systems (Ubuntu, RHEL) and shell scripting.
• Deep practical experience in containerization platforms (Docker, Kubernetes) and GPU resource management.
• Solid practical experience in API development, CI/CD deployment pipelines, and MLOps workflow automation.
• Exceptional analytical, troubleshooting, debugging, and problem-solving capabilities under high-pressure conditions.
• Excellent written and verbal English communication skills with strong cross-functional collaboration and technical documentation abilities.
• Mandatory local candidate status in NY/NJ, C2C visa eligibility, and physical availability for hybrid professional operations.

Nice-to-Have Skills

• Professional certifications such as AWS Certified Machine Learning, NVIDIA Certified Deep Learning Associate, or Linux Foundation Certified System Administrator.
• Prior professional working experience in top-tier technology consulting firms, AI startups, or enterprise technology labs.
• Hands-on familiarity with vector databases (Pinecone, Chroma) and LLM orchestration tools (LangChain, LlamaIndex).
• Experience utilizing enterprise monitoring and observability suites (Prometheus, Grafana, Datadog).
• Exposure to agile software development methodologies and enterprise ITSM ticketing platforms (Jira, ServiceNow).

Application Information

• Recruiter: VY Systems Recruitment Division
• Contact Name: Kayalvizhi
• Email: `[e-mail]`
• Phone:
• Company Website: https://www.vysystems.com
• Salary/Rate: Market Competitive / Enterprise Contract Package (C2C)
• Deadline: Open until filled (Urgent NY/NJ AI Engineer Opening)
• Notice Period: Immediate to 30 Days Preferred
• Contract Duration: Contract Engagement (C2C) / Hybrid Work in NY/NJ