Senior AI Infra Engineer: Linux, Kubernetes & GPU Deployments

Tech Junction Ltd; New York (NY); Hybrid; USD 96,000 - 152,000; Full time

Job summary

Vy Systems is seeking an experienced AI Engineer with Linux expertise to build and maintain Linux-based AI pipelines and deployment infrastructure in the NY/NJ area. The role emphasizes containerized workloads, security hardening, and collaboration with data scientists and IT teams.

The ideal candidate has 4+ years in AI engineering, strong Python and ML framework skills, and hands-on Docker/Kubernetes experience. Local residency for hybrid work is required.

Qualifications

• Bachelor’s degree in CS/AI/IT/Software Eng.
• 4+ years in AI engineering and Linux administration.
• Hands-on with RHEL/Ubuntu admin and tuning.
• Proficient in PyTorch, TensorFlow, Scikit-Learn and Python.
• Experience with Docker/Kubernetes for AI deployment.
• Automation with Bash and Ansible.
• Strong problem-solving under pressure.
• Excellent English communication and teamwork.
• C2C eligibility and local NY/NJ residency.

Responsibilities

• Design and maintain AI infrastructure and pipelines.
• Administer Linux OS and hardening for AI clusters.
• Deploy ML models with Docker/Kubernetes.
• Collaborate with data scientists and IT teams.
• Document infrastructure and runbooks.
• Ensure security baselines and access controls.
• Support hybrid C2C local operations in NY/NJ.

Skills

AI engineering

Linux administration

Python development

PyTorch TensorFlow Scikit-Learn

Docker Kubernetes

Bash scripting

Ansible

English communication

Education

Bachelor’s degree in CS/AI/IT/Software Eng

Tools

Docker

Kubernetes

Ansible

Job description

Vy Systems is seeking an experienced AI Engineer with Linux expertise to build and maintain Linux-based AI pipelines and deployment infrastructure in the NY/NJ area. The role emphasizes containerized workloads, security hardening, and collaboration with data scientists and IT teams.

The ideal candidate has 4+ years in AI engineering, strong Python and ML framework skills, and hands-on Docker/Kubernetes experience. Local residency for hybrid work is required.