Senior AI Engineer - Remote, Enterprise ML & MLOps Expert

Penguin Computing, Inc.; United States; À distance; USD 175 000 - 215 000; Plein temps

Avantages offerts par ce poste

Medical benefits

Dental benefits

Vision benefits

401k plan

Résumé du poste

Penguin Solutions in the United States is seeking a Senior AI/ML Engineer to design, build, deploy, and troubleshoot enterprise AI solutions across cloud and on-prem environments. You will work on AI models, agentic applications, and MLOps with the NVIDIA AI stack, delivering secure, production-ready systems.

The role requires strong Python, Linux, Docker, Kubernetes skills and the ability to translate customer requirements into scalable architectures.

Qualifications

• 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems.
• Strong Python programming skills — testing, packaging, async, and API development, not just scripting.
• GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is commonly deployed; equivalent stacks like vLLM, TGI, Ray Serve, SageMaker are acceptable.
• Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems.
• Hands-on experience building LLM applications that carry production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails.
• Experience deploying beyond a single managed cloud: multi-cloud, on-premises, or hybrid environments.
• Strong communication and technical judgment, with experience explaining tradeoffs to non-specialist stakeholders.

Responsabilités

• Architect and build production AI solutions using commercial, open-source, and customer-developed models.
• Create agentic solutions with retrieval, tools, workflow orchestration, memory, evaluation, guardrails, and observability.
• Design enterprise AI environments using the NVIDIA AI Enterprise stack; build portable solutions for AWS, Azure, GCP, on-prem, and hybrid setups.
• Implement secure, scalable LLMOps and MLOps practices for testing, deployment, monitoring, governance, versioning, and rollback.
• Embed security: address prompt injection, insecure tool use, data exposure, and supply-chain risks; enforce access controls and encryption.
• Translate customer requirements into practical architectures; support proofs of concept, production deployments, and ongoing operations.
• Explain technical options and tradeoffs to customers and internal teams clearly.

Connaissances

Python

LLM applications

Distributed systems

Multi-cloud deployment

Communication

Outils

NVIDIA AI Enterprise

Docker

Kubernetes

LangGraph

LlamaIndex

PyTorch

Hugging Face

MLflow

Kubeflow

OpenTelemetry

Prometheus

Grafana

Terraform

Ansible

Description du poste

Penguin Solutions in the United States is seeking a Senior AI/ML Engineer to design, build, deploy, and troubleshoot enterprise AI solutions across cloud and on-prem environments. You will work on AI models, agentic applications, and MLOps with the NVIDIA AI stack, delivering secure, production-ready systems.

The role requires strong Python, Linux, Docker, Kubernetes skills and the ability to translate customer requirements into scalable architectures.