Remote Senior AI Engineer: Production ML & MLOps

sghcorp.com; Palo Alto (CA); Híbrido; USD 175 000 - 215 000; Tempo integral

Resumo da oferta

Penguin Solutions, the AI Factory Platform Company, is seeking a Senior AI/ML Engineer to join our post-sales delivery team. You will design, build, deploy, and troubleshoot enterprise AI solutions across public cloud, sovereign, on‑premises, and hybrid environments.

Ideal candidates have 7+ years in software/ML engineering, deep Python expertise, and hands-on experience with NVIDIA AI Enterprise and multi‑cloud architectures.

Qualificações

• 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems.
• Strong Python programming skills — testing, packaging, async, and API development, not just scripting.
• GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus — but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we’ll support your ramp‑up on the NVIDIA stack.
• Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems.
• Hands‑on experience building LLM applications that carried real production traffic — retrieval‑augmented generation, agentic workflows, tool integration, evaluation, and guardrails.
• Experience deploying beyond a single managed cloud: multi‑cloud, on‑premises, or hybrid environments.
• Strong communication and technical judgment, with experience explaining tradeoffs to non‑specialist stakeholders.

Responsabilidades

• Architect and implement applications using commercial, open-source, and customer‑developed models.
• Build agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability.
• Evaluate models and determine when to use prompt engineering, retrieval‑augmented generation, fine‑tuning, or other adaptation techniques.
• Integrate AI applications with enterprise data, APIs, tools, and business systems.
• Design and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem.
• Build portable solutions for AWS, Azure, GCP, on‑premises data centers, and hybrid environments.
• Work with containers, Kubernetes, GPU‑enabled infrastructure, networking, storage, identity, and platform services.
• Implement reliable LLMOps and MLOps practices for testing, deployment, monitoring, governance, versioning, and rollback.
• Address AI‑specific risks such as prompt injection, insecure tool use, sensitive‑data exposure, excessive permissions, and software supply‑chain vulnerabilities.
• Apply enterprise security practices including access controls, encryption, secrets management, network segmentation, and auditability.
• Support deployments with data‑privacy, regulatory, sovereignty, or disconnected‑environment requirements.
• Translate customer requirements and constraints into practical architectures and implementations.
• Contribute directly to technical discovery, proofs of concept, production deployments, and operational support.
• Troubleshoot complex issues across AI applications, orchestration platforms, integrations, and infrastructure.
• Clearly explain technical options, limitations, and tradeoffs to customers and internal stakeholders.

Conhecimentos

Python programming

GPU model serving

Linux

Docker

Kubernetes

LLM apps development

Multi-cloud / hybrid environments

Ferramentas

NVIDIA AI Enterprise stack

NVIDIA NeMo / Triton

Descrição da oferta de emprego

Penguin Solutions, the AI Factory Platform Company, is seeking a Senior AI/ML Engineer to join our post-sales delivery team. You will design, build, deploy, and troubleshoot enterprise AI solutions across public cloud, sovereign, on‑premises, and hybrid environments.

Ideal candidates have 7+ years in software/ML engineering, deep Python expertise, and hands-on experience with NVIDIA AI Enterprise and multi‑cloud architectures.