Remote Tech Program Manager, AI Inference Systems

Evergrid; United States; Hybrid; USD 150,000 - 200,000; Full time

Benefits offered by this job

Health insurance

Paid time off and paid holidays

Home office stipend

Job summary

Evergrid is seeking a hands-on engineer to design and deploy high-scale production inference systems for customers in the United States. You will own projects end-to-end, turning unclear goals into reliable services with measurable latency and cost targets.

You’ll work with customer teams and cross-functional platform groups to optimize the inference stack, pipelines, and tooling, delivering maintainable solutions and clear success criteria.

Qualifications

• 1+ years of professional engineering experience.
• Bachelor's, master's, or PhD in CS/Engineering/Math or equivalent.
• Experience with SGLang, vLLM, and other inference engines.
• Strong Python production software skills.

Responsibilities

• Develop production-grade inference services in Python.
• Lead customer engagements from PoC to production deployment.
• Collaborate with platform and infrastructure teams.
• Architect end-to-end customer projects with clear specs.
• Balance latency, throughput, reliability, and cost.

Skills

Python

Production software

Communication

Customer handling

Education

Bachelor's/Master's/PhD in CS/Engineering/Math

Tools

SGLang

vLLM

Inference engines

Job description

Evergrid is seeking a hands-on engineer to design and deploy high-scale production inference systems for customers in the United States. You will own projects end-to-end, turning unclear goals into reliable services with measurable latency and cost targets.

You’ll work with customer teams and cross-functional platform groups to optimize the inference stack, pipelines, and tooling, delivering maintainable solutions and clear success criteria.