Staff Technical Program Manager, Deployments

Evergrid; United States; Hybrid; USD 150,000 - 200,000; Full time

Benefits offered by this job

Health insurance

Paid time off and paid holidays

Home office stipend

Job summary

Evergrid is seeking a hands-on engineer to design and deploy high-scale production inference systems for customers in the United States. You will own projects end-to-end, turning unclear goals into reliable services with measurable latency and cost targets.

You’ll work with customer teams and cross-functional platform groups to optimize the inference stack, pipelines, and tooling, delivering maintainable solutions and clear success criteria.

Qualifications

• 1+ years of professional engineering experience.
• Bachelor's, master's, or PhD in CS/Engineering/Math or equivalent.
• Experience with SGLang, vLLM, and other inference engines.
• Strong Python production software skills.

Responsibilities

• Develop production-grade inference services in Python.
• Lead customer engagements from PoC to production deployment.
• Collaborate with platform and infrastructure teams.
• Architect end-to-end customer projects with clear specs.
• Balance latency, throughput, reliability, and cost.

Skills

Python

Production software

Communication

Customer handling

Education

Bachelor's/Master's/PhD in CS/Engineering/Math

Tools

SGLang

vLLM

Inference engines

Job description

United States | Hybrid or Remote | Full-time

The role

You’ll work directly with Evergrid’s customers to architect, build, and deploy high-scale production inference systems on our infrastructure.

You own customer projects end to end, from early exploration to production deployment and monitoring. You take goals that start out unclear and turn them into reliable services you can monitor, with defined quality, latency, and cost targets. This role is hands-on. It combines software development, inference performance engineering, and customer-facing execution. You’ll embed with customer engineering teams and work closely with our platform and infrastructure teams.

What you’ll own

• Production-grade software systems and inference services, built mainly in Python.
• Customer engagements end to end: problem framing, evaluation, proof of concept, production deployment, and monitoring.
• Direct work with customer engineering teams through sales, implementation, and expansion.
• Turning unclear goals into clear technical specs and well-scoped PoCs.
• Inference pipelines optimized for latency, throughput, reliability, and cost.
• Improvements to Evergrid’s inference stack, tooling, and platform.
• Customer-facing initiatives, where you act as engineer, technical lead, and the person who drives execution.
• Sound tradeoffs under uncertainty that lead to simple, maintainable solutions.

What you bring

• A bachelor’s, master’s, or PhD in Computer Science, Engineering, Mathematics, or a related field, or equivalent practical experience.
• 1+ years of professional engineering experience.
• Experience with SGLang, vLLM, and other inference engines and schedulers.
• Strong production software skills, preferably in Python.
• Familiarity with the AI/ML lifecycle: model development, deployment, and monitoring.
• Clear communication on complex technical topics.
• Experience building, deploying, or optimizing AI/ML systems, which we value highly.
• Comfort working directly with customers and owning outcomes end to end.

Benefits & Compensation

• Compensation: $150,000 - $200,000
• Health insurance
• Paid time off and paid holidays
• Home office stipend