AI Inference Infrastructure Engineer

Scaled Cognition; New York (NY); On-site; USD 120,000 - 170,000; Full time

Job summary

Scaled Cognition is pioneering agentic AI for enterprise CX workflows. We seek a Software Engineer, Infrastructure to design and improve inference infrastructure and optimize latency across the stack.

You will collaborate with researchers and product engineers to move models from development to production deployments, ensuring scalable, reliable systems. Ideal candidates will have hands-on experience with cloud platforms and GPU tooling, and excel in navigating ambiguity while delivering

Qualifications

• Experience deploying systems on major cloud platforms (AWS, GCP, Azure).
• Designing and implementing GPU infrastructure / tooling.
• Strong sense for scalability and developing secure, highly reliable environments.

Responsibilities

• Design and improve inference infrastructure that powers our AI models.
• Benchmark, profile, monitor and analyze latency and throughput and drive improvements throughout the stack.
• Collaborate with research scientists and product engineers to streamline the end-to-end process from model development to production deployment.

Skills

Cloud platforms

GPU infrastructure

Scalability & reliability

Tools

GPU tooling

Job description

Scaled Cognition is pioneering agentic AI for enterprise CX workflows. We seek a Software Engineer, Infrastructure to design and improve inference infrastructure and optimize latency across the stack.

You will collaborate with researchers and product engineers to move models from development to production deployments, ensuring scalable, reliable systems. Ideal candidates will have hands-on experience with cloud platforms and GPU tooling, and excel in navigating ambiguity while delivering