Software Engineer, Generative AI Platform

Alyta; United States; On-site; USD 120,000 - 170,000; Full time

Job summary

Alyta is hiring a Software Engineer for a Generative AI Platform to build and scale the inference and serving system powering Alyta products used by billions. This is a remote, US-based, full-time, mid-level role focused on latency, cost, and quality.

You will collaborate with data engineers, ML engineers, and product teams to design resilient, observable services. You will optimize inference for large language and multimodal models, implement efficient GPU workloads, and drive distributed

Qualifications

• 3+ years building production ML systems.

Responsibilities

• Optimize inference for large language and multimodal models.
• Partner with product teams to ship AI features.
• Collaborate with data engineers, ML engineers, and product teams to design reliable services.

Skills

ML systems

GPU inference

Distributed systems

Latency optimization

Cross-team collaboration

Job description

Software Engineer, Generative AI Platform

Remote, US full time remote mid level

Build the platform that powers generative AI experiences across Alyta products used by billions.

About the role

You will build and scale the inference and serving platform that delivers generative AI to every Alyta product, optimizing for latency, cost, and quality.

What you'll do

• Optimize inference for large language and multimodal models
• Partner with product teams to ship AI features
• 3+ years building production ML systems
• Experience with GPU inference and distributed systems