Senior AI Engineer — GenAI, LLMs & Scalable Systems

Zingly, Inc.; San Francisco (CA); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Zingly, Inc. in San Francisco, CA is seeking a 10X Senior AI Engineer to design and scale cutting‑edge AI systems, including real‑time voice AI capabilities. You will own end‑to‑end development from LLM training to API design and governance, collaborating across product and engineering to deliver GenAI powered solutions.

The role emphasizes hands‑on delivery, architecture leadership, and building domain‑specific LLMs for diverse customer use cases with strong emphasis on performance and security.

Qualifications

• 5–8 years in ML/AI engineering with strong focus on NLU and GenAI systems.
• Hands-on experience with agentic AI (multi-agent systems, planning, memory, tool use) MCP and RAG architectures at scale.
• Deep knowledge of LLM training, fine-tuning, evaluation, and safety.
• Experience building real-time conversational and Voice AI systems.
• Proven track record of taking ML systems from research to production.
• Strong MLOps and cloud experience (preferably AWS), including CI/CD and model lifecycle management.
• Proficient in Python (Java a plus) and building scalable APIs and event-driven systems.
• Solid understanding of distributed systems, microservices, and containerization (Docker/Kubernetes).
• Familiarity with observability tools and real-time communication protocols (e.g., WebRTC, VoIP).
• Strong computer science fundamentals (data structures, algorithms).

Responsibilities

• Design and build state-of-the-art AI systems, including training, securing, and applying guardrails to LLMs.
• Architect, scale, and optimize AI solutions on the Zingly platform.
• Develop and integrate REST APIs for backend services (e.g., STT, TTS, STS).
• Design high-performance, scalable & secure APIs with strong governance & ease of use.
• Build and deploy scalable modules leveraging LLMs and proprietary models, including prompt engineering and fine-tuning.
• Develop application-specific interfaces powered by LLMs.
• Enable clients to build GenAI applications and experiences using platform services.
• Lead the design and development of domain-specific LLMs for targeted use cases.
• Contribute to technical direction, system design, and engineering excellence.

Skills

NLU

GenAI systems

LLM training

Python

APIs

MLOps

AWS

Docker

Kubernetes

WebRTC

VoIP

Tools

Docker

Kubernetes

WebRTC

CI/CD

REST APIs

Job description

Zingly, Inc. in San Francisco, CA is seeking a 10X Senior AI Engineer to design and scale cutting‑edge AI systems, including real‑time voice AI capabilities. You will own end‑to‑end development from LLM training to API design and governance, collaborating across product and engineering to deliver GenAI powered solutions.

The role emphasizes hands‑on delivery, architecture leadership, and building domain‑specific LLMs for diverse customer use cases with strong emphasis on performance and security.