Senior AI Engineer — Production LLM Systems

CyberCoders; New York (NY); On-site; USD 220,000 - 280,000; Full time

Benefits offered by this job

Unlimited PTO

Wellhub Platinum membership

Comprehensive health, dental, and vis​

Free company dinner every day

Job summary

CyberCoders in Manhattan, NY is seeking a Senior AI Engineer to lead the design and deployment of LLM-powered systems, from prototype to production. You will build end-to-end features, architect RAG pipelines, and develop multi-model agent frameworks with strong emphasis on safety, observability, and cost-efficient scaling.

You will collaborate with product, design, security, and domain experts to translate business requirements into technical specs and mentor junior engineers in best practices

Qualifications

• 5+ years of production backend or systems experience.
• Hands-on with LLMs and transformer architectures.
• Experience designing retrieval systems with LLMs.
• Experience building agent/tool-calling pipelines.

Responsibilities

• Design and ship end-to-end LLM-driven features and services with CI/CD and observability.
• Architect and build RAG pipelines and vector retrieval systems.
• Develop agent frameworks and tool-calling pipelines for multi-step workflows.
• Define evaluation frameworks and run automated/ human-in-the-loop evals.
• Instrument models with monitoring, A/B testing, and alerting.
• Partner with product and security to translate requirements into specs.
• Mentor engineers through code reviews and best practices.

Skills

Python

CI/CD

Testing

Containerization

LLMs

Transformers

Tools

LangChain

LlamaIndex

Weaviate

FAISS

Pinecone

Ray

MLflow

Job description

CyberCoders in Manhattan, NY is seeking a Senior AI Engineer to lead the design and deployment of LLM-powered systems, from prototype to production. You will build end-to-end features, architect RAG pipelines, and develop multi-model agent frameworks with strong emphasis on safety, observability, and cost-efficient scaling.

You will collaborate with product, design, security, and domain experts to translate business requirements into technical specs and mentor junior engineers in best practices