Forward Deployed AI Engineer

DeepRec.ai; New York (NY); On-site; USD 150,000 - 190,000; Full time

Job summary

DeepRec.ai sits at the intersection of AI engineering, product, and the customer to build production-grade AI infrastructure for complex enterprise environments. You’ll collaborate directly with senior stakeholders to understand high-value opportunities for AI and translate them into technical requirements and production systems.

You’ll develop and deploy LLM-powered applications, AI agents and intelligent workflows, taking AI solutions from prototype to production while balancing performance,

Qualifications

• 5–10+ years of software, ML or AI engineering experience.
• Strong hands-on Python + software engineering skills.
• Production experience building and deploying AI/ML systems.
• Strong recent experience with Generative AI / LLM applications.
• Experience with agents, RAG, retrieval, tool use, evaluation, fine-tuning or LLM deployment.
• Strong understanding of APIs, distributed systems and production architecture.
• Experience with AWS, Azure or GCP.
• Comfortable moving between customer conversations and hands-on engineering.
• Excellent communication skills across technical and non-technical stakeholders.
• Comfortable owning ambiguous problems with limited direction.

Responsibilities

• Work directly with customers to identify high-value opportunities for AI.
• Translate complex business workflows into technical requirements and production systems.
• Build LLM-powered applications, AI agents and intelligent workflows.
• Take AI solutions from prototype → production.
• Build and improve RAG, retrieval, evaluation and agentic AI systems.
• Integrate AI into existing APIs, platforms, data infrastructure and workflows.
• Make architectural decisions around models, infrastructure, deployment, security and reliability.
• Develop evaluation frameworks for AI system quality and performance.
• Troubleshoot complex technical problems directly within customer environments.
• Work closely with Product and Engineering to turn customer learnings into improvements to the core platform.

Skills

Python

Production systems

Generative AI/LLMs

Agents/RAG

APIs/distributed systems

Cloud platforms (AWS/Azure/GCP)

Communication

Ambiguity handling

Job description

DeepRec.ai is partnered with a high-growth AI company building production-grade AI infrastructure and applications for complex enterprise environments.

They’re looking for a Forward Deployed AI Engineer who sits at the intersection of AI engineering, product and the customer.

You’ll work directly with senior stakeholders to understand complex problems, translate them into technical solutions, and then build, deploy and iterate on those solutions in production. Think 50% engineer, 50% operator.

What you’ll be doing

• Work directly with customers to identify high-value opportunities for AI
• Translate complex business workflows into technical requirements and production systems
• Build LLM-powered applications, AI agents and intelligent workflows
• Take AI solutions from prototype → production
• Build and improve RAG, retrieval, evaluation and agentic AI systems
• Integrate AI into existing APIs, platforms, data infrastructure and workflows
• Make architectural decisions around models, infrastructure, deployment, security and reliability
• Develop evaluation frameworks for AI system quality and performance
• Troubleshoot complex technical problems directly within customer environments
• Work closely with Product and Engineering to turn customer learnings into improvements to the core platform

What they’re looking for

• 5–10+ years of software, ML or AI engineering experience
• Strong hands-on Python + software engineering skills
• Production experience building and deploying AI/ML systems
• Strong recent experience with Generative AI / LLM applications
• Experience with agents, RAG, retrieval, tool use, evaluation, fine-tuning or LLM deployment
• Strong understanding of APIs, distributed systems, microservices and production architecture
• Experience with AWS, Azure or GCP
• Comfortable moving between customer conversations and hands-on engineering
• Excellent communication skills across both technical and non-technical stakeholders
• Comfortable owning ambiguous problems with limited direction

Particularly interesting backgrounds

Experience across any of the following would be highly relevant:

• AI / LLMs | Agentic AI | RAG | LLM Evaluation | AI Infrastructure | Enterprise AI | Solutions
• Engineering | Forward Deployed Engineering | Technical Consulting | Capital Markets | Investment Management | Trading | Banking | Financial Services | Regulated Industries | AI Security & Governance

Financial services experience is valuable but not essential - exceptional engineers with strong customer-facing instincts and experience navigating complex enterprise environments will also be considered.

You’ll be joining at an early stage with significant ownership over both customer deployments and the evolution of the underlying AI platform.

This is a great opportunity for someone who wants to:

• Work on real production AI, not research exercises
• Have direct exposure to senior customers
• Work across AI, product and engineering
• Help shape how a Forward Deployed organisation scales