Generative AI Engineer

DeepRec.ai; Boston (MA); On-site; USD 180,000 - 250,000; Full time

Job summary

DeepRec.ai is seeking a hands-on AI Engineer to own the build and deployment of internal AI capabilities for a private equity-backed firm in Boston. This is a builder role, not strategy or management, reporting directly to senior leadership and partnering with portfolio teams to automate repetitive work.

You will design, develop and deploy production-grade AI agents, integrate LLMs with internal systems, and implement robust retrieval/knowledge systems (RAG) to improve research, data collection,

Qualifications

• Strong Python experience and production-grade software skills.
• Experience building AI-powered production apps using LLMs.
• Experience building AI agents and multi-step workflows.
• Knowledge of RAG, embeddings, and semantic search.
• Cloud infrastructure (AWS/Azure/GCP) and Docker experience.
• Builder mentality with ability to ship prototypes.
• Comfort operating with autonomy and ambiguity.
• Strong communication to explain technical concepts to leaders.

Responsibilities

• Work directly with senior leadership on bottlenecks and repetitive processes.
• Translate business problems into clearly defined technical solutions.
• Design, build and deploy production-grade AI agents and applications.
• Build agentic workflows involving reasoning, retrieval, data processing and interaction with internal systems.
• Integrate LLMs with existing applications, documents, databases and third-party platforms.
• Build retrieval/knowledge systems (RAG) for internal company information.
• Implement evaluation, monitoring and observability for AI systems in production.
• Design human-in-the-loop processes where full automation isn't appropriate.
• Establish controls around data access, permissions and sensitive information.
• Measure impact - time saved, adoption, productivity gains.

Skills

Python

Production AI

AI agents

RAG / embeddings

Cloud infra

Docker

Autonomy

Communication

Tools

LangGraph

LangChain

LlamaIndex

Job description

Approximately $180,000 base + performance-based bonus (~$250,000 target total cash comp)

About the Firm

Our client is a leading private equity firm with a strong track record of building and scaling high-quality businesses. The firm combines investment expertise with hands-on operational experience, and is now looking at how AI can transform the way its own teams operate and create value across the business.

The Opportunity

We're looking for a highly hands-on AI Engineer to take ownership of building and deploying internal AI capability. This is not a strategy, advisory, or people-management role - it's a builder role.

You’ll work directly with senior leadership and employees across the firm to understand how work is currently performed, identify opportunities for automation, and build AI agents and applications that remove repetitive work. An example: understanding how an investment associate monitors portfolio companies, then building an AI-powered system to automate the research, data collection, analysis and reporting involved.

Initially your focus will be the firm's management company and a small, close-knit team. Longer term, there's significant potential to expand AI capabilities across the firm's portfolio companies - for someone who delivers, there's no predefined ceiling on this role.

What You'll Do

• Work directly with senior leadership on bottlenecks and repetitive processes
• Translate business problems into clearly defined technical solutions
• Design, build and deploy production-grade AI agents and applications
• Build agentic workflows involving reasoning, retrieval, data processing and interaction with internal systems
• Integrate LLMs with existing applications, documents, databases and third-party platforms
• Build retrieval/knowledge systems (RAG) for internal company information
• Implement evaluation, monitoring and observability for AI systems in production
• Design human-in-the-loop processes where full automation isn't appropriate
• Establish controls around data access, permissions and sensitive information
• Measure impact - time saved, adoption, productivity gains

What We're Looking For

• Strong software engineering skills, ideally with significant Python experience
• Experience building production applications using LLMs (OpenAI, Anthropic, or similar)
• Experience building AI agents and multi-step agentic workflows
• RAG, embeddings, semantic search, vector databases
• Cloud infrastructure (AWS/Azure/GCP) and containerization (Docker)
• A builder mentality: you'd rather ship a working prototype than write a deck about what could be built
• Comfort operating with significant autonomy and ambiguity
• Strong communication - able to explain technical concepts to non-technical senior stakeholders

Experience with LangGraph, LangChain, LlamaIndex or similar is useful, but we care more about your ability to design robust systems than any specific framework.

Why This Role

This is a rare opportunity to build an AI function from the ground up, with direct access to senior leadership and no legacy platform to inherit. The initial mandate is focused - deliver measurable value for the management company - but the trajectory is open-ended, with real potential to extend into the firm's wider portfolio!