AI Product Engineer

Decode GR; United States; Remote; USD 77,000 - 122,000; Full time

Benefits offered by this job

Remote-first

Stock options

Generous PTO

Job summary

Decode GR is seeking a senior AI engineer to build AI-powered product features for tools that analyze complex legal documents.

You will work across retrieval-augmented generation, language models, and data workflows, guiding ideas from definition through deployment with product, legal, and engineering collaborators.

Qualifications

• Seven+ years in data science or AI engineering, with production AI/ML products.
• Strong grounding in AI/ML concepts and workflows.
• Experience with RAG, agentic workflows, vector DBs, prompts, and LLM integration.

Responsibilities

• Define and deliver AI features with cross-functional teams.
• Build and improve RAG pipelines, prompting, evaluation, and indexing.
• Prototype language-model features such as chat experiences and multilingual tools.
• Orchestrate data ingestion, model inference, and evaluation across AI workflows.
• Create evaluation and monitoring approaches for output quality, latency, and reliability.
• Lead features from scoping to shipping and iteration.

Skills

AI concepts

Production ML

Python

RAG pipelines

LangChain

Language models

Education

Master's or PhD in CS/AI

Tools

LangSmith

Vector databases

LLM integration

Job description

Role overview

Build AI-powered product features for tools that help people search, analyse, and draw insights from complex legal documents. You'll work across retrieval-augmented generation, language models, and data workflows, taking ideas from early definition through deployment and iteration with product, legal, and engineering collaborators.

Responsibilities

• Define and deliver AI features with product, legal, and engineering teams.
• Build and improve RAG pipelines, including prompting, evaluation, and vector indexing.
• Prototype language-model features such as chat experiences, legal reasoning workflows, and multilingual tools.
• Orchestrate data ingestion, model inference, and evaluation across AI workflows.
• Create evaluation and monitoring approaches for output quality, latency, and reliability.
• Take features through scoping, prototyping, shipping, monitoring, and iteration.

Requirements

• At least seven years of experience as a data scientist or AI engineer, including production AI or ML products.
• Strong grounding in AI and machine learning concepts.
• Practical experience with RAG, agentic workflows, vector databases, prompt and context engineering, and LLM integration.
• Python proficiency; familiarity with LangChain, LangSmith, a major cloud platform, or multimodal model frameworks.
• Experience processing and curating large text corpora and monitoring ML systems.
• Product focus and comfort working in an early-stage, ambiguous environment.

Nice to have

• Ability to contribute to APIs, data pipelines, or interfaces using Python, Node.js, React, or TypeScript.
• Familiarity with rule-based systems, knowledge representation, formal logic, or workflow automation tools.
• A master's or doctoral degree in computer science, AI, or a related field.

Benefits and work setup

• Remote-first, with flexibility to work from anywhere in Greece.
• Generous paid time off and stock options.