AI Engineer

AllyNd Partners; Chicago (IL); Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Annual learning stipend

Flexible hours

Comprehensive health benefits

GPU compute access

Job summary

An innovative SaaS company in Chicago is looking for an experienced AI Engineer specializing in LLMs to develop next-generation legal intelligence tools. The candidate will fine-tune models, design RAG pipelines, and evaluate AI features in a fast-paced startup environment. Strong experience in machine learning, NLP, Python, and tools like PyTorch is essential. The position offers a fully remote setup with flexible hours and comprehensive health benefits.

Qualifications

• 7+ years in ML/AI engineering roles with a focus on NLP or LLMs.
• Strong experience with model fine-tuning and RAG architectures.
• Proficiency in Python and deep learning frameworks.

Responsibilities

• Fine-tune and deploy LLMs for legal document analysis.
• Design and implement Retrieval-Augmented Generation (RAG) pipelines.
• Optimize inference workflows for latency and accuracy.

Skills

Model fine-tuning

NLP experience

Python proficiency

Deep learning frameworks

Deployment experience

Tools

PyTorch

JAX

Hugging Face

Pinecone

Weaviate

FAISS

Job description

AllyNds client is a GenAI-first SaaS company revolutionizing how legal teams interact with contracts. Their platform leverages proprietary datasets and fine-tuned language models to extract, summarize, and analyze millions of documents in seconds offering predictive insights and compliance alerts to Fortune 1000 legal teams. The company has secured institutional seed funding and is scaling its AI capabilities with high-value pilot customers.

Job Description

We’re hiring an experienced AI Engineer with deep LLM experience to build the next generation of legal intelligence tools. You’ll fine-tune models, design RAG pipelines, and build robust evaluation systems all while shaping product direction in a fast-moving startup.

Responsibilities

• Fine-tune and deploy LLMs (e.g., LLaMA, Mistral, Claude) for legal document analysis
• Design and implement Retrieval-Augmented Generation (RAG) pipelines for clause-based Q&A
• Optimize inference workflows for latency, accuracy, and cost-efficiency
• Develop tools for prompt engineering, testing, and prompt versioning
• Collaborate with product and legal SMEs to shape AI features and interfaces
• Evaluate model performance using relevance, accuracy, and hallucination metrics

Required Skills

• 7+ years in ML/AI engineering roles, with a focus on NLP or LLMs
• Strong experience with model fine‑tuning, RAG architectures, and transformer-based models
• Proficiency in Python and deep learning frameworks (PyTorch, JAX, Hugging Face)
• Familiarity with vector databases (Pinecone, Weaviate, FAISS)
• Experience deploying LLMs in production with LLMOps or MLOps stacks

Preferred Skills

• Background in legal tech, document automation, or compliance tools
• Experience with LangChain, LlamaIndex, and prompt chaining frameworks
• Understanding of AI ethics and hallucination mitigation strategies
• Fully remote setup with flexible hours
• Annual learning stipend + GPU compute access
• Comprehensive health benefits and wellness perks

Applicants must be authorized to work in the U.S. We cannot sponsor visas now or in the future.