AI Software Engineer

Rollstack; New York (NY); On-site; CAD 110,000 - 190,000; Full time

Benefits offered by this job

Remote-friendly workplace

Equity

Job summary

Rollstack is redefining how enterprises share data through slides and documents. As an AI Software Engineer, you will build core features that automate data sharing, collaborate across the stack, and optimize performance for rapid product delivery.

You will work with LangChain, RAG, and LlamaIndex to create scalable, production‑ready solutions. This role suits engineers who thrive on impact, autonomy, and fast-paced development.

Qualifications

• 3+ years of experience in machine learning and natural language processing, focusing on generative models.

Responsibilities

• Build AI‑Powered Features: develop first AI capabilities for our product.
• Utilize Existing Frameworks: leverage LangChain, RAG, LlamaIndex for scalable solutions.
• Enhance System Performance: improve reliability and speed to market.
• Collaborate with Designers and Engineers to boost adoption.
• Innovate with AI Technologies and best practices.

Skills

LangChain

RAG

LlamaIndex

Python

NLP

LLM Agents

Tools

Node.js

Prisma

Temporal

Kubernetes

OpenAI API

Sentry

Argo CD

Job description

At Rollstack, we are revolutionizing the way businesses share and communicate data and insights. Organizations worldwide rely on slide decks and documents to make informed decisions, whether for leadership, clients, or partners. Yet, preparing these materials often consumes countless hours. Rollstack fully automates that.

We help some of the world's leading organizations, from mid-sized to public companies like SoFi, Zillow, and Whirlpool, in automating their slide decks and documents. Headquartered in New York, we offer a remote-friendly workplace and are backed by Insight Partners and Y Combinator, the most successful startup incubator in the world that produced the likes of Airbnb, Twitch, Instacart, Dropbox, Reddit, DoorDash, Stripe, Coinbase, etc.

Our team operates with speed and focus to deliver outsized impacts for our customers. We approach every challenge with first principles, never assuming things have to be done a certain way. We are a diverse team that believes intelligence and kindness go hand in hand, welcoming individuals from all backgrounds. Our persistence and rapid execution define us as a category leader and a future generational company.

About The Role

As an AI Software Engineer at Rollstack, you’ll build core features that automate how companies share data through slides and documents. You’ll work across the stack on integrations, AI insights, and performance optimization. This role is ideal for engineers who thrive on impact, autonomy, and fast-paced product development.

As a LLM Engineer, you will

• Build AI‑Powered Features: Combine industry best practices with innovative thinking to develop our product's first AI capabilities.
• Utilize Existing Frameworks: Leverage libraries like LangChain, RAG, and LlamaIndex to create scalable, production‑ready solutions for data analysis and content generation.
• Enhance System Performance: Improve reliability and speed up time‑to‑market by optimizing software performance to meet customer needs.
• Collaborate with Teams: Work closely with designers and software engineers to boost user adoption and engagement.
• Innovate with AI Technologies: Pioneer best practices using cutting‑edge AI tools and techniques.

Tech Stack

• TypeScript + React frontend with Tailwind CSS and Shadcn/UI, using modern hooks for composable UI and fast iteration.
• Node.js backend with a sync engine using Prisma ORM and Temporal workflows, powering internal services.
• K8s platform on AWS, deployed with Argo CD for zero‑downtime releases and easy rollbacks.
• Logs in SigNoz, application tracing in Sentry, and product analytics in PostHog.
• Generative‑AI layer powered by OpenAI API, Gemini, LangChain, and Langfuse to deliver automated insights.
• Issue tracking with Linear.

Who We Are Looking For

• Experience with LLM Frameworks: Proficiency in current large language model frameworks like LangChain, Retrieval‑Augmented Generation (RAG), and LlamaIndex.
• Machine Learning and NLP Expertise: 3+ years of experience in machine learning and natural language processing, focusing on generative models.
• Strong Python Skills: Advanced programming skills in Python.
• LLM Agents Development (Bonus): Bonus points for experience in building LLM agents for data analysis and content generation.
• Production Experience with LLMs: Proven experience in researching, building, and fine‑tuning large language models in production environments.

Why Join Us

• We are backed by the best (Y Combinator, Insight Partners ...) and are redefining how individuals and teams, across industries and around the world, work smarter and faster.
• Work alongside an exceptional team of builders, including alumni from Amazon, Meta, Pinterest, Tesla, and AiFi.
• Be part of a fully remote, globally diverse workplace that values ownership, impact, and collaboration.
• Contribute to a product that users love and that truly sells itself.
• Once a year, the entire company gathers in a new city for a week of connection, collaboration, and fun. It’s a highlight of our year.
• Earn competitive compensation and meaningful equity in a fast-moving, high‑leverage startup where your work directly shapes the company’s trajectory.