Senior Data Scientist

ZipRecruiter; Atlanta (GA); Remote; USD 120,000 - 150,000; Full time

Job summary

A fintech startup is seeking a Senior Data Scientist to lead the development of Generative AI pipelines. This remote position requires deep expertise in machine learning and experience with LLM applications. You'll design scalable solutions, collaborate with cross-functional teams, and drive innovation in a fast-paced environment. The role offers autonomy and the opportunity to make a meaningful impact while enjoying competitive compensation and benefits.

Benefits

Generous health coverage

Unlimited vacation days

Equity in startup

Qualifications

• 3+ years of experience developing and deploying machine learning pipelines in production.
• 1+ years of experience building Generative AI or LLM-based applications.
• Deep understanding of LLM evaluation and prompt engineering.

Responsibilities

• Design and architect end-to-end Generative AI pipelines.
• Integrate LLMs via APIs and custom orchestration.
• Develop robust methods to evaluate LLM outputs.

Skills

Machine Learning

Python

Generative AI

Problem-Solving

Cross-Functional Collaboration

Education

Master’s degree in Computer Science or related field

Tools

Databricks

MLflow

LangChain

Transformers

Job description

Job DescriptionJob Description

PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financial ecosystem. We are a boutique firm, where each person’s contributions and ideas are critical to the growth of the company.

This is a fully remote position, open to candidates anywhere in the U.S. with a reliable internet connection. While we gather in person a few times a year, this role is designed to remain remote long-term. You will have autonomy and flexibility in a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action. You'll collaborate with a high-performing team — including sales, marketers, and financial services experts — who stay connected through Slack, video calls, and regular team and company-wide meetings. We’re a team that knows how to work hard, have fun, and make a meaningful impact—both together and individually.

Job Summary

We are looking for a Senior Data Scientist to lead the development of scalable Generative AI pipelines that process raw data and generate context-aware results to power Plum’s AI-driven products. You will play a central role in shaping our GenAI platform, working across the full ML lifecycle—from ingestion and retrieval to , evaluation, and deployment.

This role combines deep expertise in machine learning with hands-on experience in building production-grade systems. You’ll collaborate closely with various cross functional teams and operate in a fast-paced environment where innovation, autonomy, and ownership are key.

Key Responsibilities

• Design and architect end-to-end Generative AI pipelines using LLMs to process and generate context-aware results.
• Integrate open-source and proprietary LLMs (e.g., GPT, LLaMA) via APIs and custom orchestration.
• Build and optimize workflows using frameworks such as LangChain
• Design and implement RAG (Retrieval-Augmented ) architecture to inject relevant, contextual data into prompts.
• Develop robust methods to evaluate and compare LLM outputs based on relevance, personalization, and factual accuracy.
• Build automated and scalable LLM evaluation pipelines using embedding-based similarity, scoring metrics, and human-in-the-loop feedback.
• Implement monitoring, observability, and logging for GenAI workflows to ensure reliability in production.
• Collaborate with cross-functional teams to integrate generative outputs into client-facing applications.

Requirements

• Master’s degree in Computer Science, Engineering, Physics, or a related technical field or equivalent work experience.
• 3+ years of experience developing and deploying machine learning pipelines in production.
• 1+ years of experience building Generative AI or LLM-based applications.
• Strong programming skills in Python, with hands-on experience in ML/AI frameworks (e.g., LangChain, Transformers, LLM APIs).
• Deep understanding of LLM evaluation, prompt engineering, and text quality metrics.
• Experience designing and implementing RAG architectures.
• Hands-on experience with Databricks, MLflow, or similar platforms.
• Experience with cloud infrastructure (AWS ) and MLOps practices for deploying and maintaining models in production.
• Strong problem-solving skills and ability to lead through ambiguity.
• Excellent communication and documentation habits.

Qualifications

• Prior experience using Generative AI in Fintech, Sales Tech, or Marketing Tech domains.
• Experience with agentic frameworks such as LangGraph, AutoGPT, or CrewAI.
• Familiarity with fine-tuning or custom instruction tuning of LLMs.
• Understanding of data privacy and compliance implications when working with client data and GenAI systems.

Benefits

Benefits and Compensation

• A fast-paced, collaborative startup culture with high visibility.
• Autonomy, flexibility, and a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action.
• Opportunity to make a meaningful impact in building a company and culture.
• Equity in a financial technology startup.
• Generous health, dental, and vision coverage for employees and family members + 401K.
• Eleven paid holidays and unlimited discretionary vacation days.
• Competitive compensation and bonus potential.