Senior Data Scientist

Altimate Inc.; Sunnyvale (CA); On-site; USD 135,000 - 210,000; Full time

Job summary

A leading AI company in Sunnyvale seeks a Senior Data Scientist to advance their AI capabilities. The ideal candidate will have extensive experience in generative AI, building large language models, and deploying production-grade AI solutions. Join a dynamic team to shape the future of enterprise data operations with innovative AI-driven solutions.

Benefits

Competitive salary and equity

Access to cutting-edge AI infrastructure

Learning budget for AI courses

Team offsite opportunities

Qualifications

• 7+ years of hands-on ML/AI experience with GenAI/LLM projects.
• Track record of deploying ML/AI systems in production.

Responsibilities

• Design and implement advanced AI agent architectures.
• Build and optimize retrieval-augmented generation pipelines.
• Implement advanced model optimization techniques.

Skills

Python

Machine Learning

Deep Learning

API Development

Prompt Engineering

Tools

Hugging Face

NumPy

Pandas

scikit-learn

PyTorch

TensorFlow

FastAPI

Job description

Join to apply for the Senior Data Scientist role at Altimate AI

2 weeks ago Be among the first 25 applicants

Join to apply for the Senior Data Scientist role at Altimate AI

Mission

Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative AI-driven solutions that automate and accelerate a wide range of data tasks. Our flagship product, DataPilot, offers advanced data automation capabilities, while our new DataMates technology brings the concept of agentic AI to data operations, acting as virtual teammates for data professionals. Our solutions seamlessly fit into existing tools like VSCode, Git, and Slack, performing tasks ranging from data documentation to performance optimization.

Who are we?

Mission

Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative AI-driven solutions that automate and accelerate a wide range of data tasks. Our flagship product, DataPilot, offers advanced data automation capabilities, while our new DataMates technology brings the concept of agentic AI to data operations, acting as virtual teammates for data professionals. Our solutions seamlessly fit into existing tools like VSCode, Git, and Slack, performing tasks ranging from data documentation to performance optimization.

By leveraging a proprietary framework that combines multiple language models and a custom-built knowledge graph, we enable contextually aware AI agents that integrate seamlessly into existing workflows. Our solutions, including ambient AI for continuous monitoring and optimization, are designed to meet the growing demands of data operations, business intelligence, and analytics in an era of ever-increasing data volumes. Used by thousands of users across the world, and backed by prominent investors, we're positioned at the forefront of the AI-powered data engineering revolution. You can read more about us in a recently published venture beat article.

Team

As a team, we are Silicon Valley veterans who previously created category-defining data and AI products loved by thousands of companies worldwide. We have experienced the journey of a small startup to IPO very closely. We have started on a similar journey again and are backed by prominent advisors and VC firms with multi-billion dollar portfolios.

What are we looking for?

We're in search of a Senior Data Scientist who brings deep expertise in building and deploying large language models and AI systems at scale. This role is for those with extensive experience in developing production-grade AI solutions, particularly in the realm of generative AI and language models. The ideal candidate will play a crucial role in advancing our AI capabilities, designing intelligent agent architectures, and implementing sophisticated RAG pipelines that power our products used by thousands of data teams worldwide.

Professional Experience:

• 7+ years of hands-on ML/AI experience with at least 1 year of hands-on experience in GenAI/LLM projects
• Track record of successfully deploying ML/AI systems in production environments
• Experience working with enterprise customers and understanding their unique requirements
  
  

Technical Skills Required:

• Strong programming skills in Python, including expertise in ML stack (Hugging Face, NumPy, Pandas, scikit-learn)
• Production experience with deep learning frameworks (PyTorch/Tensorflow) and transformer architectures
• API development expertise (FastAPI) and production deployment experience
• Proven experience with prompt engineering best practices and LLM evaluation metrics
  
  

Technical Skills Preferred:

Infrastructure & Deployment

• Experience with vector databases (e.g., Pinecone, Weaviate) and RAG pipelines
• Experience with observability and monitoring of LLM applications
• Proficiency in model compression, distillation, and deployment at scale
  
  

Model Development & LLMs

• Expertise in semantic search and embedding models
• Experience in LLM frameworks (LangChain, LlamaIndex) and agentic AI systems
• Advanced model fine-tuning techniques, including LoRA, Prompt Tuning, and Adapter Training
  
  

Why you should join Altimate AI?

Projects You'll Work On:

• Advanced AI Agent Architecture: Design and implement sophisticated multi-agent systems that can understand context, make decisions, and enable seamless collaboration between AI and human data professionals.
• Large-Scale RAG Systems: Build and optimize retrieval-augmented generation pipelines that can efficiently process and utilize enterprise-scale knowledge bases.
• Model Optimization & Deployment: Implement advanced techniques (LoRA, Prompt Tuning) to adapt off-the-shelf models for specific enterprise data tasks, ensuring faster, more accurate performance.
• Scalable AI Infrastructure: Develop and optimize cloud-native architectures (AWS, Kubernetes) for large-scale training, inference, and multi-agent orchestration.
• Enterprise Security & Compliance: Implement robust security measures for LLM applications, including data anonymization, prompt injection prevention, and compliance with enterprise security standards.
  
  

Impact:

• Innovation Leadership: Shape the future of enterprise AI by developing novel approaches to autonomous data operations and AI-driven automation.
• Product Development: Direct influence on our flagship products, DataPilot and DataMates, working on cutting-edge features that define the next generation of AI-powered data tools.
• Team Growth: Help build and mentor a growing team of AI engineers, shaping our technical culture and practices.
• Open Source Contribution: Lead and contribute to our open-source initiatives, establishing yourself as a thought leader in the AI community.
• Technical Growth: Opportunity to work with the latest advancements in AI technology and shape the architecture of next-generation AI systems.
  
  

What We Offer

• Competitive salary and equity
• Base Salary Range: $135,000 - $210,000 [influenced by your expertise, how the interview goes, and how well you match the role]
• Equity: 0.05% - 0.4%
• Access to cutting-edge AI infrastructure and resources
• Team offsite and opportunities to attend and present at leading industry conferences (across the world)
• Learning budget for AI courses, books, and computing resources
• Dynamic and intellectually stimulating work environment with a team of talented engineers
• Opportunities to shape the direction of the company and leave a lasting impact
  
  

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Altimate AI by 2x

Sign in to set job alerts for “Senior Data Scientist” roles.

Software Engineer 4 - TV & Web Player Platform

Software Engineer, AI Platform - New Grad

Software Engineer I (Full Time) United States

San Jose, CA $98,600.00-$125,900.00 19 hours ago

Sunnyvale, CA $56.25-$173,000.00 1 week ago

New Grads 2025 - Software Engineer, Algorithm

San Jose, CA $120,000.00-$165,000.00 7 months ago

Full Stack Software Engineer - Post-training

Palo Alto, CA $180,000.00-$440,000.00 20 hours ago

Sunnyvale, CA $117,000.00-$234,000.00 1 week ago

eCommerce Full Stack Developer (React / Shopify) - On Site

New Grads 2025 - General Software Engineer

San Jose, CA $120,000.00-$165,000.00 3 months ago

San Jose, CA $113,400.00-$206,300.00 3 days ago

(General Hire) Software Engineer Graduate (Advertisement Team) - 2025 Start (BS/MS)

San Jose, CA $113,500.00-$250,000.00 1 week ago

Palo Alto, CA $140,000.00-$185,000.00 2 weeks ago

San Jose, CA $113,400.00-$206,300.00 1 week ago

San Jose, CA $113,400.00-$206,300.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.