Founding Generative AI Engineer

Altimate Inc.; Sunnyvale (CA); On-site; USD 135,000 - 210,000; Full time

Job summary

A leading company in AI is seeking a Founding Generative AI Engineer to innovate and implement advanced AI systems. This role offers the chance to work at the forefront of AI technology, developing solutions that drive automation in enterprise data operations.

Benefits

Competitive salary and equity

Access to cutting-edge AI infrastructure

Team offsite events

Learning budget for AI courses

Qualifications

• 7+ years of hands-on ML/AI experience.
• Experience in GenAI/LLM projects.
• Track record in deploying ML/AI systems.

Responsibilities

• Design intelligent agent architectures.
• Implement sophisticated RAG pipelines.
• Collaborate with cross-functional teams.

Skills

Python

ML stack (Hugging Face, NumPy, Pandas, scikit-learn)

Production deployment of AI systems

Prompt engineering

Tools

PyTorch

TensorFlow

FastAPI

Job description

Join to apply for the Founding Generative AI Engineer role at Altimate AI

Join to apply for the Founding Generative AI Engineer role at Altimate AI

Mission

Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative AI-driven solutions that automate and accelerate a wide range of data tasks. Our flagship product, DataPilot, offers advanced data automation capabilities, while our new DataMates technology brings the concept of agentic AI to data operations, acting as virtual teammates for data professionals. Our solutions seamlessly fit into existing tools like VSCode, Git, and Slack, performing tasks ranging from data documentation to performance optimization.

Who are we?

Mission

Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative AI-driven solutions that automate and accelerate a wide range of data tasks. Our flagship product, DataPilot, offers advanced data automation capabilities, while our new DataMates technology brings the concept of agentic AI to data operations, acting as virtual teammates for data professionals. Our solutions seamlessly fit into existing tools like VSCode, Git, and Slack, performing tasks ranging from data documentation to performance optimization.

By leveraging a proprietary framework that combines multiple language models and a custom-built knowledge graph, we enable contextually aware AI agents that integrate seamlessly into existing workflows. Our solutions, including ambient AI for continuous monitoring and optimization, are designed to meet the growing demands of data operations, business intelligence, and analytics in an era of ever-increasing data volumes. Used by thousands of users across the world, and backed by prominent investors, we're positioned at the forefront of the AI-powered data engineering revolution. You can read more about us in a recently published venture beat article.

Team

As a team, we are Silicon Valley veterans who previously created category-defining data and AI products loved by thousands of companies worldwide. We have experienced the journey of a small startup to IPO very closely. We have started on a similar journey again and are backed by prominent advisors and VC firms with multi-billion dollar portfolios.

What are we looking for?

We're in search of a Senior Generative AI Engineer who brings deep expertise in building and deploying large language models and AI systems at scale. This role is for those with extensive experience in developing production-grade AI solutions, particularly in the realm of generative AI and language models. The ideal candidate will play a crucial role in advancing our AI capabilities, designing intelligent agent architectures, and implementing sophisticated RAG pipelines that power our products used by thousands of data teams worldwide.

Professional Experience:

• 7+ years of hands-on ML/AI experience with at least 1 year of hands-on experience in GenAI/LLM projects
• Track record of successfully deploying ML/AI systems in production environments
• Experience working with enterprise customers and understanding their unique requirements
  
  

Technical Skills Required:

• Strong programming skills in Python, including expertise in ML stack (Hugging Face, NumPy, Pandas, scikit-learn)
• Production experience with deep learning frameworks (PyTorch/Tensorflow) and transformer architectures
• API development expertise (FastAPI) and production deployment experience
• Proven experience with prompt engineering best practices and LLM evaluation metrics
  
  

Technical Skills Preferred:

Infrastructure & Deployment

• Experience with vector databases (e.g., Pinecone, Weaviate) and RAG pipelines
• Experience with observability and monitoring of LLM applications
• Proficiency in model compression, distillation, and deployment at scale
  
  

Model Development & LLMs

• Expertise in semantic search and embedding models
• Experience in LLM frameworks (LangChain, LlamaIndex) and agentic AI systems
• Advanced model fine-tuning techniques, including LoRA, Prompt Tuning, and Adapter Training
  
  

Why you should join Altimate AI?

Projects You'll Work On:

• Advanced AI Agent Architecture: Design and implement sophisticated multi-agent systems that can understand context, make decisions, and enable seamless collaboration between AI and human data professionals.
• Large-Scale RAG Systems: Build and optimize retrieval-augmented generation pipelines that can efficiently process and utilize enterprise-scale knowledge bases.
• Model Optimization & Deployment: Implement advanced techniques (LoRA, Prompt Tuning) to adapt off-the-shelf models for specific enterprise data tasks, ensuring faster, more accurate performance.
• Scalable AI Infrastructure: Develop and optimize cloud-native architectures (AWS, Kubernetes) for large-scale training, inference, and multi-agent orchestration.
• Enterprise Security & Compliance: Implement robust security measures for LLM applications, including data anonymization, prompt injection prevention, and compliance with enterprise security standards.
  
  

Impact:

• Innovation Leadership: Shape the future of enterprise AI by developing novel approaches to autonomous data operations and AI-driven automation.
• Product Development: Direct influence on our flagship products, DataPilot and DataMates, working on cutting-edge features that define the next generation of AI-powered data tools.
• Team Growth: Help build and mentor a growing team of AI engineers, shaping our technical culture and practices.
• Open Source Contribution: Lead and contribute to our open-source initiatives, establishing yourself as a thought leader in the AI community.
• Technical Growth: Opportunity to work with the latest advancements in AI technology and shape the architecture of next-generation AI systems.
  
  

What We Offer

• Competitive salary and equity
• Base Salary Range: $135,000 - $210,000 [influenced by your expertise, how the interview goes, and how well you match the role]
• Equity: 0.05% - 0.4%
• Access to cutting-edge AI infrastructure and resources
• Team offsite and opportunities to attend and present at leading industry conferences (across the world)
• Learning budget for AI courses, books, and computing resources
• Dynamic and intellectually stimulating work environment with a team of talented engineers
• Opportunities to shape the direction of the company and leave a lasting impact
  
  

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Altimate AI by 2x

Get notified about new Generative AI Engineer jobs in Sunnyvale, CA.

Software Engineer, Early Career 2025 Start

Software Engineer, AI Platform - New Grad

Software Engineer I (Full Time) United States

San Jose, CA $98,600.00-$125,900.00 2 weeks ago

New Grads 2025 - Software Engineer, Algorithm

San Jose, CA $120,000.00-$165,000.00 8 months ago

Sunnyvale, CA $56.25-$173,000.00 3 weeks ago

New Grads 2025 - General Software Engineer

San Jose, CA $120,000.00-$165,000.00 3 months ago

Software Engineer - Fullstack, Mountain View

Software Engineer 4 - TV & Web Player Platform

Full Stack Software Engineer (L4), Product Localization Engineering

Software Engineer I (Intern) United States

San Jose, CA $44,000.00-$130,000.00 1 week ago

Full Stack Software Engineer - Post-training

Palo Alto, CA $180,000.00-$440,000.00 2 weeks ago

Software Engineer - Intern (Summer 2025)

San Jose, CA $3,000.00-$4,000.00 7 months ago

Santa Clara, CA $150,000.00-$175,000.00 6 months ago

Software Engineer III, Full Stack, Chrome

San Jose, CA $113,500.00-$250,000.00 1 week ago

Menlo Park, CA $56.25-$173,000.00 7 hours ago

Software Engineer(s) - New Grad (Fall 2025 Graduation)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.