Machine Learning Research Engineer

Prophecy

Palo Alto (CA)

Hybrid

USD 250,000 - 350,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Health insurance

Remote stipend

Flexible PTO

Professional development

Long-term disability

Life insurance

Dental & vision

Equity benefits

Job summary

Prophecy is seeking a Machine Learning Research Engineer in San Francisco, CA. This hybrid role focuses on pushing AI innovations and delivering production-ready ML systems that transform enterprise data workflows.

You will work on cutting-edge ML research, spanning transformers, LLMs, and advanced optimization techniques, with direct impact on customers worldwide.

Qualifications

Hands-on experience with fine-tuning techniques (SFT, DPO, RLHF).
Model optimization via distillation, quantization, and pruning.
Deep understanding of transformer architectures and LLM capabilities.
End-to-end ML pipeline experience; data acquisition to production.
Proficiency with PyTorch and open-source transformers (HuggingFace).
Python fluency for dataset and model processing.

Responsibilities

Push AI innovation while building production-ready solutions.
Work on cutting-edge ML research with enterprise impact.
Translate research ideas into deployable features.
Collaborate with cross-functional teams to ship features.

Skills

Fine-tuning

Distillation

Quantization

Pruning

Transformers

LLMs

Tools

PyTorch

HuggingFace

AWS

Kubernetes

Python

Java

Scala

Spark

Neo4j

Weaviate

Pinecone

SQL

Job description

MACHINE LEARNING RESEARCH ENGINEER

San Francisco, CA Hybrid $250K-$350K

Join the Data Revolution at Prophecy

About Prophecy

Prophecy is revolutionizing enterprise data transformation with AI-native tools that turn data chaos into reliable insights. We're not just building software—we're reshaping how the world's leading companies work with data. Our AI agents collaborate seamlessly with humans through intuitive visual and document interfaces, empowering teams to analyze, transform, and prepare data at enterprise scale.

Don't miss the rocket ship—join Prophecy and build the next data revolution!

The Role

As a Machine Learning Research Engineer, you'll push the boundaries of AI innovation while building production-ready solutions. This is a unique opportunity to work on cutting-edge ML research and see your work directly impact how enterprises worldwide leverage data. You'll have the freedom to explore new ideas while maintaining a builder's mentality to ship transformative features.

What You'll Bring

Hands-on experience with fine-tuning techniques: SFT, DPO, RLHF
Model optimization through distillation, quantization, and pruning
Deep understanding of transformer architectures and LLM capabilities

Full ML Lifecycle Mastery

End-to-end ML pipeline experience: data acquisition → training → production
Expertise with PyTorch and open-source transformers (HuggingFace)
Python fluency for dataset and model processing

Production Engineering Skills

Backend development experience with pipelines and microservices
Cloud infrastructure expertise: AWS, Kubernetes
Proficiency in Java and Scala for scalable systems

Builder Mentality

Proven track record of taking innovative ideas from research to production

What Makes You Stand Out

ML/LLM work in code generation (Codex, text-to-SQL) or semantic extraction
Knowledge graphs expertise (Neo4j, Neptune)
Experience with big data engines like Apache Spark
Compiler development for SQL, Python, or Scala
ML model optimization for low-latency, high-throughput production use
Active contributions to open-source AI/ML projects (Hugging Face, PyTorch)
Retrieval systems or vector database expertise (Pinecone, Weaviate)
Strategic tech evaluation and build vs. buy decision-making skills

Position Details

Experience Level: 3+ years in industry (Junior to Staff Level)
Compensation: $250,000 - $350,000 base salary
Location: San Francisco, California (Hybrid)
Note: Compensation reflects base pay only. Total package includes equity and comprehensive benefits. Pay varies based on achievements, skills, experience, and location.

Benefits & Perks