About Prophecy
About the role
MACHINE LEARNING RESEARCH ENGINEER San Francisco, CA • Hybrid • $250K-$350K 🚀 Join the Data Revolution at Prophecy About Prophecy Prophecy is revolutionizing enterprise data transformation with AI-native tools that turn data chaos into reliable insights. We're not just building software—we're reshaping how the world's leading companies work with data. Our AI agents collaborate seamlessly with humans through intuitive visual and document interfaces, empowering teams to analyze, transform, and prepare data at enterprise scale. 🌟 Don't miss the rocket ship—join Prophecy and build the next data revolution! 🌟 The Role As a Machine Learning Research Engineer, you'll push the boundaries of AI innovation while building production-ready solutions. This is a unique opportunity to work on cutting-edge ML research and see your work directly impact how enterprises worldwide leverage data. You'll have the freedom to explore new ideas while maintaining a builder's mentality to ship transformative features. What You'll Bring Advanced ML/LLM Expertise • Hands-on experience with fine-tuning techniques: SFT, DPO, RLHF • Model optimization through distillation, quantization, and pruning • Deep understanding of transformer architectures and LLM capabilities Full ML Lifecycle Mastery • End-to-end ML pipeline experience: data acquisition → training → production • Expertise with PyTorch and open-source transformers (HuggingFace) • Python fluency for dataset and model processing Production Engineering Skills • Backend development experience with pipelines and microservices • Cloud infrastructure expertise: AWS, Kubernetes • Proficiency in Java and Scala for scalable systems Builder Mentality • Proven track record of taking innovative ideas from research to production What Makes You Stand Out • ML/LLM work in code generation (Codex, text-to-SQL) or semantic extraction • Knowledge graphs expertise (Neo4j, Neptune) • Experience with big data engines like Apache Spark • Compiler development for SQL, Python, or Scala • ML model optimization for low-latency, high-throughput production use • Active contributions to open-source AI/ML projects (Hugging Face, PyTorch) • Retrieval systems or vector database expertise (Pinecone, Weaviate) • Strategic tech evaluation and build vs. buy decision-making skills Position Details Experience Level 3+ years in industry (Junior to Staff Level) Compensation $250,000 - $350,000 base salary Location San Francisco, California (Hybrid) Note: Compensation reflects base pay only. Total package includes equity and comprehensive benefits. Pay varies based on achievements, skills, experience, and location. Benefits & Perks We invest in our team's success and well-being: • 99% employee health insurance coverage, 75% for dependents • $200/month stipend for remote work, wellness, gym, and self-care • Flexible PTO to recharge when you need it • Professional development allowance for continuous learning • Company-sponsored Long Term Disability and Life Insurance • FSA/HSA, dental, vision, and comprehensive health benefits • Direct impact on an innovative, industry-leading platform • End-to-end ownership of transformative projects *Benefits and perks may vary by country
Responsibilities
Requirements
- Hands-on experience with fine-tuning techniques: SFT, DPO, RLHF
- Model optimization through distillation, quantization, and pruning
- Deep understanding of transformer architectures and LLM capabilities
- End-to-end ML pipeline experience: data acquisition → training → production
- Expertise with PyTorch and open-source transformers (HuggingFace)
- Python fluency for dataset and model processing
- Backend development experience with pipelines and microservices
- Cloud infrastructure expertise: AWS, Kubernetes
- Proficiency in Java and Scala for scalable systems
- Proven track record of taking innovative ideas from research to production
