Original Summary

Honestly got sick of shipping every little yes/no decision off to the cloud. Felt ridiculous. Full LLMs for that? Come on. So I threw together jevos. You dump some text and a yes/no question at it, it does one forward pass and spits back the probability of yes. No fancy text generation, just the answer. Runs on a regular laptop CPU. On mine I’m hitting around 54ms a pop. Context is 8k. And it talks the same API format as Jev for yes/no stuff, so if you’ve already got something hooked up to Jev you can just point it here instead. Ran it against 2000 yes/no questions about rules it had never seen: Jev hit 0.927 jevos 0.815 Laya 0.489 Open source, free, runs locally. Repo’s here if you wanna play with it or roast it: https://github.com/feder-cr/jev Curious what y’all think. Especially if you’ve been hunting for something local for this kinda thing.   submitted by   /u/Money-Quarter-4833 [link]   [comments]

  • 情报分类：商业与市场研究
  • 分类依据：内容涉及商业、投资或市场动态
  • 信息来源：Reddit · SideProject
  • 发布时间：2026/9/30 21:25:38