Original Summary

I really want to find a way to get frontier-level intelligence on local hardware.<p>I think some really cool ways to get this have been done already like the technique of spreading an LLMs weights across a fast-enough SSD and then only serving up an expert at a time on the GPU&#x2F;SoC.<p>I have this idea to make a tool that lets people download several small open-weight models and they act like experts but are different very task specific models with a harness designed to keep track of their thoughts &amp; work to let normal hardware be able to get close to frontier (or just useful level intelligence).<p>Basically, I want to have a model that acts like a router or decision maker where you start your chat with initially (say a coding task for example) and it decides what model does the work next. If it needs to research it writes down in an .MD what it needs to find out, if it needs to write code, another model starts working but the other models memory &amp; work get saved to an .MD (or folder of .MDs) and lets you get real work done but completely locally.<p>This might already be done but its just an idea I had and I wanted to see what the smart people on the internet thought or how they would approach this. I might also just be able to ask AI.

  • 情报分类：硬件与数码
  • 分类依据：内容涉及硬件、数码产品或通信卡
  • 信息来源：Hacker News 新项目
  • 发布时间：2026/10/16 04:36:30