- SignalDesk6 days ago
Original Summary
As part of a ML study group I've been building tools to experiment with ML concepts. I use AI Coding agents to develop software, mostly cloud-based but I keep trying local LLMs on 12G, 16G, and 24G VRAM GPUs. Freetoken has made it possible to run larger MoE models on smaller GPUs.<p>This inspired me to use my ML tools to build a tiny MoE model from scratch so I can experiment with different agent optimizations and things like Engram, recursive models, hierarchical modeles, KV Cache compression etc.<p>My link above shows results of building different tiny models, one dense, the rest MoE variants. There is a lot of code and tooling behind this.<p>Goals: - build tiny MoE models that run in a browser to give interactive help (today I use deterministic matchers to respond to user queries; still researching how to improve this with better trained MoE models). - build tiny MoE models that run on small ARM and RISC-V development boards, possibly using NPUs (using no_std Rust).<p>My tools are an alternative to Python, ML libraries, Jupyter notebooks, and Google Colab.<p>My approach is a REPL and/or AOT Compilable array-programming DSL written in Rust. This language has ML concepts as first class language elements and built in visualization primitives.<p>It runs in a browser via WASM. It runs at the CLI on both Apple and Linux (supporting Apple GPU and NVIDIA GPU libraries, Ollama-based REPL context-senstive help). It is extensible via dyamic plug-in Rust libraries.<p>I have created many demo repos showing how to use this ML array language for ML tasks, learning Math concepts, general purpose programming. You can build desktop apps, (Ruby on Rails inspired) CRUD apps. So you can create ML experiments and visualize data in the browser or on the desktop.<p>It also supports Emacs org-mode for literate programming.<p>This tiny MOE Microscope is just my latest demo of this approach. I hope it helps someone learn more about MoE experts, routing, Engram, etc. It helped me learn more.
中文概览
中文标题: Show HN:我做了一个微型 MoE/Engram 可视化工具
作者在 ML 学习小组中构建用于实验 ML 概念的工具,展示了一个微型 MoE/Engram 可视化工具;其工具是 Rust 编写的数组编程 DSL,可通过 WASM 在浏览器运行,也可在 CLI 运行,支持动态插件,目标包括浏览器交互帮助和小型 ARM/RISC-V 开发板上的微型 MoE 模型。
- 情报分类:开源项目与落地
- 分类依据:Show HN 个人 ML 工具与可视化项目,涉及微型 MoE 模型。
- 信息来源:Hacker News 新项目
- 发布时间:2026/9/14 09:59:28
- No replies yet