Original Summary

Sandboxed, OpenAI-compatible LLM server for GGUF models: drop in a model → get a ChatGPT-style API → the model runs in a padded cell. llama.cpp engine · continuous batching + prompt cache (faster than llama-server under load) · namespace/Landlock/seccomp sandbox · hashed API keys · TLS/mTLS · Prometheus metrics · signed static binaries & Docker

  • 情报分类：商业与市场研究
  • 分类依据：内容涉及商业、投资或市场动态
  • 信息来源：GitHub · AI 新项目
  • 发布时间：2026/10/19 04:12:57