Original Summary

Hey everyone! I’ve been building a tool that consumes a lot of AI tokens, and my API bill is getting pretty high. I’ve already tried using smaller models for simpler tasks and larger models for more complex ones. I’ve also implemented prompt caching and optimized my backend as much as possible. I’m fine with slower response times as long as the results are accurate, so speed isn’t a priority for me. I’ve also considered hosting a model from Hugging Face myself instead of relying on smaller API models, but the accuracy has been pretty disappointing. For those of you who’ve dealt with similar issues, what approaches have worked best for you to reduce AI costs without sacrificing accuracy? Is self-hosting a good option, or are there better alternatives I’m overlooking?   submitted by   /u/Internal_Client6752 [link]   [comments]

  • 情报分类：服务器与云资源
  • 分类依据：内容涉及服务器、云资源或网络线路
  • 信息来源：Reddit · SaaS
  • 发布时间：2026/10/16 20:57:00