Original Summary

You know that moment when Codex spends 20 minutes working on something, tells you everything is done, and then you open the code and realize half the task is still missing? Yeah. That got old pretty fast. I kept running into the same problem. The agent would finish something , but not necessarily what I actually asked for. And I'd end up checking everything myself or typing "continue" over and over. So I started building a tool called Truth Firewall. The idea is pretty simple: instead of trusting the agent when it says it's finished, check the actual result against a set of requirements. If something doesn't pass, the tool rejects the "done" and gives Codex another attempt. It's open source, and I finally got it published on PyPI. pipx install truth-firewall https://github.com/aldi949/truth-firewall It's still early. Right now the working Codex integration is for Windows and Python tasks, and you have to define what needs to be checked. I've also found cases where the verifier itself gets fooled because the checks don't cover the whole task. I'm trying to figure out how far I can push that without making the tool uselessly strict. Anyway, I'm looking for people who actually use coding agents and wouldn't mind trying to break it. And I'm curious — how do you guys deal with agents claiming they've finished something when they clearly haven't?   submitted by   /u/aldi949 [link]   [comments]

  • 情报分类：商业与市场研究
  • 分类依据：内容涉及商业、投资或市场动态
  • 信息来源：Reddit · SideProject
  • 发布时间：2026/10/19 15:57:31