Original Summary

I wanted to know why E2E tests in public projects keep changing. Reading thousands of diffs by hand wasn't realistic (and boring), so I built HekaJev. You point it at a Git repo and write your questions and categories in a small YAML file. It filters commits, sends the relevant commit messages and diffs to Jev, and saves the answers, uncertain cases. In the end, you get files with stats and a report. The questions don't have to be about testing. You can ask something completely different about your own Git history. In my case it was two questions: Does this commit actually change E2E tests or the setup they need? Yes / No / Uncertain. Why did they change? New coverage / Product change / Flaky-test fix / Environment & tooling / Refactoring / Bug in the test. More than one reason can apply. The real questions and category descriptions are a bit more specific for Jev. I shortened them here to make the idea easier to follow here. You can check out original wording in the repo. So, I wanted to see for myself the kind of numbers I'd seen in reports about E2E test maintenance. So I screened 549,224 commits across 21 public projects, including such well known projects as n8n, Supabase, Material UI, Storybook and Apache Superset, etc. HekaJev filtered those commits by path and sent 20,026 candidates to Jev. It identified 16,024 E2E-related changes with the first question. The main run cost an estimated $23.20 in API calls. It is low, and surprises me, considering Jev saw commit messages, changed paths and as well as diffs, not just titles+description. Cool tech! HekaJev is free and MIT-licensed. Running an analysis requires a TypeSafe API key, and API usage has a cost, but they give ~$5 after sign up. It also sends the selected commit content to TypeSafe, which matters if you're analyzing a private repo. The project: https://github.com/zurk/hekajev The README also links to the E2E report and data if you're interested in what came out of that first run. What would you ask your own Git history?   submitted by   /u/_s0uthpaw_ [link]   [comments]

  • 情报分类：商业与市场研究
  • 分类依据：内容涉及商业、投资或市场动态
  • 信息来源：Reddit · SideProject
  • 发布时间：2026/9/26 14:57:17