Original Summary

I've been experimenting with a way to let an iPhone control itself programmatically, and I just open-sourced the result. It's an iOS app that connects to the phone's own developer services and lets an LLM interact with other apps: screenshots, taps, swipes, typing, and launching apps. The interesting technical part is that it uses a loopback VPN to communicate with those services from the same device. Setup is a bit complicated: it requires Developer Mode, an initial pairing file generated with a Mac, and sideloading/building the app. It won't work as a normal App Store app. But once it's set up, everything runs directly on the iPhone. No Mac connected, no external hardware, no jailbreak. The agent itself uses a vision model to decide which action to take based on screenshots. Code: https://github.com/EliotAndres/iphone-use-app I'd be interested to hear what other iOS developers think of this approach, particularly whether there's a simpler way to access these services locally.   submitted by   /u/Paletton [link]   [comments]

  • 情报分类：硬件与数码
  • 分类依据：内容涉及硬件、数码产品或通信卡
  • 信息来源：Reddit · SideProject
  • 发布时间：2026/10/20 03:50:37