header-langage
简体中文
繁體中文
English
Tiếng Việt
한국어
日本語
ภาษาไทย
Türkçe
Scan to Download the APP

Has the iPhone version of Doubao Mobile Assistant appeared? Developer demonstrates operating an iPhone with Opus 5.5.

Beating AI News Flash: Developer Finn Voorhees demonstrated an AI Agent that can directly operate an iPhone. He simply sent one sentence, asking the Agent to check the cheapest Ryanair flight to London for the next day. The Agent then opened Ryanair on its own, filled in the destination, selected the date, queried the fare, and finally returned to the chat interface to report the result. No computer was involved throughout the process.


This Agent runs in PiChat, an iPhone chat app developed by Finn. Under the hood, it uses his previously open-sourced PiDurableKit to run the Pi Agent on the phone through Apple's JavaScriptCore, handling model calls, tool execution, and task management. The video uses Claude Opus 5.5, and model inference still takes place in the cloud. To allow the Agent to continue working after switching to other apps, PiChat also uses Apple's background task mechanism and saves execution progress via SQLite, making it easy to resume after interruption.


The most critical cross-app control code has not yet been made public. In the video, when iPhone Control is enabled, the system requires entering the lock screen passcode to enable XCTest UI automation. XCTest is Apple's interface testing framework, capable of simulating taps, swipes, and text input. The open-source project TouchSynthesis uses XCTest's private interfaces to let the iPhone generate touch events on its own, without the need for real-time computer control. However, Finn has not yet confirmed whether this solution was used.

举报 Correction/Report
Correction/Report
Submit
Add Library
Visible to myself only
Public
Save
Choose Library
Add Library
Cancel
Finish