Instinct gained credit card access for 40% of users in 3 weeks; founder admits early version had no firewall.

Beating AI News Flash: Instinct founder Noah Shinn disclosed that about 40% of users, after using the product for 3 weeks, will allow Instinct to use their credit cards, letting the Agent autonomously complete purchases. They also use "how long it takes to first obtain a credit card, account password, or other sensitive information" as a metric for measuring user trust.

Once a user connects at least one piece of sensitive information to Instinct, the retention rate is about 80%. Shinn said users typically need several weeks to gradually build trust, and Instinct will not ask users to hand over all permissions from the start; data already shared can also be revoked at any time.

But Shinn also admitted that early versions of Instinct did not have the firewalls and proactive monitoring it has now, and some errors did occur. Later, the company rebuilt a security system rather than just patching a single issue. Now all text, images, and other content prepared for the Agent to process must first pass through an independent "firewall" check; the actions the Agent is about to execute and part of its reasoning process are also monitored by another system, which can pause or intercept them before actual execution.

A user previously discovered that Instinct suddenly began processing a financial document they had never uploaded. Shinn later responded that this was actually a hallucination caused by the model fabricating information and then continuing to fabricate an explanation, and that no user data leak occurred. Instinct subsequently launched an independent hallucination detection system to check and intercept anomalies before the Agent continues reasoning or calls tools.