Sign President Meredith Whittaker warned Friday that agentic AI may include a threat to person privateness.
Talking on stage on the SXSW convention in Austin, Texas, the advocate for safe communications, referred to using AI brokers as “placing your mind in a jar,” and cautioned that this new paradigm of computing — the place AI performs duties on customers’ behalf — has a “profound situation” with each privateness and safety.
Whittaker defined how AI brokers are being marketed as a means so as to add worth to your life by dealing with varied on-line duties for the person. As an illustration, AI brokers would have the ability to tackle duties like trying up live shows, reserving tickets, scheduling the occasion in your calendar, and messaging your mates that it’s booked.
“So we are able to simply put our mind in a jar as a result of the factor is doing that and we don’t have to the touch it, proper?,” Whittaker mused.
Then she defined the kind of entry the AI agent would want to carry out these duties, together with entry to our internet browser and a method to drive it in addition to entry to our bank card info to pay for tickets, our calendar, and messaging app to ship the textual content to your mates.
“It could want to have the ability to drive that [process] throughout our complete system with one thing that appears like root permission, accessing each single a kind of databases — most likely within the clear, as a result of there’s no mannequin to try this encrypted,” Whittaker warned.
“And if we’re speaking a few sufficiently highly effective … AI mannequin that’s powering that, there’s no means that’s taking place on system,” she continued. “That’s virtually actually being despatched to a cloud server the place it’s being processed and despatched again. So there’s a profound situation with safety and privateness that’s haunting this hype round brokers, and that’s finally threatening to interrupt the blood-brain barrier between the appliance layer and the OS layer by conjoining all of those separate providers [and] muddying their knowledge,” Whittaker concluded.
If a messaging app like Sign have been to combine with AI brokers, it will undermine the privateness of your messages, she mentioned. The agent has to entry the app to textual content your mates and in addition pull knowledge again to summarize these texts.
Her feedback adopted remarks she made earlier through the panel on how the AI trade had been constructed on a surveillance mannequin with mass knowledge assortment. She mentioned that the “larger is best AI paradigm” — which means the extra knowledge, the higher — had potential penalties that she didn’t assume have been good.
With agentic AI, Whittaker warned we’d additional undermine privateness and safety within the identify of a “magic genie bot that’s going to deal with the exigencies of life,” she concluded.
About The Author
