The Sound of Sucking into the Cloud
You’re led to believe you’re talking to a little guy in the computer; in fact, as with most computer and smartphone interactions these days, you’re also filing text into a searchable database. Add in the rise of AI-powered meeting transcription and social surveillance, and the range of materials generated in the course of a regular computer-job workday will soon be breathtaking.
Even when you know not to, it’s too easy to accidentally slip and send private data to your agents.
Claude Code has, on multiple occasions, read private keys that it wasn’t supposed to, and I’ve had to rotate them because of the exposure. And with features like GPT’s Computer History (horrible name BTW), it’s even easier to just dump more of your private data into the cloud. Frontier models have known to be relentless in the pursuit of their goals, and guardrails to tell them not to read your home dir or private files doesn’t seem like much use in blocking them.
I think the way forward is to either run only local models or setup a separate workstation just to run remote models/agents. Without some sort of isolation, the agents can just easily suck up all the data they see.