Coffee at Sightglass

Had a great chat with Josh Nguyen today. He’s working on RoverAI, doing super interesting work with local LLMs. I think more and more people and businesses will care about how much data we keep feeding model providers. I know I’m concerned about it, and I don’t think I’m alone. Beyond the privacy concern, having personal context available to models is a huge win too.

I don’t really want Claude to have all that data about me: how can I trust that they’re not using it to advertise to me or manipulate responses? Take them at their word?

I want to run my models locally where I control who gets to see my data, and it’s clear that the model is working for me rather than for a model provider.