As someone who prefers to run my own local models, I’m excited to see rumblings about Apple working on making local inference scalable. Not everyone has 128GB+ of RAM sitting on a single machine to be able to run inference on larger models. But being able to easily cluster multiple machines together? This is SUPER COOL!