A small AI lab with Caltech roots has ported its compact language models onto smart glasses running Qualcomm silicon. PrismML, advised by UC Berkeley’s Ion Stoica, says the work shows capable AI can live on the frame instead of a data center.

Qualcomm used its Snapdragon Summit stage on Wednesday to demonstrate the model, branded Bonsai, answering queries on eyewear built around the AR1 Gen 1 platform. A 1-bit design is unusually aggressive compression, trading numerical precision for speed and memory savings.

Two billion parameters, tuned for both images and text, let a wearer ask about whatever is in front of them and hear a reply with no noticeable pause. PrismML says the trick is a fourfold reduction in model size with almost no loss on standard benchmarks.

What PrismML is selling is a different bargain: an open-weight model that lives on the device, so the wearer is not asked to take a proprietary lab’s word on privacy, and not asked to fund that lab’s growing appetite for compute. Running a vision model on the frame means a question about the world never has to leave the glasses for a cloud round trip.

As yet, no pair of glasses carrying PrismML’s model has gone on sale, so the demonstration is a proof point for the platform rather than a shipping product. It lands as Qualcomm markets on-body AI across phones, earbuds and eyewear, and as the big frame makers decide how much work belongs on the glasses themselves rather than in a cloud.

Source: TechCrunch