pull down to refresh
https://research.google/blog/turboquant-redefining-ai-efficiency-with-extreme-compression/
I'm sure it's deeper than that? Though this blog post is surprisingly fluffy. Maybe the blog post is written for the marketing people at google.
reply
Wait, Google's TurboQuant main way to save memory is by switching from Cartesian to polar coordinates to represent the vectors?!