13 points | by liventruth 2 days ago ago
1 comments
This should be trivially demonstrable if it actually works. Cosine similarity is not a good metric, however, for attention compression.
This should be trivially demonstrable if it actually works. Cosine similarity is not a good metric, however, for attention compression.