Add Birch-san's sub-quadratic attention implementation

This commit is contained in:
brkirch
2022-12-27 08:50:55 -05:00
parent 4af3ca5393
commit d782a95967
6 changed files with 312 additions and 35 deletions
+1 -1
View File
@@ -30,4 +30,4 @@ inflection
GitPython
torchsde
safetensors
psutil; sys_platform == 'darwin'
psutil