关于显存占用 #10
Ethereal-sakura
started this conversation in
General
关于显存占用
#10
Replies: 1 comment
-
|
信息不足，无法给出准确数据。什么工具，什么精度？你参考以下数据吧。 llama.cpp下Q6_K（GGUF格式），35.74 GiB（磁盘占用大小）：
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
作者您好，我想请教一下128K，64K上下文，需要的显存分别是多少？
Beta Was this translation helpful? Give feedback.
All reactions