[Bug]: turboquant accuracy and speed are bad than bf16

[zzz3bbb3]

Your current environment

H200 x1, ～45B moe model， vllm

🐛 Describe the bug

Accuracy with MBPP

Speed and Throughput

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.