请教 PRO 6000 96G 选择什么模型部署

V2EX = way to explore

V2EX 是一个关于分享和探索的地方

For Existing Member Sign In

This topic created in 148 days ago, the information mentioned may be changed or developed.

96G 显存下，选择哪个模型以及哪种量化效果比较好

2 replies • 2025-12-08 09:15:35 +08:00

egen

Dec 8, 2025

agent：gpt-oss-120B
其他：Qwen3 Next80B A3B FP8

565656

Dec 8, 2025

gpt 120 跑起来都还剩 20G