mmjy's recent timeline updates mmjy's recent timeline updates ONLINE |
mmjyPer Aspera Ad Astra V2EX member #638389, joined on 2023-07-13 13:20:17 +08:00 |
mmjy's recent replies
Dec 2, 2024 Replied to a topic by fid › Local LLM › 8x4090 离线部署 Qwen2.5 求助 |
vllm 文档是有量化实验特性支持的，可以试试好不好用： https://docs.vllm.ai/en/latest/quantization/auto_awq.html
Select Language