1L Qwen3, d=3, 4h/1kv, hd=2, ff=2
ALiBi enables extreme compression: the 36-param leader uses ALiBi with slope log(10) for base-10 positional weighting, achieving 100% accuracy with a 2-layer decoder (d=5) in float64
,更多细节参见爱思助手下载最新版本
但是,奧爾代也指出,由於關稅普遍適用,有一件事是確定的:外國產品在美國的價格普遍會更高。
Water resistance: IP54 (splash resistant)