11 Commits

Author	SHA1	Message	Date
youkaichao	b15f0dbbbe	support scale_fmt=ue8m0 (#964) ... * support scale_fmt=ue8m0 * keep improving Signed-off-by: youkaichao <youkaichao@gmail.com> * keep improving Signed-off-by: youkaichao <youkaichao@gmail.com> * add clamp min of 1e-4 Signed-off-by: youkaichao <youkaichao@gmail.com> * rename config Signed-off-by: youkaichao <youkaichao@gmail.com> --------- Signed-off-by: youkaichao <youkaichao@gmail.com>	2025-08-27 15:30:21 +08:00
Xingkai Yu	4592be48c0	fp32 gate bias	2025-08-26 17:39:07 +08:00
huxuedan	d29a967601	modify the explanation of MLA	2025-02-26 17:07:39 +08:00
Xingkai Yu	1398800ebf	fix scores mask	2025-02-14 20:26:45 +08:00
Xingkai Yu	5ee97a83f0	fix comment	2025-02-07 16:42:55 +08:00
Xingkai Yu	87a01053e4	Merge pull request #556 from XxAlonexX/main ... Fix Linear Layer Bias Initialization	2025-02-05 16:23:02 +08:00
XxAlonexX	6a30b43249	Fix Linear Layer Bias Initialization	2025-02-04 10:38:45 +05:30
Roman Fitzjalen	2756e130c2	clarify assertion error	2025-01-28 13:16:54 +01:00
enoch kan	bc77f22afc	Updated model.py docstrings	2025-01-05 18:24:31 +00:00
GeeeekExplorer	fd011c11aa	torch rmsnorm	2025-01-05 14:33:48 +08:00
stack-heap-overflow	4c2fdb8f55	Release DeepSeek-V3	2024-12-26 19:01:57 +08:00