xinyun/DeepSeek-V3
1
0
Fork 0
mirror of https://git.datalinker.icu/deepseek-ai/DeepSeek-V3.git synced 2025-12-09 12:54:33 +08:00
Code Issues Packages Projects Releases Wiki Activity

Create model.py

Browse Source
This commit is contained in:
Janson Lau 2025-07-27 23:34:37 +08:00 committed by GitHub
parent b265f3795c
commit 292b8a34d8
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 10 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
inference/model.py Normal file
View File

@ -0,0 +1,10 @@
import math
from dataclasses import dataclass
from typing import Tuple, Optional, Literal
import torch
from torch import nn
import torch.nn.functional as F
import torch.distributed as dist
from kernel import act_quant, weight_dequant, fp8_gemm