Gemm/Kernel Class Template Overview
【免费下载链接】catlass本项目是CANN的算子模板库,提供NPU上高性能矩阵乘及其相关融合类算子模板样例。项目地址: https://gitcode.com/cann/catlass
API List
| Component | Description |
|---|---|
| basic_matmul | Basic matrix multiplication of the Common template |
| basic_matmul_tla_visitor | EVG GM workspace kernel entry point |
| basic_matmul_tla_ub_visitor | EVG UB workspace kernel entry point |
API Breakdown
The namespace isCatlass::Gemm::Kernel. The class template contains the following core members.
| Type | Name | Function |
|---|---|---|
| struct | Params | Input arguments used when invoking the device kernel function through<<<>>>. |
| struct | Arguments | Input arguments encapsulated prior to device execution |
| Static function | bool CanImplement | Argumentsvalidation interface |
| Static function | size_t GetWorkspaceSize | Calculates the required workspace size based onArguments |
| Static function | Params ToUnderlyingArguments | ConvertsArgumentsinto kernel arguments (Params) |
| Function | void operator()<AscendC::AIC> | InputsParamsand executes MMAD computations on the AIC |
| Function | void operator()<AscendC::AIV> | InputsParamsand executes calculation on the AIV, such as prologue and epilogue |
【免费下载链接】catlass本项目是CANN的算子模板库,提供NPU上高性能矩阵乘及其相关融合类算子模板样例。项目地址: https://gitcode.com/cann/catlass
创作声明:本文部分内容由AI辅助生成(AIGC),仅供参考