Skip to content

[KernelSwift算子优化] 程柯雷-Task01 engram_hash-571900729 - #188

Open
Lfan-ke wants to merge 2 commits into
DeepLink-org:mainfrom
Lfan-ke:ks-task01-engram-hash
Open

[KernelSwift算子优化] 程柯雷-Task01 engram_hash-571900729#188
Lfan-ke wants to merge 2 commits into
DeepLink-org:mainfrom
Lfan-ke:ks-task01-engram-hash

Conversation

@Lfan-ke

@Lfan-ke Lfan-ke commented Aug 31, 2026

Copy link
Copy Markdown

作品说明:沐曦 C500 上用 Clike 重写 KernelSwift 赛道二 Task01 engram_hash,文件内同时含与参考一致的 Model 与优化实现 ModelNewforward 内通过 python 调用自实现算子。

优化方案:把参考实现十几次 torch 算子启动折成一个融合 kernel,一个线程负责一整行 (layer, token),行内 16 个输出共用的前缀异或只在寄存器里推进一次,不落任何中间张量;另外把宿主侧编译提到 -O3load_inline 默认不注入任何 -O,pybind 胶水一直是 -O0)。

性能结果(MetaX C500 / MACA 3.7.0.38 / torch 2.8.0+metax3.7.0.7,官方 benchmarks/ks/auto_bench.py 默认参数,连跑三次,均 PASS accuracy):

赛题 v0(torch 参考) v1(本提交) Speedup
Task01 engram_hash 0.3591 / 0.3516 / 0.3453 ms 0.0412 / 0.0402 / 0.0409 ms 8.71× / 8.74× / 8.45×

本作品为原创。

@CLAassistant

CLAassistant commented Aug 31, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants