add all backends for moe benchmark#948

ybenvidia wants to merge 6 commits into

NVIDIA:mainNVIDIA/cloudai:mainfrom

ybenvidia:mainybenvidia/cloudai:mainCopy head branch name to clipboard