@sthalles
Hello, i saw there have the similar issue before, the problem is i haven't saw any torch.gather API to collect the negative terms crossing all gpu in loss function calculation.
So, is that means this repo does not support the multi-gpu yet ?
Any suggestion will be appreciated !!
@sthalles
Hello, i saw there have the similar issue before, the problem is i haven't saw any torch.gather API to collect the negative terms crossing all gpu in loss function calculation.
So, is that means this repo does not support the multi-gpu yet ?
Any suggestion will be appreciated !!