You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Long-range interaction masking: In mask from torch.nn.transformerencoder set attn_mask to -inf. Currently, not working because together with src_padding_mask it returns NaNs in the global embedding
Description of feature
maskfromtorch.nn.transformerencodersetattn_maskto-inf. Currently, not working because together withsrc_padding_maskit returns NaNs in the global embedding