Question about formula 7

[Rachel-Yeah-Lee]

Hi, thanks for sharing the great job!
I am confused with formula 7 in section 3.6. In the previous section Ui Uj is produced by E1, but in formular 7 is produced by E2?
If so, what is the different between the first and the second item?
look for your instruction, thank you!

[yeonsw]

Hi,

Ui and Uj in sections 3.5 and 3.6 are different. In section 3.5, Ui and Uj are produced by the base encoder (E1).
Section 3.6 is about how to use E2, which is trained on the Ui and Uj predicted by E1, in the inference step. So we use E2 when computing the Ui and Uj in section 3.6.

Thanks!