
where \(\Vert \)  denotes concatenation.
GraphCache makes sentence-wise relation predictions \(\hat{r}_i(t)\)  using a sentence-wise Head, implemented as a multi-layer perception (MLP), analogous to a PointNet [1]}.
Since GraphCache predicts a relation label for each sentence, it can be trained by standard task-specific classification losses, e.g., cross-entropy [2]}.
During inference, we take \(\hat{r}_i(t)\)  after convergence as the output for RE.
