Here, \(W_{K}\in\mathbb{R}^{d_{model}\times d_{bay}}\), \(W_{V}\in\mathbb{R}^{d_{model}\times d_{value}}\) and \(W_{Q}\in\mathbb{R}^{d_{model}\times d_{bay}}\) are trainable projection matrices.
여기서 \(W_{K}\in\mathbb{R}^{d_{model}\times d_{bay}}\), \(W_{V}\in\mathbb{R}^{d_{model}\times d_{value}}\) 및 \(W_{Q}\in\mathbb{R}^{d_{model}\times d_{bay}}\)는 학습 가능한 투영 행렬입니다.
여기서 \(W_{K}\in\mathbb{R}^{d_{model}\times d_{bay}}\), \(W_{V}\in\mathbb{R}^{d_{model}\times d_{value}}\), \(W_{Q}\in\mathbb{R}^{d_{model}\times d_{bay}}\)는 학습 가능한 투영 행렬입니다.