To promote the Transformer from the classical to quantum real, one can replace the linear transformations \(W_Q\) , \(W_K\)  and \(W_V\)  with VQCs [1]}. A preliminary experiment for sentiment analysis made use of the IMDB dataset [2]} for binary classification. We used PennyLane [3]} version 0.13.0 and its plugin to perform simulations of quantum processes with the Qulacs library [4]}, which is a VQC simulator that runs on a GPU.
The parameters of the hybrid network are described in Tab. REF . It took about 100 hours to train the classifier for a single epoch. It is clear that unless a more sophisticated training method is devised, model development and parameter tuning is prohibitive with the hardware currently available to the general public. The open-source code is available at https://github.com/rdisipio/qtransformer.
<TABLE>