
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# gpt2-neurallinguisticpioneers

This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.6810

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 4

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 8.1162        | 0.01  | 1    | 6.2529          |
| 8.1162        | 0.01  | 2    | 4.5251          |
| 8.1162        | 0.02  | 3    | 3.0687          |
| 8.1162        | 0.02  | 4    | 1.8112          |
| 8.1162        | 0.03  | 5    | 1.1957          |
| 8.1162        | 0.03  | 6    | 0.9460          |
| 8.1162        | 0.04  | 7    | 0.8582          |
| 8.1162        | 0.04  | 8    | 0.8263          |
| 8.1162        | 0.05  | 9    | 0.8032          |
| 2.1875        | 0.05  | 10   | 0.7848          |
| 2.1875        | 0.06  | 11   | 0.7715          |
| 2.1875        | 0.06  | 12   | 0.7634          |
| 2.1875        | 0.07  | 13   | 0.7591          |
| 2.1875        | 0.07  | 14   | 0.7565          |
| 2.1875        | 0.08  | 15   | 0.7549          |
| 2.1875        | 0.09  | 16   | 0.7532          |
| 2.1875        | 0.09  | 17   | 0.7517          |
| 2.1875        | 0.1   | 18   | 0.7502          |
| 2.1875        | 0.1   | 19   | 0.7482          |
| 0.7815        | 0.11  | 20   | 0.7464          |
| 0.7815        | 0.11  | 21   | 0.7448          |
| 0.7815        | 0.12  | 22   | 0.7431          |
| 0.7815        | 0.12  | 23   | 0.7415          |
| 0.7815        | 0.13  | 24   | 0.7399          |
| 0.7815        | 0.13  | 25   | 0.7386          |
| 0.7815        | 0.14  | 26   | 0.7374          |
| 0.7815        | 0.14  | 27   | 0.7361          |
| 0.7815        | 0.15  | 28   | 0.7348          |
| 0.7815        | 0.16  | 29   | 0.7338          |
| 0.7937        | 0.16  | 30   | 0.7326          |
| 0.7937        | 0.17  | 31   | 0.7317          |
| 0.7937        | 0.17  | 32   | 0.7309          |
| 0.7937        | 0.18  | 33   | 0.7302          |
| 0.7937        | 0.18  | 34   | 0.7296          |
| 0.7937        | 0.19  | 35   | 0.7290          |
| 0.7937        | 0.19  | 36   | 0.7284          |
| 0.7937        | 0.2   | 37   | 0.7278          |
| 0.7937        | 0.2   | 38   | 0.7272          |
| 0.7937        | 0.21  | 39   | 0.7267          |
| 0.7899        | 0.21  | 40   | 0.7261          |
| 0.7899        | 0.22  | 41   | 0.7256          |
| 0.7899        | 0.22  | 42   | 0.7252          |
| 0.7899        | 0.23  | 43   | 0.7248          |
| 0.7899        | 0.24  | 44   | 0.7242          |
| 0.7899        | 0.24  | 45   | 0.7237          |
| 0.7899        | 0.25  | 46   | 0.7232          |
| 0.7899        | 0.25  | 47   | 0.7225          |
| 0.7899        | 0.26  | 48   | 0.7219          |
| 0.7899        | 0.26  | 49   | 0.7214          |
| 0.7555        | 0.27  | 50   | 0.7209          |
| 0.7555        | 0.27  | 51   | 0.7203          |
| 0.7555        | 0.28  | 52   | 0.7198          |
| 0.7555        | 0.28  | 53   | 0.7194          |
| 0.7555        | 0.29  | 54   | 0.7191          |
| 0.7555        | 0.29  | 55   | 0.7189          |
| 0.7555        | 0.3   | 56   | 0.7186          |
| 0.7555        | 0.3   | 57   | 0.7182          |
| 0.7555        | 0.31  | 58   | 0.7178          |
| 0.7555        | 0.32  | 59   | 0.7175          |
| 0.7823        | 0.32  | 60   | 0.7172          |
| 0.7823        | 0.33  | 61   | 0.7170          |
| 0.7823        | 0.33  | 62   | 0.7168          |
| 0.7823        | 0.34  | 63   | 0.7166          |
| 0.7823        | 0.34  | 64   | 0.7163          |
| 0.7823        | 0.35  | 65   | 0.7160          |
| 0.7823        | 0.35  | 66   | 0.7158          |
| 0.7823        | 0.36  | 67   | 0.7156          |
| 0.7823        | 0.36  | 68   | 0.7154          |
| 0.7823        | 0.37  | 69   | 0.7152          |
| 0.7324        | 0.37  | 70   | 0.7150          |
| 0.7324        | 0.38  | 71   | 0.7147          |
| 0.7324        | 0.39  | 72   | 0.7144          |
| 0.7324        | 0.39  | 73   | 0.7140          |
| 0.7324        | 0.4   | 74   | 0.7136          |
| 0.7324        | 0.4   | 75   | 0.7134          |
| 0.7324        | 0.41  | 76   | 0.7130          |
| 0.7324        | 0.41  | 77   | 0.7126          |
| 0.7324        | 0.42  | 78   | 0.7123          |
| 0.7324        | 0.42  | 79   | 0.7119          |
| 0.7982        | 0.43  | 80   | 0.7116          |
| 0.7982        | 0.43  | 81   | 0.7113          |
| 0.7982        | 0.44  | 82   | 0.7110          |
| 0.7982        | 0.44  | 83   | 0.7107          |
| 0.7982        | 0.45  | 84   | 0.7104          |
| 0.7982        | 0.45  | 85   | 0.7100          |
| 0.7982        | 0.46  | 86   | 0.7098          |
| 0.7982        | 0.47  | 87   | 0.7095          |
| 0.7982        | 0.47  | 88   | 0.7091          |
| 0.7982        | 0.48  | 89   | 0.7088          |
| 0.8248        | 0.48  | 90   | 0.7085          |
| 0.8248        | 0.49  | 91   | 0.7082          |
| 0.8248        | 0.49  | 92   | 0.7079          |
| 0.8248        | 0.5   | 93   | 0.7076          |
| 0.8248        | 0.5   | 94   | 0.7074          |
| 0.8248        | 0.51  | 95   | 0.7071          |
| 0.8248        | 0.51  | 96   | 0.7069          |
| 0.8248        | 0.52  | 97   | 0.7066          |
| 0.8248        | 0.52  | 98   | 0.7064          |
| 0.8248        | 0.53  | 99   | 0.7062          |
| 0.8284        | 0.53  | 100  | 0.7060          |
| 0.8284        | 0.54  | 101  | 0.7058          |
| 0.8284        | 0.55  | 102  | 0.7056          |
| 0.8284        | 0.55  | 103  | 0.7053          |
| 0.8284        | 0.56  | 104  | 0.7052          |
| 0.8284        | 0.56  | 105  | 0.7050          |
| 0.8284        | 0.57  | 106  | 0.7048          |
| 0.8284        | 0.57  | 107  | 0.7046          |
| 0.8284        | 0.58  | 108  | 0.7043          |
| 0.8284        | 0.58  | 109  | 0.7040          |
| 0.7394        | 0.59  | 110  | 0.7039          |
| 0.7394        | 0.59  | 111  | 0.7038          |
| 0.7394        | 0.6   | 112  | 0.7038          |
| 0.7394        | 0.6   | 113  | 0.7039          |
| 0.7394        | 0.61  | 114  | 0.7039          |
| 0.7394        | 0.61  | 115  | 0.7041          |
| 0.7394        | 0.62  | 116  | 0.7041          |
| 0.7394        | 0.63  | 117  | 0.7042          |
| 0.7394        | 0.63  | 118  | 0.7042          |
| 0.7394        | 0.64  | 119  | 0.7043          |
| 0.7026        | 0.64  | 120  | 0.7041          |
| 0.7026        | 0.65  | 121  | 0.7040          |
| 0.7026        | 0.65  | 122  | 0.7039          |
| 0.7026        | 0.66  | 123  | 0.7037          |
| 0.7026        | 0.66  | 124  | 0.7036          |
| 0.7026        | 0.67  | 125  | 0.7034          |
| 0.7026        | 0.67  | 126  | 0.7030          |
| 0.7026        | 0.68  | 127  | 0.7026          |
| 0.7026        | 0.68  | 128  | 0.7022          |
| 0.7026        | 0.69  | 129  | 0.7019          |
| 0.711         | 0.7   | 130  | 0.7015          |
| 0.711         | 0.7   | 131  | 0.7011          |
| 0.711         | 0.71  | 132  | 0.7008          |
| 0.711         | 0.71  | 133  | 0.7006          |
| 0.711         | 0.72  | 134  | 0.7004          |
| 0.711         | 0.72  | 135  | 0.7003          |
| 0.711         | 0.73  | 136  | 0.7001          |
| 0.711         | 0.73  | 137  | 0.7000          |
| 0.711         | 0.74  | 138  | 0.6999          |
| 0.711         | 0.74  | 139  | 0.6999          |
| 0.6655        | 0.75  | 140  | 0.6999          |
| 0.6655        | 0.75  | 141  | 0.6998          |
| 0.6655        | 0.76  | 142  | 0.6998          |
| 0.6655        | 0.76  | 143  | 0.6996          |
| 0.6655        | 0.77  | 144  | 0.6995          |
| 0.6655        | 0.78  | 145  | 0.6995          |
| 0.6655        | 0.78  | 146  | 0.6994          |
| 0.6655        | 0.79  | 147  | 0.6993          |
| 0.6655        | 0.79  | 148  | 0.6993          |
| 0.6655        | 0.8   | 149  | 0.6993          |
| 0.7044        | 0.8   | 150  | 0.6994          |
| 0.7044        | 0.81  | 151  | 0.6996          |
| 0.7044        | 0.81  | 152  | 0.6998          |
| 0.7044        | 0.82  | 153  | 0.6999          |
| 0.7044        | 0.82  | 154  | 0.7001          |
| 0.7044        | 0.83  | 155  | 0.7001          |
| 0.7044        | 0.83  | 156  | 0.7000          |
| 0.7044        | 0.84  | 157  | 0.6998          |
| 0.7044        | 0.84  | 158  | 0.6995          |
| 0.7044        | 0.85  | 159  | 0.6993          |
| 0.693         | 0.86  | 160  | 0.6990          |
| 0.693         | 0.86  | 161  | 0.6987          |
| 0.693         | 0.87  | 162  | 0.6984          |
| 0.693         | 0.87  | 163  | 0.6983          |
| 0.693         | 0.88  | 164  | 0.6981          |
| 0.693         | 0.88  | 165  | 0.6979          |
| 0.693         | 0.89  | 166  | 0.6976          |
| 0.693         | 0.89  | 167  | 0.6974          |
| 0.693         | 0.9   | 168  | 0.6972          |
| 0.693         | 0.9   | 169  | 0.6969          |
| 0.713         | 0.91  | 170  | 0.6967          |
| 0.713         | 0.91  | 171  | 0.6965          |
| 0.713         | 0.92  | 172  | 0.6963          |
| 0.713         | 0.93  | 173  | 0.6961          |
| 0.713         | 0.93  | 174  | 0.6959          |
| 0.713         | 0.94  | 175  | 0.6958          |
| 0.713         | 0.94  | 176  | 0.6956          |
| 0.713         | 0.95  | 177  | 0.6955          |
| 0.713         | 0.95  | 178  | 0.6953          |
| 0.713         | 0.96  | 179  | 0.6952          |
| 0.7331        | 0.96  | 180  | 0.6952          |
| 0.7331        | 0.97  | 181  | 0.6951          |
| 0.7331        | 0.97  | 182  | 0.6950          |
| 0.7331        | 0.98  | 183  | 0.6950          |
| 0.7331        | 0.98  | 184  | 0.6949          |
| 0.7331        | 0.99  | 185  | 0.6949          |
| 0.7331        | 0.99  | 186  | 0.6948          |
| 0.7331        | 1.0   | 187  | 0.6948          |
| 0.7331        | 1.01  | 188  | 0.6947          |
| 0.7331        | 1.01  | 189  | 0.6947          |
| 0.7024        | 1.02  | 190  | 0.6947          |
| 0.7024        | 1.02  | 191  | 0.6947          |
| 0.7024        | 1.03  | 192  | 0.6947          |
| 0.7024        | 1.03  | 193  | 0.6946          |
| 0.7024        | 1.04  | 194  | 0.6945          |
| 0.7024        | 1.04  | 195  | 0.6945          |
| 0.7024        | 1.05  | 196  | 0.6946          |
| 0.7024        | 1.05  | 197  | 0.6946          |
| 0.7024        | 1.06  | 198  | 0.6944          |
| 0.7024        | 1.06  | 199  | 0.6943          |
| 0.6302        | 1.07  | 200  | 0.6943          |
| 0.6302        | 1.07  | 201  | 0.6942          |
| 0.6302        | 1.08  | 202  | 0.6941          |
| 0.6302        | 1.09  | 203  | 0.6941          |
| 0.6302        | 1.09  | 204  | 0.6941          |
| 0.6302        | 1.1   | 205  | 0.6941          |
| 0.6302        | 1.1   | 206  | 0.6940          |
| 0.6302        | 1.11  | 207  | 0.6939          |
| 0.6302        | 1.11  | 208  | 0.6938          |
| 0.6302        | 1.12  | 209  | 0.6937          |
| 0.6372        | 1.12  | 210  | 0.6936          |
| 0.6372        | 1.13  | 211  | 0.6935          |
| 0.6372        | 1.13  | 212  | 0.6934          |
| 0.6372        | 1.14  | 213  | 0.6934          |
| 0.6372        | 1.14  | 214  | 0.6934          |
| 0.6372        | 1.15  | 215  | 0.6934          |
| 0.6372        | 1.16  | 216  | 0.6934          |
| 0.6372        | 1.16  | 217  | 0.6934          |
| 0.6372        | 1.17  | 218  | 0.6934          |
| 0.6372        | 1.17  | 219  | 0.6933          |
| 0.7487        | 1.18  | 220  | 0.6932          |
| 0.7487        | 1.18  | 221  | 0.6931          |
| 0.7487        | 1.19  | 222  | 0.6931          |
| 0.7487        | 1.19  | 223  | 0.6930          |
| 0.7487        | 1.2   | 224  | 0.6928          |
| 0.7487        | 1.2   | 225  | 0.6926          |
| 0.7487        | 1.21  | 226  | 0.6924          |
| 0.7487        | 1.21  | 227  | 0.6923          |
| 0.7487        | 1.22  | 228  | 0.6922          |
| 0.7487        | 1.22  | 229  | 0.6920          |
| 0.692         | 1.23  | 230  | 0.6919          |
| 0.692         | 1.24  | 231  | 0.6918          |
| 0.692         | 1.24  | 232  | 0.6917          |
| 0.692         | 1.25  | 233  | 0.6916          |
| 0.692         | 1.25  | 234  | 0.6916          |
| 0.692         | 1.26  | 235  | 0.6915          |
| 0.692         | 1.26  | 236  | 0.6915          |
| 0.692         | 1.27  | 237  | 0.6915          |
| 0.692         | 1.27  | 238  | 0.6916          |
| 0.692         | 1.28  | 239  | 0.6917          |
| 0.7377        | 1.28  | 240  | 0.6917          |
| 0.7377        | 1.29  | 241  | 0.6918          |
| 0.7377        | 1.29  | 242  | 0.6918          |
| 0.7377        | 1.3   | 243  | 0.6918          |
| 0.7377        | 1.3   | 244  | 0.6918          |
| 0.7377        | 1.31  | 245  | 0.6917          |
| 0.7377        | 1.32  | 246  | 0.6916          |
| 0.7377        | 1.32  | 247  | 0.6916          |
| 0.7377        | 1.33  | 248  | 0.6915          |
| 0.7377        | 1.33  | 249  | 0.6915          |
| 0.6835        | 1.34  | 250  | 0.6914          |
| 0.6835        | 1.34  | 251  | 0.6914          |
| 0.6835        | 1.35  | 252  | 0.6914          |
| 0.6835        | 1.35  | 253  | 0.6914          |
| 0.6835        | 1.36  | 254  | 0.6914          |
| 0.6835        | 1.36  | 255  | 0.6915          |
| 0.6835        | 1.37  | 256  | 0.6916          |
| 0.6835        | 1.37  | 257  | 0.6916          |
| 0.6835        | 1.38  | 258  | 0.6916          |
| 0.6835        | 1.39  | 259  | 0.6916          |
| 0.6302        | 1.39  | 260  | 0.6916          |
| 0.6302        | 1.4   | 261  | 0.6916          |
| 0.6302        | 1.4   | 262  | 0.6917          |
| 0.6302        | 1.41  | 263  | 0.6917          |
| 0.6302        | 1.41  | 264  | 0.6918          |
| 0.6302        | 1.42  | 265  | 0.6916          |
| 0.6302        | 1.42  | 266  | 0.6915          |
| 0.6302        | 1.43  | 267  | 0.6913          |
| 0.6302        | 1.43  | 268  | 0.6912          |
| 0.6302        | 1.44  | 269  | 0.6911          |
| 0.7234        | 1.44  | 270  | 0.6910          |
| 0.7234        | 1.45  | 271  | 0.6909          |
| 0.7234        | 1.45  | 272  | 0.6908          |
| 0.7234        | 1.46  | 273  | 0.6906          |
| 0.7234        | 1.47  | 274  | 0.6906          |
| 0.7234        | 1.47  | 275  | 0.6905          |
| 0.7234        | 1.48  | 276  | 0.6904          |
| 0.7234        | 1.48  | 277  | 0.6903          |
| 0.7234        | 1.49  | 278  | 0.6902          |
| 0.7234        | 1.49  | 279  | 0.6901          |
| 0.6754        | 1.5   | 280  | 0.6900          |
| 0.6754        | 1.5   | 281  | 0.6899          |
| 0.6754        | 1.51  | 282  | 0.6899          |
| 0.6754        | 1.51  | 283  | 0.6899          |
| 0.6754        | 1.52  | 284  | 0.6899          |
| 0.6754        | 1.52  | 285  | 0.6898          |
| 0.6754        | 1.53  | 286  | 0.6898          |
| 0.6754        | 1.53  | 287  | 0.6897          |
| 0.6754        | 1.54  | 288  | 0.6896          |
| 0.6754        | 1.55  | 289  | 0.6895          |
| 0.6729        | 1.55  | 290  | 0.6894          |
| 0.6729        | 1.56  | 291  | 0.6894          |
| 0.6729        | 1.56  | 292  | 0.6894          |
| 0.6729        | 1.57  | 293  | 0.6893          |
| 0.6729        | 1.57  | 294  | 0.6892          |
| 0.6729        | 1.58  | 295  | 0.6892          |
| 0.6729        | 1.58  | 296  | 0.6890          |
| 0.6729        | 1.59  | 297  | 0.6890          |
| 0.6729        | 1.59  | 298  | 0.6889          |
| 0.6729        | 1.6   | 299  | 0.6889          |
| 0.6323        | 1.6   | 300  | 0.6888          |
| 0.6323        | 1.61  | 301  | 0.6888          |
| 0.6323        | 1.61  | 302  | 0.6887          |
| 0.6323        | 1.62  | 303  | 0.6886          |
| 0.6323        | 1.63  | 304  | 0.6885          |
| 0.6323        | 1.63  | 305  | 0.6884          |
| 0.6323        | 1.64  | 306  | 0.6882          |
| 0.6323        | 1.64  | 307  | 0.6881          |
| 0.6323        | 1.65  | 308  | 0.6881          |
| 0.6323        | 1.65  | 309  | 0.6880          |
| 0.7545        | 1.66  | 310  | 0.6880          |
| 0.7545        | 1.66  | 311  | 0.6879          |
| 0.7545        | 1.67  | 312  | 0.6879          |
| 0.7545        | 1.67  | 313  | 0.6879          |
| 0.7545        | 1.68  | 314  | 0.6878          |
| 0.7545        | 1.68  | 315  | 0.6878          |
| 0.7545        | 1.69  | 316  | 0.6877          |
| 0.7545        | 1.7   | 317  | 0.6876          |
| 0.7545        | 1.7   | 318  | 0.6875          |
| 0.7545        | 1.71  | 319  | 0.6874          |
| 0.6746        | 1.71  | 320  | 0.6873          |
| 0.6746        | 1.72  | 321  | 0.6872          |
| 0.6746        | 1.72  | 322  | 0.6870          |
| 0.6746        | 1.73  | 323  | 0.6869          |
| 0.6746        | 1.73  | 324  | 0.6868          |
| 0.6746        | 1.74  | 325  | 0.6867          |
| 0.6746        | 1.74  | 326  | 0.6866          |
| 0.6746        | 1.75  | 327  | 0.6865          |
| 0.6746        | 1.75  | 328  | 0.6863          |
| 0.6746        | 1.76  | 329  | 0.6862          |
| 0.6963        | 1.76  | 330  | 0.6861          |
| 0.6963        | 1.77  | 331  | 0.6860          |
| 0.6963        | 1.78  | 332  | 0.6859          |
| 0.6963        | 1.78  | 333  | 0.6858          |
| 0.6963        | 1.79  | 334  | 0.6858          |
| 0.6963        | 1.79  | 335  | 0.6857          |
| 0.6963        | 1.8   | 336  | 0.6857          |
| 0.6963        | 1.8   | 337  | 0.6857          |
| 0.6963        | 1.81  | 338  | 0.6856          |
| 0.6963        | 1.81  | 339  | 0.6856          |
| 0.6206        | 1.82  | 340  | 0.6856          |
| 0.6206        | 1.82  | 341  | 0.6857          |
| 0.6206        | 1.83  | 342  | 0.6857          |
| 0.6206        | 1.83  | 343  | 0.6857          |
| 0.6206        | 1.84  | 344  | 0.6857          |
| 0.6206        | 1.84  | 345  | 0.6857          |
| 0.6206        | 1.85  | 346  | 0.6857          |
| 0.6206        | 1.86  | 347  | 0.6857          |
| 0.6206        | 1.86  | 348  | 0.6857          |
| 0.6206        | 1.87  | 349  | 0.6857          |
| 0.6714        | 1.87  | 350  | 0.6857          |
| 0.6714        | 1.88  | 351  | 0.6857          |
| 0.6714        | 1.88  | 352  | 0.6857          |
| 0.6714        | 1.89  | 353  | 0.6858          |
| 0.6714        | 1.89  | 354  | 0.6858          |
| 0.6714        | 1.9   | 355  | 0.6859          |
| 0.6714        | 1.9   | 356  | 0.6860          |
| 0.6714        | 1.91  | 357  | 0.6860          |
| 0.6714        | 1.91  | 358  | 0.6861          |
| 0.6714        | 1.92  | 359  | 0.6861          |
| 0.7122        | 1.93  | 360  | 0.6862          |
| 0.7122        | 1.93  | 361  | 0.6862          |
| 0.7122        | 1.94  | 362  | 0.6862          |
| 0.7122        | 1.94  | 363  | 0.6862          |
| 0.7122        | 1.95  | 364  | 0.6862          |
| 0.7122        | 1.95  | 365  | 0.6862          |
| 0.7122        | 1.96  | 366  | 0.6861          |
| 0.7122        | 1.96  | 367  | 0.6860          |
| 0.7122        | 1.97  | 368  | 0.6859          |
| 0.7122        | 1.97  | 369  | 0.6858          |
| 0.7182        | 1.98  | 370  | 0.6858          |
| 0.7182        | 1.98  | 371  | 0.6858          |
| 0.7182        | 1.99  | 372  | 0.6858          |
| 0.7182        | 1.99  | 373  | 0.6858          |
| 0.7182        | 2.0   | 374  | 0.6858          |
| 0.7182        | 2.01  | 375  | 0.6858          |
| 0.7182        | 2.01  | 376  | 0.6857          |
| 0.7182        | 2.02  | 377  | 0.6857          |
| 0.7182        | 2.02  | 378  | 0.6856          |
| 0.7182        | 2.03  | 379  | 0.6856          |
| 0.6543        | 2.03  | 380  | 0.6856          |
| 0.6543        | 2.04  | 381  | 0.6855          |
| 0.6543        | 2.04  | 382  | 0.6854          |
| 0.6543        | 2.05  | 383  | 0.6854          |
| 0.6543        | 2.05  | 384  | 0.6853          |
| 0.6543        | 2.06  | 385  | 0.6853          |
| 0.6543        | 2.06  | 386  | 0.6852          |
| 0.6543        | 2.07  | 387  | 0.6852          |
| 0.6543        | 2.07  | 388  | 0.6852          |
| 0.6543        | 2.08  | 389  | 0.6852          |
| 0.7564        | 2.09  | 390  | 0.6852          |
| 0.7564        | 2.09  | 391  | 0.6852          |
| 0.7564        | 2.1   | 392  | 0.6852          |
| 0.7564        | 2.1   | 393  | 0.6852          |
| 0.7564        | 2.11  | 394  | 0.6852          |
| 0.7564        | 2.11  | 395  | 0.6852          |
| 0.7564        | 2.12  | 396  | 0.6852          |
| 0.7564        | 2.12  | 397  | 0.6852          |
| 0.7564        | 2.13  | 398  | 0.6852          |
| 0.7564        | 2.13  | 399  | 0.6851          |
| 0.6413        | 2.14  | 400  | 0.6851          |
| 0.6413        | 2.14  | 401  | 0.6851          |
| 0.6413        | 2.15  | 402  | 0.6851          |
| 0.6413        | 2.16  | 403  | 0.6851          |
| 0.6413        | 2.16  | 404  | 0.6851          |
| 0.6413        | 2.17  | 405  | 0.6851          |
| 0.6413        | 2.17  | 406  | 0.6852          |
| 0.6413        | 2.18  | 407  | 0.6852          |
| 0.6413        | 2.18  | 408  | 0.6853          |
| 0.6413        | 2.19  | 409  | 0.6854          |
| 0.6271        | 2.19  | 410  | 0.6855          |
| 0.6271        | 2.2   | 411  | 0.6855          |
| 0.6271        | 2.2   | 412  | 0.6855          |
| 0.6271        | 2.21  | 413  | 0.6854          |
| 0.6271        | 2.21  | 414  | 0.6854          |
| 0.6271        | 2.22  | 415  | 0.6854          |
| 0.6271        | 2.22  | 416  | 0.6853          |
| 0.6271        | 2.23  | 417  | 0.6853          |
| 0.6271        | 2.24  | 418  | 0.6852          |
| 0.6271        | 2.24  | 419  | 0.6851          |
| 0.6567        | 2.25  | 420  | 0.6849          |
| 0.6567        | 2.25  | 421  | 0.6848          |
| 0.6567        | 2.26  | 422  | 0.6846          |
| 0.6567        | 2.26  | 423  | 0.6845          |
| 0.6567        | 2.27  | 424  | 0.6844          |
| 0.6567        | 2.27  | 425  | 0.6842          |
| 0.6567        | 2.28  | 426  | 0.6841          |
| 0.6567        | 2.28  | 427  | 0.6839          |
| 0.6567        | 2.29  | 428  | 0.6838          |
| 0.6567        | 2.29  | 429  | 0.6837          |
| 0.655         | 2.3   | 430  | 0.6836          |
| 0.655         | 2.3   | 431  | 0.6835          |
| 0.655         | 2.31  | 432  | 0.6834          |
| 0.655         | 2.32  | 433  | 0.6833          |
| 0.655         | 2.32  | 434  | 0.6832          |
| 0.655         | 2.33  | 435  | 0.6832          |
| 0.655         | 2.33  | 436  | 0.6832          |
| 0.655         | 2.34  | 437  | 0.6832          |
| 0.655         | 2.34  | 438  | 0.6832          |
| 0.655         | 2.35  | 439  | 0.6832          |
| 0.6582        | 2.35  | 440  | 0.6833          |
| 0.6582        | 2.36  | 441  | 0.6834          |
| 0.6582        | 2.36  | 442  | 0.6834          |
| 0.6582        | 2.37  | 443  | 0.6835          |
| 0.6582        | 2.37  | 444  | 0.6835          |
| 0.6582        | 2.38  | 445  | 0.6835          |
| 0.6582        | 2.39  | 446  | 0.6835          |
| 0.6582        | 2.39  | 447  | 0.6835          |
| 0.6582        | 2.4   | 448  | 0.6835          |
| 0.6582        | 2.4   | 449  | 0.6835          |
| 0.6078        | 2.41  | 450  | 0.6835          |
| 0.6078        | 2.41  | 451  | 0.6835          |
| 0.6078        | 2.42  | 452  | 0.6835          |
| 0.6078        | 2.42  | 453  | 0.6835          |
| 0.6078        | 2.43  | 454  | 0.6836          |
| 0.6078        | 2.43  | 455  | 0.6836          |
| 0.6078        | 2.44  | 456  | 0.6837          |
| 0.6078        | 2.44  | 457  | 0.6837          |
| 0.6078        | 2.45  | 458  | 0.6838          |
| 0.6078        | 2.45  | 459  | 0.6838          |
| 0.6529        | 2.46  | 460  | 0.6839          |
| 0.6529        | 2.47  | 461  | 0.6840          |
| 0.6529        | 2.47  | 462  | 0.6842          |
| 0.6529        | 2.48  | 463  | 0.6843          |
| 0.6529        | 2.48  | 464  | 0.6844          |
| 0.6529        | 2.49  | 465  | 0.6845          |
| 0.6529        | 2.49  | 466  | 0.6846          |
| 0.6529        | 2.5   | 467  | 0.6847          |
| 0.6529        | 2.5   | 468  | 0.6847          |
| 0.6529        | 2.51  | 469  | 0.6847          |
| 0.652         | 2.51  | 470  | 0.6848          |
| 0.652         | 2.52  | 471  | 0.6848          |
| 0.652         | 2.52  | 472  | 0.6847          |
| 0.652         | 2.53  | 473  | 0.6847          |
| 0.652         | 2.53  | 474  | 0.6846          |
| 0.652         | 2.54  | 475  | 0.6844          |
| 0.652         | 2.55  | 476  | 0.6843          |
| 0.652         | 2.55  | 477  | 0.6841          |
| 0.652         | 2.56  | 478  | 0.6840          |
| 0.652         | 2.56  | 479  | 0.6839          |
| 0.6467        | 2.57  | 480  | 0.6838          |
| 0.6467        | 2.57  | 481  | 0.6837          |
| 0.6467        | 2.58  | 482  | 0.6836          |
| 0.6467        | 2.58  | 483  | 0.6836          |
| 0.6467        | 2.59  | 484  | 0.6836          |
| 0.6467        | 2.59  | 485  | 0.6835          |
| 0.6467        | 2.6   | 486  | 0.6835          |
| 0.6467        | 2.6   | 487  | 0.6835          |
| 0.6467        | 2.61  | 488  | 0.6835          |
| 0.6467        | 2.61  | 489  | 0.6835          |
| 0.684         | 2.62  | 490  | 0.6835          |
| 0.684         | 2.63  | 491  | 0.6835          |
| 0.684         | 2.63  | 492  | 0.6835          |
| 0.684         | 2.64  | 493  | 0.6835          |
| 0.684         | 2.64  | 494  | 0.6834          |
| 0.684         | 2.65  | 495  | 0.6834          |
| 0.684         | 2.65  | 496  | 0.6833          |
| 0.684         | 2.66  | 497  | 0.6833          |
| 0.684         | 2.66  | 498  | 0.6832          |
| 0.684         | 2.67  | 499  | 0.6832          |
| 0.6397        | 2.67  | 500  | 0.6831          |
| 0.6397        | 2.68  | 501  | 0.6831          |
| 0.6397        | 2.68  | 502  | 0.6830          |
| 0.6397        | 2.69  | 503  | 0.6830          |
| 0.6397        | 2.7   | 504  | 0.6830          |
| 0.6397        | 2.7   | 505  | 0.6830          |
| 0.6397        | 2.71  | 506  | 0.6830          |
| 0.6397        | 2.71  | 507  | 0.6830          |
| 0.6397        | 2.72  | 508  | 0.6830          |
| 0.6397        | 2.72  | 509  | 0.6830          |
| 0.6555        | 2.73  | 510  | 0.6830          |
| 0.6555        | 2.73  | 511  | 0.6830          |
| 0.6555        | 2.74  | 512  | 0.6830          |
| 0.6555        | 2.74  | 513  | 0.6830          |
| 0.6555        | 2.75  | 514  | 0.6829          |
| 0.6555        | 2.75  | 515  | 0.6829          |
| 0.6555        | 2.76  | 516  | 0.6829          |
| 0.6555        | 2.76  | 517  | 0.6829          |
| 0.6555        | 2.77  | 518  | 0.6828          |
| 0.6555        | 2.78  | 519  | 0.6828          |
| 0.6674        | 2.78  | 520  | 0.6827          |
| 0.6674        | 2.79  | 521  | 0.6827          |
| 0.6674        | 2.79  | 522  | 0.6827          |
| 0.6674        | 2.8   | 523  | 0.6826          |
| 0.6674        | 2.8   | 524  | 0.6826          |
| 0.6674        | 2.81  | 525  | 0.6826          |
| 0.6674        | 2.81  | 526  | 0.6826          |
| 0.6674        | 2.82  | 527  | 0.6827          |
| 0.6674        | 2.82  | 528  | 0.6827          |
| 0.6674        | 2.83  | 529  | 0.6827          |
| 0.6873        | 2.83  | 530  | 0.6827          |
| 0.6873        | 2.84  | 531  | 0.6826          |
| 0.6873        | 2.84  | 532  | 0.6827          |
| 0.6873        | 2.85  | 533  | 0.6827          |
| 0.6873        | 2.86  | 534  | 0.6827          |
| 0.6873        | 2.86  | 535  | 0.6826          |
| 0.6873        | 2.87  | 536  | 0.6826          |
| 0.6873        | 2.87  | 537  | 0.6826          |
| 0.6873        | 2.88  | 538  | 0.6826          |
| 0.6873        | 2.88  | 539  | 0.6826          |
| 0.6506        | 2.89  | 540  | 0.6825          |
| 0.6506        | 2.89  | 541  | 0.6825          |
| 0.6506        | 2.9   | 542  | 0.6824          |
| 0.6506        | 2.9   | 543  | 0.6824          |
| 0.6506        | 2.91  | 544  | 0.6824          |
| 0.6506        | 2.91  | 545  | 0.6824          |
| 0.6506        | 2.92  | 546  | 0.6824          |
| 0.6506        | 2.93  | 547  | 0.6823          |
| 0.6506        | 2.93  | 548  | 0.6823          |
| 0.6506        | 2.94  | 549  | 0.6822          |
| 0.7203        | 2.94  | 550  | 0.6822          |
| 0.7203        | 2.95  | 551  | 0.6821          |
| 0.7203        | 2.95  | 552  | 0.6820          |
| 0.7203        | 2.96  | 553  | 0.6820          |
| 0.7203        | 2.96  | 554  | 0.6819          |
| 0.7203        | 2.97  | 555  | 0.6818          |
| 0.7203        | 2.97  | 556  | 0.6818          |
| 0.7203        | 2.98  | 557  | 0.6818          |
| 0.7203        | 2.98  | 558  | 0.6818          |
| 0.7203        | 2.99  | 559  | 0.6817          |
| 0.5701        | 2.99  | 560  | 0.6817          |
| 0.5701        | 3.0   | 561  | 0.6817          |
| 0.5701        | 3.01  | 562  | 0.6817          |
| 0.5701        | 3.01  | 563  | 0.6817          |
| 0.5701        | 3.02  | 564  | 0.6817          |
| 0.5701        | 3.02  | 565  | 0.6817          |
| 0.5701        | 3.03  | 566  | 0.6817          |
| 0.5701        | 3.03  | 567  | 0.6817          |
| 0.5701        | 3.04  | 568  | 0.6817          |
| 0.5701        | 3.04  | 569  | 0.6817          |
| 0.6936        | 3.05  | 570  | 0.6817          |
| 0.6936        | 3.05  | 571  | 0.6817          |
| 0.6936        | 3.06  | 572  | 0.6817          |
| 0.6936        | 3.06  | 573  | 0.6817          |
| 0.6936        | 3.07  | 574  | 0.6817          |
| 0.6936        | 3.07  | 575  | 0.6817          |
| 0.6936        | 3.08  | 576  | 0.6817          |
| 0.6936        | 3.09  | 577  | 0.6817          |
| 0.6936        | 3.09  | 578  | 0.6817          |
| 0.6936        | 3.1   | 579  | 0.6817          |
| 0.6722        | 3.1   | 580  | 0.6817          |
| 0.6722        | 3.11  | 581  | 0.6818          |
| 0.6722        | 3.11  | 582  | 0.6818          |
| 0.6722        | 3.12  | 583  | 0.6819          |
| 0.6722        | 3.12  | 584  | 0.6820          |
| 0.6722        | 3.13  | 585  | 0.6820          |
| 0.6722        | 3.13  | 586  | 0.6820          |
| 0.6722        | 3.14  | 587  | 0.6820          |
| 0.6722        | 3.14  | 588  | 0.6820          |
| 0.6722        | 3.15  | 589  | 0.6820          |
| 0.6676        | 3.16  | 590  | 0.6820          |
| 0.6676        | 3.16  | 591  | 0.6820          |
| 0.6676        | 3.17  | 592  | 0.6820          |
| 0.6676        | 3.17  | 593  | 0.6820          |
| 0.6676        | 3.18  | 594  | 0.6820          |
| 0.6676        | 3.18  | 595  | 0.6819          |
| 0.6676        | 3.19  | 596  | 0.6819          |
| 0.6676        | 3.19  | 597  | 0.6818          |
| 0.6676        | 3.2   | 598  | 0.6818          |
| 0.6676        | 3.2   | 599  | 0.6817          |
| 0.7445        | 3.21  | 600  | 0.6817          |
| 0.7445        | 3.21  | 601  | 0.6817          |
| 0.7445        | 3.22  | 602  | 0.6816          |
| 0.7445        | 3.22  | 603  | 0.6816          |
| 0.7445        | 3.23  | 604  | 0.6816          |
| 0.7445        | 3.24  | 605  | 0.6816          |
| 0.7445        | 3.24  | 606  | 0.6816          |
| 0.7445        | 3.25  | 607  | 0.6816          |
| 0.7445        | 3.25  | 608  | 0.6816          |
| 0.7445        | 3.26  | 609  | 0.6816          |
| 0.5487        | 3.26  | 610  | 0.6816          |
| 0.5487        | 3.27  | 611  | 0.6816          |
| 0.5487        | 3.27  | 612  | 0.6815          |
| 0.5487        | 3.28  | 613  | 0.6815          |
| 0.5487        | 3.28  | 614  | 0.6815          |
| 0.5487        | 3.29  | 615  | 0.6815          |
| 0.5487        | 3.29  | 616  | 0.6815          |
| 0.5487        | 3.3   | 617  | 0.6815          |
| 0.5487        | 3.3   | 618  | 0.6815          |
| 0.5487        | 3.31  | 619  | 0.6814          |
| 0.6195        | 3.32  | 620  | 0.6814          |
| 0.6195        | 3.32  | 621  | 0.6814          |
| 0.6195        | 3.33  | 622  | 0.6814          |
| 0.6195        | 3.33  | 623  | 0.6814          |
| 0.6195        | 3.34  | 624  | 0.6814          |
| 0.6195        | 3.34  | 625  | 0.6814          |
| 0.6195        | 3.35  | 626  | 0.6813          |
| 0.6195        | 3.35  | 627  | 0.6813          |
| 0.6195        | 3.36  | 628  | 0.6813          |
| 0.6195        | 3.36  | 629  | 0.6813          |
| 0.5994        | 3.37  | 630  | 0.6813          |
| 0.5994        | 3.37  | 631  | 0.6813          |
| 0.5994        | 3.38  | 632  | 0.6813          |
| 0.5994        | 3.39  | 633  | 0.6812          |
| 0.5994        | 3.39  | 634  | 0.6812          |
| 0.5994        | 3.4   | 635  | 0.6812          |
| 0.5994        | 3.4   | 636  | 0.6812          |
| 0.5994        | 3.41  | 637  | 0.6812          |
| 0.5994        | 3.41  | 638  | 0.6811          |
| 0.5994        | 3.42  | 639  | 0.6811          |
| 0.6741        | 3.42  | 640  | 0.6811          |
| 0.6741        | 3.43  | 641  | 0.6811          |
| 0.6741        | 3.43  | 642  | 0.6811          |
| 0.6741        | 3.44  | 643  | 0.6811          |
| 0.6741        | 3.44  | 644  | 0.6811          |
| 0.6741        | 3.45  | 645  | 0.6811          |
| 0.6741        | 3.45  | 646  | 0.6811          |
| 0.6741        | 3.46  | 647  | 0.6811          |
| 0.6741        | 3.47  | 648  | 0.6811          |
| 0.6741        | 3.47  | 649  | 0.6811          |
| 0.6098        | 3.48  | 650  | 0.6810          |
| 0.6098        | 3.48  | 651  | 0.6810          |
| 0.6098        | 3.49  | 652  | 0.6810          |
| 0.6098        | 3.49  | 653  | 0.6810          |
| 0.6098        | 3.5   | 654  | 0.6810          |
| 0.6098        | 3.5   | 655  | 0.6810          |
| 0.6098        | 3.51  | 656  | 0.6810          |
| 0.6098        | 3.51  | 657  | 0.6810          |
| 0.6098        | 3.52  | 658  | 0.6810          |
| 0.6098        | 3.52  | 659  | 0.6810          |
| 0.5846        | 3.53  | 660  | 0.6810          |
| 0.5846        | 3.53  | 661  | 0.6810          |
| 0.5846        | 3.54  | 662  | 0.6810          |
| 0.5846        | 3.55  | 663  | 0.6809          |
| 0.5846        | 3.55  | 664  | 0.6809          |
| 0.5846        | 3.56  | 665  | 0.6809          |
| 0.5846        | 3.56  | 666  | 0.6809          |
| 0.5846        | 3.57  | 667  | 0.6809          |
| 0.5846        | 3.57  | 668  | 0.6809          |
| 0.5846        | 3.58  | 669  | 0.6809          |
| 0.6812        | 3.58  | 670  | 0.6809          |
| 0.6812        | 3.59  | 671  | 0.6809          |
| 0.6812        | 3.59  | 672  | 0.6809          |
| 0.6812        | 3.6   | 673  | 0.6809          |
| 0.6812        | 3.6   | 674  | 0.6809          |
| 0.6812        | 3.61  | 675  | 0.6809          |
| 0.6812        | 3.61  | 676  | 0.6809          |
| 0.6812        | 3.62  | 677  | 0.6809          |
| 0.6812        | 3.63  | 678  | 0.6809          |
| 0.6812        | 3.63  | 679  | 0.6809          |
| 0.617         | 3.64  | 680  | 0.6808          |
| 0.617         | 3.64  | 681  | 0.6808          |
| 0.617         | 3.65  | 682  | 0.6808          |
| 0.617         | 3.65  | 683  | 0.6808          |
| 0.617         | 3.66  | 684  | 0.6808          |
| 0.617         | 3.66  | 685  | 0.6808          |
| 0.617         | 3.67  | 686  | 0.6808          |
| 0.617         | 3.67  | 687  | 0.6808          |
| 0.617         | 3.68  | 688  | 0.6809          |
| 0.617         | 3.68  | 689  | 0.6809          |
| 0.5914        | 3.69  | 690  | 0.6809          |
| 0.5914        | 3.7   | 691  | 0.6809          |
| 0.5914        | 3.7   | 692  | 0.6809          |
| 0.5914        | 3.71  | 693  | 0.6809          |
| 0.5914        | 3.71  | 694  | 0.6809          |
| 0.5914        | 3.72  | 695  | 0.6809          |
| 0.5914        | 3.72  | 696  | 0.6810          |
| 0.5914        | 3.73  | 697  | 0.6810          |
| 0.5914        | 3.73  | 698  | 0.6810          |
| 0.5914        | 3.74  | 699  | 0.6810          |
| 0.6496        | 3.74  | 700  | 0.6810          |
| 0.6496        | 3.75  | 701  | 0.6810          |
| 0.6496        | 3.75  | 702  | 0.6810          |
| 0.6496        | 3.76  | 703  | 0.6810          |
| 0.6496        | 3.76  | 704  | 0.6811          |
| 0.6496        | 3.77  | 705  | 0.6811          |
| 0.6496        | 3.78  | 706  | 0.6811          |
| 0.6496        | 3.78  | 707  | 0.6811          |
| 0.6496        | 3.79  | 708  | 0.6811          |
| 0.6496        | 3.79  | 709  | 0.6811          |
| 0.6913        | 3.8   | 710  | 0.6811          |
| 0.6913        | 3.8   | 711  | 0.6811          |
| 0.6913        | 3.81  | 712  | 0.6811          |
| 0.6913        | 3.81  | 713  | 0.6811          |
| 0.6913        | 3.82  | 714  | 0.6811          |
| 0.6913        | 3.82  | 715  | 0.6811          |
| 0.6913        | 3.83  | 716  | 0.6811          |
| 0.6913        | 3.83  | 717  | 0.6811          |
| 0.6913        | 3.84  | 718  | 0.6811          |
| 0.6913        | 3.84  | 719  | 0.6811          |
| 0.593         | 3.85  | 720  | 0.6810          |
| 0.593         | 3.86  | 721  | 0.6810          |
| 0.593         | 3.86  | 722  | 0.6810          |
| 0.593         | 3.87  | 723  | 0.6810          |
| 0.593         | 3.87  | 724  | 0.6810          |
| 0.593         | 3.88  | 725  | 0.6810          |
| 0.593         | 3.88  | 726  | 0.6810          |
| 0.593         | 3.89  | 727  | 0.6810          |
| 0.593         | 3.89  | 728  | 0.6810          |
| 0.593         | 3.9   | 729  | 0.6810          |
| 0.6338        | 3.9   | 730  | 0.6810          |
| 0.6338        | 3.91  | 731  | 0.6810          |
| 0.6338        | 3.91  | 732  | 0.6810          |
| 0.6338        | 3.92  | 733  | 0.6810          |
| 0.6338        | 3.93  | 734  | 0.6810          |
| 0.6338        | 3.93  | 735  | 0.6810          |
| 0.6338        | 3.94  | 736  | 0.6810          |
| 0.6338        | 3.94  | 737  | 0.6810          |
| 0.6338        | 3.95  | 738  | 0.6810          |
| 0.6338        | 3.95  | 739  | 0.6810          |
| 0.6908        | 3.96  | 740  | 0.6810          |
| 0.6908        | 3.96  | 741  | 0.6810          |
| 0.6908        | 3.97  | 742  | 0.6810          |
| 0.6908        | 3.97  | 743  | 0.6810          |
| 0.6908        | 3.98  | 744  | 0.6810          |
| 0.6908        | 3.98  | 745  | 0.6810          |
| 0.6908        | 3.99  | 746  | 0.6810          |
| 0.6908        | 3.99  | 747  | 0.6810          |
| 0.6908        | 4.0   | 748  | 0.6810          |


### Framework versions

- Transformers 4.28.0
- Pytorch 2.0.1+cu118
- Datasets 2.12.0
- Tokenizers 0.13.3

{"license": "mit", "tags": ["generated_from_trainer"], "model-index": [{"name": "gpt2-neurallinguisticpioneers", "results": []}]}
transformers pytorch tensorboard gpt2 text-generation generated_from_trainer license:mit autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #tensorboard #gpt2 #text-generation #generated_from_trainer #license-mit #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

gpt2-neurallinguisticpioneers
=============================


This model is a fine-tuned version of gpt2 on an unknown dataset.
It achieves the following results on the evaluation set:


* Loss: 0.6810


Model description
-----------------


More information needed


Intended uses & limitations
---------------------------


More information needed


Training and evaluation data
----------------------------


More information needed


Training procedure
------------------


### Training hyperparameters


The following hyperparameters were used during training:


* learning\_rate: 3e-05
* train\_batch\_size: 8
* eval\_batch\_size: 8
* seed: 42
* optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
* lr\_scheduler\_type: linear
* num\_epochs: 4


### Training results



### Framework versions


* Transformers 4.28.0
* Pytorch 2.0.1+cu118
* Datasets 2.12.0
* Tokenizers 0.13.3



### Training hyperparameters


The following hyperparameters were used during training:


* learning\_rate: 3e-05
* train\_batch\_size: 8
* eval\_batch\_size: 8
* seed: 42
* optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
* lr\_scheduler\_type: linear
* num\_epochs: 4 ### Training results ### Framework versions


* Transformers 4.28.0
* Pytorch 2.0.1+cu118
* Datasets 2.12.0
* Tokenizers 0.13.3
TAGS
#transformers #pytorch #tensorboard #gpt2 #text-generation #generated_from_trainer #license-mit #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
 ### Training hyperparameters


The following hyperparameters were used during training:


* learning\_rate: 3e-05
* train\_batch\_size: 8
* eval\_batch\_size: 8
* seed: 42
* optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
* lr\_scheduler\_type: linear
* num\_epochs: 4 ### Training results ### Framework versions


* Transformers 4.28.0
* Pytorch 2.0.1+cu118
* Datasets 2.12.0
* Tokenizers 0.13.3