agemagician
commited on
Commit
•
52aab73
1
Parent(s):
5160645
Update README.md
Browse filesfix activation function
README.md
CHANGED
@@ -22,7 +22,9 @@ ANKH2-Large is based on the `ANKH-Large` model and was pretrained on a large cor
|
|
22 |
This means it was pretrained on the raw protein sequences only, with no humans labelling them in any way (which is why it can use lots of
|
23 |
publicly available data) with an automatic process to generate inputs and labels from those protein sequences.
|
24 |
|
25 |
-
|
|
|
|
|
26 |
|
27 |
It has been shown that the features extracted from this self-supervised model (LM-embeddings) captured important biophysical properties governing protein shape.
|
28 |
shape.
|
|
|
22 |
This means it was pretrained on the raw protein sequences only, with no humans labelling them in any way (which is why it can use lots of
|
23 |
publicly available data) with an automatic process to generate inputs and labels from those protein sequences.
|
24 |
|
25 |
+
Two important differences between this ANKH2-Large model and the original ANKH-Large version are:
|
26 |
+
1. The model was trained with more number of epochs.
|
27 |
+
2. The activation function changed to silu.
|
28 |
|
29 |
It has been shown that the features extracted from this self-supervised model (LM-embeddings) captured important biophysical properties governing protein shape.
|
30 |
shape.
|