Update README.md
Browse files
README.md
CHANGED
|
@@ -20,7 +20,7 @@ Original reddit post: https://www.reddit.com/r/LocalLLaMA/comments/1ec0s8p/i_mad
|
|
| 20 |
I created a program to randomize the weights of a model. The program has 2 parameters: the percentage of weights to modify and the percentage of the original value to randmly apply to each weight.
|
| 21 |
|
| 22 |
At the end I check the resulting GGUF file for binary differences.
|
| 23 |
-
In this example I set to modify 100% of the weights of
|
| 24 |
|
| 25 |
Since the deviation is calculated on the F32 weights, when quantized to Q8\_0 this changes.
|
| 26 |
So, in the end I got a file that compared to the original has:
|
|
|
|
| 20 |
I created a program to randomize the weights of a model. The program has 2 parameters: the percentage of weights to modify and the percentage of the original value to randmly apply to each weight.
|
| 21 |
|
| 22 |
At the end I check the resulting GGUF file for binary differences.
|
| 23 |
+
In this example I set to modify 100% of the weights of Gemma 2b by a maximum of 15% deviation.
|
| 24 |
|
| 25 |
Since the deviation is calculated on the F32 weights, when quantized to Q8\_0 this changes.
|
| 26 |
So, in the end I got a file that compared to the original has:
|