Update README.md
Browse files
README.md
CHANGED
@@ -52,10 +52,10 @@ To preprocess the data there were three options we considered:
|
|
52 |
- The last option was to use <a href="https://ai.googleblog.com/2020/12/mediapipe-holistic-simultaneous-face.html">MediaPipe Holistic</a> to provide pose face and hand landmarks to the ControlNet. This method was promising in theory, however, the HaGRID dataset was not suitable for this method as the Holistic model performs poorly with partial body and obscurely cropped images.
|
53 |
|
54 |
We anecdotally determined that when trained at lower steps the encoded hand model performed better than the standard MediaPipe model due to implied handedness. We theorize that with a larger dataset of more full-body hand and pose classifications, Holistic landmarks will provide the best images in the future however for the moment the hand-encoded model performs best.
|
55 |
-
This repo contain the weight of
|
56 |
## Dataset
|
57 |
|
58 |
-
[Dataset for Hand Encoding Mode](https://huggingface.co/datasets/MakiPan/hagrid250k-blip2)
|
59 |
|
60 |
|
61 |
## Examples
|
|
|
52 |
- The last option was to use <a href="https://ai.googleblog.com/2020/12/mediapipe-holistic-simultaneous-face.html">MediaPipe Holistic</a> to provide pose face and hand landmarks to the ControlNet. This method was promising in theory, however, the HaGRID dataset was not suitable for this method as the Holistic model performs poorly with partial body and obscurely cropped images.
|
53 |
|
54 |
We anecdotally determined that when trained at lower steps the encoded hand model performed better than the standard MediaPipe model due to implied handedness. We theorize that with a larger dataset of more full-body hand and pose classifications, Holistic landmarks will provide the best images in the future however for the moment the hand-encoded model performs best.
|
55 |
+
This repo contain the weight of **Encoded hand ControlNet model**
|
56 |
## Dataset
|
57 |
|
58 |
+
130k image [Dataset for Hand Encoding Mode](https://huggingface.co/datasets/MakiPan/hagrid250k-blip2)
|
59 |
|
60 |
|
61 |
## Examples
|