Zabriskije commited on
Commit
805c6f6
1 Parent(s): 7cd9086

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +73 -89
README.md CHANGED
@@ -5,90 +5,67 @@ tags:
5
  - stable-diffusion
6
  - text-to-image
7
  ---
8
- # Core ML Converted Model:
9
-
10
- - This model was converted to [Core ML for use on Apple Silicon devices](https://github.com/apple/ml-stable-diffusion). Conversion instructions can be found [here](https://github.com/godly-devotion/MochiDiffusion/wiki/How-to-convert-ckpt-or-safetensors-files-to-Core-ML).<br>
11
- - Provide the model to an app such as Mochi Diffusion [Github](https://github.com/godly-devotion/MochiDiffusion) - [Discord](https://discord.gg/x2kartzxGv) to generate images.<br>
12
- - `split_einsum` version is compatible with all compute unit options including Neural Engine.<br>
13
- - `original` version is only compatible with CPU & GPU option.<br>
14
- - `vae` tagged files have a vae embedded into the model. Most common are 1.5 or 2.1 others are named accordingly.<br>
15
- - Descriptions are posted as-is from original model source. Not all features and/or results may be available in CoreML format.<br>
16
-
17
- # Note: Some models do not have the [unet split into chunks](https://github.com/apple/ml-stable-diffusion#-converting-models-to-core-ml).
18
-
19
- # H&A 3DKX:
20
- Source(s): [Hugging Face](https://huggingface.co/HavoAloe/3DKX_1.0b) - [CivitAI](https://civitai.com/models/2504/handas-3dkx-11)
21
-
22
- <a href="https://discord.gg/havonaloe">
23
- <img src="https://cdn.discordapp.com/attachments/1051410188592226364/1061335270194171944/havo_aloe_banner_copie.jpg" alt="image description" width="768">
24
- </a>
25
- <a href="https://www.patreon.com/aloeNhavo">
26
- <img src="https://cdn.discordapp.com/attachments/1051410188592226364/1061335270483566662/havo_aloe_banner_patreon.jpg" alt="image description" width="768">
27
- </a>
28
-
29
-
30
-
31
- Model name: H&A 3DKX
32
- Model versions: 1.0b, 1.1(latest)
33
-
34
- ## Changelog:
35
- V1.1: Minor update based on feedback, containing the following fixes:
36
-
37
- -“nsfw”, “nudity” , and “erotica” have been trained into the model and work as Negatives to greatly reduce unintended NSFW content.
38
-
39
- - CFG can be pushed a bit higher before the images become burnt. As a result, the model can accommodate more complicated prompts now.
40
-
41
- - Oversaturated images will be encountered way less often
42
-
43
- ## Description:
44
-
45
- SFW model with limited nsfw capabilities (suggestive nsfw) that is highly versatile for 3D renders.
46
- The model has the particularity of splitting itself into two different well balanced styles.
47
- If you'd like to have your 3D characters have a more "Cartoony" face, you simply start your prompt
48
- with "3d cartoon of", and if you want the classic 3D render style, you write "a 3d render of".
49
-
50
- Please check the cheat sheet for prompting tips as the structure of the prompt and negatives used has a huge effect.
51
- Note: Model has an embedded VAE, so do not add one with this model. It will be the best in most cases, and configured for higher resolutions.
52
-
53
- ## Model has an embedded VAE, do not use an extra one!
54
- If you want to chat with us and join our community visit our discord:
55
- https://discord.gg/CPyqJgXdRG
56
- ## Dataset:
57
- - between 140 and 180 pictures of 3D render of all kind
58
-
59
- ## PromptGuide/Cheat Sheet
60
- [3DKX_1.0b/1.1 Guide](https://docs.google.com/document/d/15pJ3TkbmX3LRoSTNsMYsbetvO7A46L60wVOxIL2ZZ6E/)
61
-
62
- ## Has a high success rate at:
63
- - sfw portraits, full body poses, close ups, etc
64
- - high versatility in terms of outputs, it isn't locked to perform well on portraits
65
- - Landscapes, cyberpunk, steampunk, natural, scifi, etc
66
- - 2B Nier Automata (Don't ask us why)
67
- - different body types - different ethnicity
68
- - nsfw portraits, full body poses, close ups, etc
69
-
70
- ## What it "In theory" shouldn't exceed at:
71
- - anything outside the scope of portraits, people, landscapes, game artworks, 3D sculptures, 3D fantasy, 3D film stills, etc
72
- - celebrities
73
- - highly specific animated cartoon characters
74
- - multiple subjects
75
- - highly specific video-game characters
76
- - pornography, genitalia and highly explicit materials
77
-
78
- <img width="768px" src="https://cdn.discordapp.com/attachments/1056287982363086930/1056331346177425438/00011-3928902726-A203d20render20of2020epic20portrait20close20shot20of20beautiful20turkish20woman20wearing20with20angelic20feathered20wings20gold20armour20neckline.png">
79
- <img width="768px" src="https://cdn.discordapp.com/attachments/323893037379878912/1056823178846031882/00494-2262985444-3d_render_of_a_sharp_focused_detailed_photo_of_a_super_car_with_iridescent_metallic_color_driving_on_a_midnight_road_multicolo.png">
80
- <img width="768px" src="https://media.discordapp.net/attachments/1056287982363086930/1056387208900268062/00102-971809704-movie_still_of_a_alien_from_mass_effect_wearing_scifi_armor_disney_pixar_animation_3d_render_4k_resolution_very_detail.png">
81
- <img width="768px" src="https://cdn.discordapp.com/attachments/1056287982363086930/1056399456695767151/00143-556286556-3d_render_of_a_cute_simba_from_the_lion_king_disney_pixar_animation_RDR_2_game_render_lion_king_movie_still_very_detailed_4.png">
82
- <img width="768px" src="https://media.discordapp.net/attachments/1056287982363086930/1056385527907110963/00097-3269033961-picture_of_a_handsome_viking_chief_in_his_village_disney_pixar_animation_3d_render_4k_resolution_very_detailed_movie_stil.png?width=645&height=806">
83
- <img width="768px" src="https://cdn.discordapp.com/attachments/1056287982363086930/1056340815011659917/02082-2709311262-A_3d_render_of_a_cute_tiny_little_fluffy_monster_with_googly_eyes_running_in_a_huge_bedroom_antview_bokeh_closeup_highly_det.png">
84
- <img width="768px" src="https://media.discordapp.net/attachments/1051410188592226364/1056636097330942022/02045-172340656-A_3d_render_of_A_mature_woman_with_short_styled_hair_and_wearing_a_colorful_printed_blouse_seated_in_a_cozy_armchair_with_a_wa.png">
85
- <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1056636096412389508/02029-172340656-A_3d_cartoon_of_A_mature_woman_with_short_styled_hair_and_wearing_a_colorful_printed_blouse_seated_in_a_cozy_armchair_with_a.png">
86
- <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1056636286347247616/01925-2050823061-A_woman_with_short_bobbed_hair_styled_in_a_choppy_textured_look_wearing_a_cyberpunk-inspired_outfit_with_neon_accents_and_boo.png">
87
- <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1056636296103198740/01858-1327022461-A_slender_woman_with_pale_skin_short_blonde_hair_and_bright_blue_eyes._She_is_standing_in_a_bright_white_studio_surrounded_by.png">
88
- <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1056636414059618406/02107-599009770-A_3d_cartoon_of_a_a_beautiful_spanish_woman_wearing_Kimono_neckline_fine_-_art_photography_cinematic_portrait_shot_8_k_mid.png">
89
-
90
- ## Use Restrictions
91
  You agree not to use the Model or Derivatives of the Model:
 
 
92
  - In any way that violates any applicable national, federal, state, local or international law or regulation;
93
  - For the purpose of exploiting, harming or attempting to exploit or harm minors in any way;
94
  - To generate or disseminate verifiably false information and/or content with the purpose of harming others;
@@ -100,15 +77,22 @@ You agree not to use the Model or Derivatives of the Model:
100
  - For any use intended to or which has the effect of discriminating against individuals or groups based on legally protected characteristics or categories;
101
  - To provide medical advice and medical results interpretation;
102
  - To generate or disseminate information for the purpose to be used for administration of justice, law enforcement, immigration or asylum processes, such as predicting an individual will commit fraud/crime commitment (e.g. by text profiling, drawing causal relationships between assertions made in documents, indiscriminate and arbitrarily-targeted use).
 
 
103
  ## Important notes:
104
- - This model’s datasets do NOT contain any character that could be remotely described as a child, or underage.
105
  - Our datasets contains no mentions of the artist's name, nor specific styles from any artist whatsoever.
106
- - The creators (Havo and Aloe Vera) will not be held accountable for the way this model is being used or the outputs that any person may generate.
107
  - The purpose of this model isn't to replicate a style, but to provide a useful tool to creators of all kinds to generate 3D related contents
108
  - Be advised that this model can generate explicit material and therefore shouldn't be used in any way to cause harm or produce non-consensual sexual content.
109
 
110
- ## Conclusion:
 
 
 
 
 
 
111
 
112
- We do have limited resources, so our weeks worth of testing cannot realistically encapsulate the full potential of the model. Which is why we're very excited to discover that YOU, the awesome creators will make out of this tool. And for anyone that feels like we're worth a shot, we invite you to please have a look at our Patreon in which you can choose to chip in and support our work.
113
- We have many plans and we'd like to have some more resources that will allow us to work more efficiently and to eventually be able to create models of professional standards. It's our goal !
114
- https://www.patreon.com/aloeNhavo
 
5
  - stable-diffusion
6
  - text-to-image
7
  ---
8
+
9
+ # Core ML converted model
10
+
11
+ This model was converted to Core ML for use on Apple Silicon devices by following Apple's instructions [here](https://github.com/apple/ml-stable-diffusion#-converting-models-to-core-ml).\
12
+ Provide the model to an app such as [Mochi Diffusion](https://github.com/godly-devotion/MochiDiffusion) to generate images.
13
+
14
+ `split_einsum` versions are compatible with all compute units.\
15
+ `original` versions are only compatible with `CPU & GPU`.
16
+
17
+ # 3DKX V2
18
+
19
+ Sources: [Hugging Face](https://huggingface.co/unvailai/3DKX_V2) - [CivitAI](https://civitai.com/models/2504/handas-3dkx-11)
20
+
21
+ <img width="604px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076941914538004581/ezgif-3-7ac098980a.gif">
22
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932535445098626/1.png">
23
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932536120385657/2.png">
24
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932536795664405/3.png">
25
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932537416433835/4.png">
26
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932538041372782/5.png">
27
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932538783768626/6.png">
28
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932539664580688/7.png">
29
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932540327268413/8.png">
30
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932541052895292/9.png">
31
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932541614923818/10.png">
32
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932544534151178/11.png">
33
+ <img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932545117179924/12.png">
34
+
35
+
36
+ ## Model Description
37
+
38
+ <!-- Provide a longer summary of what this model is. -->
39
+
40
+ 3DKX V2 is a model that was trained on highly detailed 3D rendered pictures of various subjects such as landscapes, scenes, models, textures, and more.
41
+ Our aim is to provide a useful tool that can produce consistent and high-resolution renders for creative purposes such as storyboarding, sketching, templates, wallpapers, and more.
42
+
43
+ - **Created By:** Unvail ai
44
+ - **Language(s) (NLP):** English
45
+ - **License:** **Modified** creativeml-openrail-m
46
+ - **Finetuned from model:** SimpMaker 3k3
47
+
48
+
49
+ # Uses
50
+
51
+ <!-- 3DKX is a model that was trained on highly detailed 3D rendered pictures of various subjects such as landscapes, scenes, models, textures, and more.
52
+ Our aim is to provide a useful tool that can produce consistent and high-resolution renders for creative purposes such as storyboarding, sketching, templates, wallpapers, and more. -->
53
+ - 3D renders, cartoony or realistic
54
+ - Landscapes
55
+ - Scenery
56
+ - Fantasy, creatures, RPG renders
57
+ - Portraits
58
+ - Dramatic scenes, horror, dark, obscure
59
+
60
+ ## Get started with the model, use our cheat sheet !
61
+
62
+ Use the guide in the link below to get started with the model !
63
+ [3DKX_V2 Presentation/Guide](https://docs.google.com/presentation/d/1zG-pvw47ZRO9JjCkU3B2YbcYNwOHoNQ27qN6h-Xs0mM)
64
+
65
+ ## License & User Restrictions
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
66
  You agree not to use the Model or Derivatives of the Model:
67
+ - To host, finetune, or do inference with the model or its derivatives on websites/apps/etc. If you want to, please email us at [email protected]
68
+ - Not to use this outputs of this model commercially if you are an organization/team of 10 members or more.
69
  - In any way that violates any applicable national, federal, state, local or international law or regulation;
70
  - For the purpose of exploiting, harming or attempting to exploit or harm minors in any way;
71
  - To generate or disseminate verifiably false information and/or content with the purpose of harming others;
 
77
  - For any use intended to or which has the effect of discriminating against individuals or groups based on legally protected characteristics or categories;
78
  - To provide medical advice and medical results interpretation;
79
  - To generate or disseminate information for the purpose to be used for administration of justice, law enforcement, immigration or asylum processes, such as predicting an individual will commit fraud/crime commitment (e.g. by text profiling, drawing causal relationships between assertions made in documents, indiscriminate and arbitrarily-targeted use).
80
+ Note: All derivatives of our model created by users **must** include the same license & user agreements.
81
+
82
  ## Important notes:
 
83
  - Our datasets contains no mentions of the artist's name, nor specific styles from any artist whatsoever.
84
+ - The creators (unvail ai) will not be held accountable for the way this model is being used or the outputs that any person may generate.
85
  - The purpose of this model isn't to replicate a style, but to provide a useful tool to creators of all kinds to generate 3D related contents
86
  - Be advised that this model can generate explicit material and therefore shouldn't be used in any way to cause harm or produce non-consensual sexual content.
87
 
88
+ # Training Details
89
+
90
+ **Base Model**: SD 1.5
91
+ **Steps**: 15,000
92
+ **Training Method**: Finetuning
93
+ **Trigger Keywords**: None really, but the main styles trained are "3d render" and "3d cartoon" see our presentation slide for more details.
94
+
95
 
96
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
97
+ Big shoutout to this new code that allowed us to fix the diffusion noise, allowing for more depth, contrast, and white level balance in the outputs.
98
+ https://www.crosslabs.org//blog/diffusion-with-offset-noise