Zabriskije
commited on
Commit
•
805c6f6
1
Parent(s):
7cd9086
Update README.md
Browse files
README.md
CHANGED
@@ -5,90 +5,67 @@ tags:
|
|
5 |
- stable-diffusion
|
6 |
- text-to-image
|
7 |
---
|
8 |
-
|
9 |
-
|
10 |
-
|
11 |
-
|
12 |
-
|
13 |
-
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
#
|
18 |
-
|
19 |
-
|
20 |
-
|
21 |
-
|
22 |
-
<
|
23 |
-
|
24 |
-
|
25 |
-
<
|
26 |
-
|
27 |
-
|
28 |
-
|
29 |
-
|
30 |
-
|
31 |
-
|
32 |
-
|
33 |
-
|
34 |
-
|
35 |
-
|
36 |
-
|
37 |
-
|
38 |
-
|
39 |
-
|
40 |
-
|
41 |
-
-
|
42 |
-
|
43 |
-
|
44 |
-
|
45 |
-
|
46 |
-
|
47 |
-
|
48 |
-
|
49 |
-
|
50 |
-
|
51 |
-
|
52 |
-
|
53 |
-
|
54 |
-
|
55 |
-
|
56 |
-
|
57 |
-
|
58 |
-
|
59 |
-
|
60 |
-
|
61 |
-
|
62 |
-
|
63 |
-
-
|
64 |
-
|
65 |
-
|
66 |
-
- 2B Nier Automata (Don't ask us why)
|
67 |
-
- different body types - different ethnicity
|
68 |
-
- nsfw portraits, full body poses, close ups, etc
|
69 |
-
|
70 |
-
## What it "In theory" shouldn't exceed at:
|
71 |
-
- anything outside the scope of portraits, people, landscapes, game artworks, 3D sculptures, 3D fantasy, 3D film stills, etc
|
72 |
-
- celebrities
|
73 |
-
- highly specific animated cartoon characters
|
74 |
-
- multiple subjects
|
75 |
-
- highly specific video-game characters
|
76 |
-
- pornography, genitalia and highly explicit materials
|
77 |
-
|
78 |
-
<img width="768px" src="https://cdn.discordapp.com/attachments/1056287982363086930/1056331346177425438/00011-3928902726-A203d20render20of2020epic20portrait20close20shot20of20beautiful20turkish20woman20wearing20with20angelic20feathered20wings20gold20armour20neckline.png">
|
79 |
-
<img width="768px" src="https://cdn.discordapp.com/attachments/323893037379878912/1056823178846031882/00494-2262985444-3d_render_of_a_sharp_focused_detailed_photo_of_a_super_car_with_iridescent_metallic_color_driving_on_a_midnight_road_multicolo.png">
|
80 |
-
<img width="768px" src="https://media.discordapp.net/attachments/1056287982363086930/1056387208900268062/00102-971809704-movie_still_of_a_alien_from_mass_effect_wearing_scifi_armor_disney_pixar_animation_3d_render_4k_resolution_very_detail.png">
|
81 |
-
<img width="768px" src="https://cdn.discordapp.com/attachments/1056287982363086930/1056399456695767151/00143-556286556-3d_render_of_a_cute_simba_from_the_lion_king_disney_pixar_animation_RDR_2_game_render_lion_king_movie_still_very_detailed_4.png">
|
82 |
-
<img width="768px" src="https://media.discordapp.net/attachments/1056287982363086930/1056385527907110963/00097-3269033961-picture_of_a_handsome_viking_chief_in_his_village_disney_pixar_animation_3d_render_4k_resolution_very_detailed_movie_stil.png?width=645&height=806">
|
83 |
-
<img width="768px" src="https://cdn.discordapp.com/attachments/1056287982363086930/1056340815011659917/02082-2709311262-A_3d_render_of_a_cute_tiny_little_fluffy_monster_with_googly_eyes_running_in_a_huge_bedroom_antview_bokeh_closeup_highly_det.png">
|
84 |
-
<img width="768px" src="https://media.discordapp.net/attachments/1051410188592226364/1056636097330942022/02045-172340656-A_3d_render_of_A_mature_woman_with_short_styled_hair_and_wearing_a_colorful_printed_blouse_seated_in_a_cozy_armchair_with_a_wa.png">
|
85 |
-
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1056636096412389508/02029-172340656-A_3d_cartoon_of_A_mature_woman_with_short_styled_hair_and_wearing_a_colorful_printed_blouse_seated_in_a_cozy_armchair_with_a.png">
|
86 |
-
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1056636286347247616/01925-2050823061-A_woman_with_short_bobbed_hair_styled_in_a_choppy_textured_look_wearing_a_cyberpunk-inspired_outfit_with_neon_accents_and_boo.png">
|
87 |
-
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1056636296103198740/01858-1327022461-A_slender_woman_with_pale_skin_short_blonde_hair_and_bright_blue_eyes._She_is_standing_in_a_bright_white_studio_surrounded_by.png">
|
88 |
-
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1056636414059618406/02107-599009770-A_3d_cartoon_of_a_a_beautiful_spanish_woman_wearing_Kimono_neckline_fine_-_art_photography_cinematic_portrait_shot_8_k_mid.png">
|
89 |
-
|
90 |
-
## Use Restrictions
|
91 |
You agree not to use the Model or Derivatives of the Model:
|
|
|
|
|
92 |
- In any way that violates any applicable national, federal, state, local or international law or regulation;
|
93 |
- For the purpose of exploiting, harming or attempting to exploit or harm minors in any way;
|
94 |
- To generate or disseminate verifiably false information and/or content with the purpose of harming others;
|
@@ -100,15 +77,22 @@ You agree not to use the Model or Derivatives of the Model:
|
|
100 |
- For any use intended to or which has the effect of discriminating against individuals or groups based on legally protected characteristics or categories;
|
101 |
- To provide medical advice and medical results interpretation;
|
102 |
- To generate or disseminate information for the purpose to be used for administration of justice, law enforcement, immigration or asylum processes, such as predicting an individual will commit fraud/crime commitment (e.g. by text profiling, drawing causal relationships between assertions made in documents, indiscriminate and arbitrarily-targeted use).
|
|
|
|
|
103 |
## Important notes:
|
104 |
-
- This model’s datasets do NOT contain any character that could be remotely described as a child, or underage.
|
105 |
- Our datasets contains no mentions of the artist's name, nor specific styles from any artist whatsoever.
|
106 |
-
- The creators (
|
107 |
- The purpose of this model isn't to replicate a style, but to provide a useful tool to creators of all kinds to generate 3D related contents
|
108 |
- Be advised that this model can generate explicit material and therefore shouldn't be used in any way to cause harm or produce non-consensual sexual content.
|
109 |
|
110 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
111 |
|
112 |
-
|
113 |
-
|
114 |
-
https://www.
|
|
|
5 |
- stable-diffusion
|
6 |
- text-to-image
|
7 |
---
|
8 |
+
|
9 |
+
# Core ML converted model
|
10 |
+
|
11 |
+
This model was converted to Core ML for use on Apple Silicon devices by following Apple's instructions [here](https://github.com/apple/ml-stable-diffusion#-converting-models-to-core-ml).\
|
12 |
+
Provide the model to an app such as [Mochi Diffusion](https://github.com/godly-devotion/MochiDiffusion) to generate images.
|
13 |
+
|
14 |
+
`split_einsum` versions are compatible with all compute units.\
|
15 |
+
`original` versions are only compatible with `CPU & GPU`.
|
16 |
+
|
17 |
+
# 3DKX V2
|
18 |
+
|
19 |
+
Sources: [Hugging Face](https://huggingface.co/unvailai/3DKX_V2) - [CivitAI](https://civitai.com/models/2504/handas-3dkx-11)
|
20 |
+
|
21 |
+
<img width="604px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076941914538004581/ezgif-3-7ac098980a.gif">
|
22 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932535445098626/1.png">
|
23 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932536120385657/2.png">
|
24 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932536795664405/3.png">
|
25 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932537416433835/4.png">
|
26 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932538041372782/5.png">
|
27 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932538783768626/6.png">
|
28 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932539664580688/7.png">
|
29 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932540327268413/8.png">
|
30 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932541052895292/9.png">
|
31 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932541614923818/10.png">
|
32 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932544534151178/11.png">
|
33 |
+
<img width="768px" src="https://cdn.discordapp.com/attachments/1051410188592226364/1076932545117179924/12.png">
|
34 |
+
|
35 |
+
|
36 |
+
## Model Description
|
37 |
+
|
38 |
+
<!-- Provide a longer summary of what this model is. -->
|
39 |
+
|
40 |
+
3DKX V2 is a model that was trained on highly detailed 3D rendered pictures of various subjects such as landscapes, scenes, models, textures, and more.
|
41 |
+
Our aim is to provide a useful tool that can produce consistent and high-resolution renders for creative purposes such as storyboarding, sketching, templates, wallpapers, and more.
|
42 |
+
|
43 |
+
- **Created By:** Unvail ai
|
44 |
+
- **Language(s) (NLP):** English
|
45 |
+
- **License:** **Modified** creativeml-openrail-m
|
46 |
+
- **Finetuned from model:** SimpMaker 3k3
|
47 |
+
|
48 |
+
|
49 |
+
# Uses
|
50 |
+
|
51 |
+
<!-- 3DKX is a model that was trained on highly detailed 3D rendered pictures of various subjects such as landscapes, scenes, models, textures, and more.
|
52 |
+
Our aim is to provide a useful tool that can produce consistent and high-resolution renders for creative purposes such as storyboarding, sketching, templates, wallpapers, and more. -->
|
53 |
+
- 3D renders, cartoony or realistic
|
54 |
+
- Landscapes
|
55 |
+
- Scenery
|
56 |
+
- Fantasy, creatures, RPG renders
|
57 |
+
- Portraits
|
58 |
+
- Dramatic scenes, horror, dark, obscure
|
59 |
+
|
60 |
+
## Get started with the model, use our cheat sheet !
|
61 |
+
|
62 |
+
Use the guide in the link below to get started with the model !
|
63 |
+
[3DKX_V2 Presentation/Guide](https://docs.google.com/presentation/d/1zG-pvw47ZRO9JjCkU3B2YbcYNwOHoNQ27qN6h-Xs0mM)
|
64 |
+
|
65 |
+
## License & User Restrictions
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
66 |
You agree not to use the Model or Derivatives of the Model:
|
67 |
+
- To host, finetune, or do inference with the model or its derivatives on websites/apps/etc. If you want to, please email us at [email protected]
|
68 |
+
- Not to use this outputs of this model commercially if you are an organization/team of 10 members or more.
|
69 |
- In any way that violates any applicable national, federal, state, local or international law or regulation;
|
70 |
- For the purpose of exploiting, harming or attempting to exploit or harm minors in any way;
|
71 |
- To generate or disseminate verifiably false information and/or content with the purpose of harming others;
|
|
|
77 |
- For any use intended to or which has the effect of discriminating against individuals or groups based on legally protected characteristics or categories;
|
78 |
- To provide medical advice and medical results interpretation;
|
79 |
- To generate or disseminate information for the purpose to be used for administration of justice, law enforcement, immigration or asylum processes, such as predicting an individual will commit fraud/crime commitment (e.g. by text profiling, drawing causal relationships between assertions made in documents, indiscriminate and arbitrarily-targeted use).
|
80 |
+
Note: All derivatives of our model created by users **must** include the same license & user agreements.
|
81 |
+
|
82 |
## Important notes:
|
|
|
83 |
- Our datasets contains no mentions of the artist's name, nor specific styles from any artist whatsoever.
|
84 |
+
- The creators (unvail ai) will not be held accountable for the way this model is being used or the outputs that any person may generate.
|
85 |
- The purpose of this model isn't to replicate a style, but to provide a useful tool to creators of all kinds to generate 3D related contents
|
86 |
- Be advised that this model can generate explicit material and therefore shouldn't be used in any way to cause harm or produce non-consensual sexual content.
|
87 |
|
88 |
+
# Training Details
|
89 |
+
|
90 |
+
**Base Model**: SD 1.5
|
91 |
+
**Steps**: 15,000
|
92 |
+
**Training Method**: Finetuning
|
93 |
+
**Trigger Keywords**: None really, but the main styles trained are "3d render" and "3d cartoon" see our presentation slide for more details.
|
94 |
+
|
95 |
|
96 |
+
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
97 |
+
Big shoutout to this new code that allowed us to fix the diffusion noise, allowing for more depth, contrast, and white level balance in the outputs.
|
98 |
+
https://www.crosslabs.org//blog/diffusion-with-offset-noise
|