Update README.md
Browse files
README.md
CHANGED
@@ -28,7 +28,7 @@ metrics:
|
|
28 |
## Setup
|
29 |
|
30 |
You can run the smashed model on a A100 GPU by:
|
31 |
-
1. Installing and importing the `pruna-engine` (version 0.2.
|
32 |
2. Downloading the model files at `model_path`. This can be done using huggingface with this repository name or with manual downloading.
|
33 |
3. Loading the model
|
34 |
4. Running the model.
|
@@ -42,7 +42,7 @@ from pruna_engine.PrunaModel import PrunaModel # Step (1): install and import `
|
|
42 |
...
|
43 |
model_path = cached_file("PrunaAI/segmind-SSD-1B-smashed", "model") # Step (2): download the model files at `model_path`.
|
44 |
smashed_model = PrunaModel.load_model(model_path) # Step (3): load the model.
|
45 |
-
y = smashed_model(prompt="a
|
46 |
```
|
47 |
|
48 |
## Configurations
|
|
|
28 |
## Setup
|
29 |
|
30 |
You can run the smashed model on a A100 GPU by:
|
31 |
+
1. Installing and importing the `pruna-engine` (version 0.2.7) package. Use `pip install pruna --extra-index-url https://pypi.nvidia.com --extra-index-url https://pypi.ngc.nvidia.com` for installation. See [Pypi](https://pypi.org/project/pruna-engine/) for detailed on the package.
|
32 |
2. Downloading the model files at `model_path`. This can be done using huggingface with this repository name or with manual downloading.
|
33 |
3. Loading the model
|
34 |
4. Running the model.
|
|
|
42 |
...
|
43 |
model_path = cached_file("PrunaAI/segmind-SSD-1B-smashed", "model") # Step (2): download the model files at `model_path`.
|
44 |
smashed_model = PrunaModel.load_model(model_path) # Step (3): load the model.
|
45 |
+
y = smashed_model(prompt="a silly prune with a face in high definition", image_height=1024, image_width=1024)[0] # Step (4): run the model.
|
46 |
```
|
47 |
|
48 |
## Configurations
|