apoorvkh
/

blip2-flan-t5-xxl-endpoint

Inference Endpoints

Model card Files Files and versions Community

blip2-flan-t5-xxl-endpoint

Commit History

Updated bitsandbytes config

e68919f

apoorvkh commited on Jun 18, 2023

Adding torch_dtype = float16

76aff17

apoorvkh commited on Jun 18, 2023

Adding cpu offloading (if necessary?)

665939a

apoorvkh commited on Jun 18, 2023

Printing device map

94d713e

apoorvkh commited on Jun 18, 2023

Create requirements.txt

1b9ada9

apoorvkh commited on Jun 18, 2023

Loading in 8-bit

5eda3fd

apoorvkh commited on Jun 18, 2023

device map fix

ca66b5c

apoorvkh commited on Jun 18, 2023

inputs to device 0 instead of cuda

2126f25

apoorvkh commited on Jun 18, 2023

to 'cuda' instead of model.device

007e4d7

apoorvkh commited on Jun 18, 2023

Upload handler.py

ca0693b

apoorvkh commited on Jun 18, 2023

initial commit

60609f1

apoorvkh commited on Jun 18, 2023