| language: | |
| - tr | |
| base_model: | |
| - openai/clip-vit-base-patch32 | |
| tags: | |
| - lora | |
| - peft | |
| To build this finetuned CLIP using LORA on Turkish language. | |
| You can get more information (and code 🎉) on how to train or use the model on my [github]. | |
| [github]: https://github.com/kesimeg/LORA-turkish-clip | |
| # How to use the model? | |
| You can use the model like shown in below: | |
| ```Python | |
| from PIL import Image | |
| from transformers import CLIPProcessor, CLIPModel | |
| model = CLIPModel.from_pretrained("openai/clip-vit-base-patch32") | |
| model.load_adapter("kesimeg/lora-turkish-clip") | |
| model.eval() | |
| processor = CLIPProcessor.from_pretrained("openai/clip-vit-base-patch32") | |
| img = Image.open("dog.png") # A dog image | |
| inputs = processor(text=["Çimenler içinde bir köpek.","Bir köpek.","Çimenler içinde bir kuş."], images=img, return_tensors="pt", padding=True) | |
| outputs = model(**inputs) | |
| logits_per_image = outputs.logits_per_image | |
| probs = logits_per_image.softmax(dim=1) | |
| print(probs) | |
| ``` |