teowu commited on
Commit
88d2311
1 Parent(s): ffa96e2

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ Use `transformers==4.36.1`. Preview version only.
3
+
4
+ This model has reached 75.99\% accuracy on Q-Bench A1 *test* (multi-choice questions), notably superior than GPT-4V (73.44\%).
5
+
6
+ ### Load Model
7
+
8
+ ```python
9
+ import torch
10
+ from transformers import AutoModelForCausalLM
11
+
12
+ model = AutoModelForCausalLM.from_pretrained("q-future/co-instruct-preview",
13
+ trust_remote_code=True,
14
+ torch_dtype=torch.float16,
15
+ device_map={"":"cuda:0"})
16
+ ```
17
+
18
+ ### Chat
19
+
20
+ ```python
21
+ import requests
22
+ from PIL import Image
23
+
24
+
25
+ ### Single Image
26
+ prompt = "USER: The image: <|image|> Which happens in this image: motion-blur, over-exposure, or under-exposure? ASSISTANT:"
27
+ url = "https://raw.githubusercontent.com/Q-Future/Q-Align/main/fig/singapore_flyer.jpg"
28
+ image = Image.open(requests.get(url,stream=True).raw)
29
+ model.chat(prompt, [image], max_new_tokens=200)
30
+
31
+ ## Motion blur
32
+
33
+ ### Double Image Comparison
34
+ prompt_cmp = "USER: The first image: <|image|>\nThe second image: <|image|>Which image has better quality, and why? ASSISTANT:"
35
+ url = "https://raw.githubusercontent.com/Q-Future/Q-Align/main/fig/boy_colorful.jpg"
36
+ image_2 = Image.open(requests.get(url,stream=True).raw)
37
+ model.chat(prompt_cmp, [image, image_2], max_new_tokens=200)
38
+
39
+ ## The second image has better quality. The description indicates that the image has accurate exposure, precise focus, clear details, rich colors, and sufficient lighting. Additionally, the texture details are clear, and the composition is centered. In comparison, the first image has good clarity and rich texture details, but the lighting is slightly weak, which can affect the overall quality of the image. Therefore, the second image is of higher quality due to its accurate exposure, precise focus, clear details, rich colors, sufficient lighting, and centered composition.
40
+
41
+ ```