Update README.md

README.md

@@ -67,7 +67,7 @@ def generate_text(system, instruction, input=None):
     tokens = torch.LongTensor(tokens).unsqueeze(0)
     tokens = tokens.to('cuda')
 
-    instance = {'input_ids': tokens,'top_p': 1.0, 'temperature':0.7, 'generate_len': 1024}
+    instance = {'input_ids': tokens,'top_p': 1.0, 'temperature':0.7, 'generate_len': 1024, 'top_k': 50}
 
     length = len(tokens[0])
     with torch.no_grad():
@@ -77,17 +77,38 @@ def generate_text(system, instruction, input=None):
             use_cache=True, 
             do_sample=True, 
             top_p=instance['top_p'],
-            temperature=instance['temperature']
+            temperature=instance['temperature'],
+            top_k=instance['top_k']
         )    
     output = rest[0][length:]
     string = tokenizer.decode(output, skip_special_tokens=True)
-    print(f'[!] Response: {string}')
+    return f'[!] Response: {string}'
 
-# same prompt as provided by Orca Research Paper
-system = 'You are an AI assistant. User will you give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.'
-instruction = 'Use the given data to calculate the median.'
-input = '[5,2,3,4,1]'
-generate_text(system, instruction, input)
+# Sample Test Instruction Used by Youtuber Sam Witteveen https://www.youtube.com/@samwitteveenai
+system = 'You are an AI assistant that follows instruction extremely well. Help as much as you can.'
+instruction = 'Write a letter to Sam Altman, CEO of OpenAI, requesting him to convert GPT4 a private model by OpenAI to an open source project'
+print(generate_text(system, instruction))
+
+```
+
+```
+
+[!] Response:
+Dear Sam Altman,
+
+I am writing to request that you convert the GPT4 private model developed by OpenAI to an open source project. As a user of OpenAI, I have been waiting for the day when I can use the advanced natural language processing capabilities of GPT4 in a more open and accessible way.
+
+While OpenAI has made significant progress in developing AI applications, it has primarily focused on building private models that are not accessible to the general public. However, with the recent release of GPT-3, there is a growing demand for more open and accessible AI tools.
+
+Converting GPT4 to an open source project would allow for greater transparency, collaboration, and innovation. It would also help to build trust in the technology and ensure that it is used ethically and responsibly.
+
+I urge you to consider converting GPT4 to an open source project. This would be a significant contribution to the AI community and would help to create a more open and accessible future.
+
+Thank you for your consideration.
+
+Sincerely,
+
+[Your Name]
 
 ```
 
@@ -95,9 +116,8 @@ generate_text(system, instruction, input)
 
 Next Goals:
 1) Try more data like actually using FLAN-v2, just like Orka Research Paper (I am open for suggestions)
-2) Try smaller OpenLLaMA models 7B and 3B
-3) Provide more options for Text generation UI. (may be https://github.com/oobabooga/text-generation-webui)
-4) Provide 4bit GGML/GPTQ quantized model (may be [TheBloke](https://huggingface.co/TheBloke) can help here)
+2) Provide more options for Text generation UI. (may be https://github.com/oobabooga/text-generation-webui)
+3) Provide 4bit GGML/GPTQ quantized model (may be [TheBloke](https://huggingface.co/TheBloke) can help here)
 
 
 Reference: