fastapi-mixtral-46.7b

Sleeping

OjciecTadeusz commited on 22 days ago

Commit

f01378a

•

1 Parent(s): ce5d4ab

Update main.py

Files changed (1) hide show

main.py CHANGED Viewed

@@ -57,6 +57,7 @@ def generate(item: Item):
         # Check if response has the attribute 'token'
         if hasattr(response, 'tokens'):
             output += response.token.text
         else:
             output += response  # If not, treat it as a string

         # Check if response has the attribute 'token'
         if hasattr(response, 'tokens'):
+            print('tokens')
             output += response.token.text
         else:
             output += response  # If not, treat it as a string