Spaces:
Duplicated from radinhas/hf-llm-api

DHEIVER
/

hf-llm-api-pt

Running

App Files Files Community

hf-llm-api-pt / networks /message_streamer.py

Commit History

:pencil: [Doc] Readme for features, and comments for references

e820e51

Hansimov commited on Dec 20, 2023

:zap: [Enhance] Cleaner logger output

b96cef7

Hansimov commited on Dec 20, 2023

:zap: [Enhance] New models: mistral-7b and openchat-3.5

e916990

Hansimov commited on Dec 20, 2023

:zap: [Enhance] OSLogger: Re-wrap for better syntax check, and move stream log to debug

047008b

Hansimov commited on Dec 20, 2023

:pencil: [Comment] References of requests params

395ee29

Hansimov commited on Dec 20, 2023

:zap: [Enhance] Default models and max_new_tokens

6aa8b86

Hansimov commited on Dec 20, 2023

:zap: [Enhance] API: Ensure temperature to be positive

3dfcb72

Hansimov commited on Dec 19, 2023

:gem: [Feature] New ArgParser: Specify server ip, port and running mode

e28221f

Hansimov commited on Dec 19, 2023

:gem: [Feature] New MessageStreamer: Enable requests inference api with requests

9f341cc

Hansimov commited on Dec 19, 2023