hf-llm-api / networks

Commit History

:zap: [Enhance] Default models and max_new_tokens
6aa8b86

Hansimov commited on

:zap: [Enhance] API: Ensure temperature to be positive
3dfcb72

Hansimov commited on

:gem: [Feature] New ArgParser: Specify server ip, port and running mode
e28221f

Hansimov commited on

:gem: [Feature] New MessageStreamer: Enable requests inference api with requests
9f341cc

Hansimov commited on