
My second try at training. Same idea as my first run, falcon-40b with oasst1 dataset.

Did some weird things with putting a suffix after the input sequence. 

Had a play with MLflow.

Ran on 1xH100 this time to compare to the A100 experience.

Very much an experiment, use at your own risk!
{"license": "apache-2.0", "datasets": ["OpenAssistant/oasst1"]}
dataset:OpenAssistant/oasst1 license:apache-2.0 region:us
TAGS
#dataset-OpenAssistant/oasst1 #license-apache-2.0 #region-us 


My second try at training. Same idea as my first run, falcon-40b with oasst1 dataset.

Did some weird things with putting a suffix after the input sequence. 

Had a play with MLflow.

Ran on 1xH100 this time to compare to the A100 experience.

Very much an experiment, use at your own risk!
TAGS
#dataset-OpenAssistant/oasst1 #license-apache-2.0 #region-us 
