vwxyzjn's picture
Update README.md
2984046
metadata
license: bigscience-openrail-m
datasets:
  - trivia_qa
language:
  - en
tags:
  - trl
  - transformers
  - rlhf

starcoderbase-triviaqa

This model is baesed on https://huggingface.co/bigcode/starcoderbase and is fine-tuned on the TriviaQA dataset using reinforcement learning via TRL's TextEnvironment (https://github.com/huggingface/trl/pull/424).

Out of Scope Use

  • Replacing human expertise

Bias, Risks, and Limitations

  • May generate answers that are incorrect or misleading.
  • May copy answers from the training data verbatim.
  • May generate language that is hateful or promotes discrimination (example).
  • May generate language that is offensive to direct or indirect users or to people or groups mentioned.

Recommendations

  • Answers should be validated through the use of external sources.
  • Disparities between the data contributors and the direct and indirect users of the technology should inform developers in assessing what constitutes an appropriate use case.
  • Further research is needed to attribute model generations to sources in the training data, especially in cases where the model copies answers from the training data.