---
license: llama3
datasets:
- THUDM/AgentInstruct
- anon8231489123/ShareGPT_Vicuna_unfiltered
language:
- en
base_model:
- meta-llama/Llama-3-8B-Instruct
---
# Model Card for Model ID

This model is trained by lora for Retrospex based on AgentInstruct and ShareGPT datasets. The base model is Llama-3-8B-Instruct.

## Model Details

### Model Description

- **Developed by:** Convai NJU
- **Shared by [optional]:** Convai NJU
- **Model type:** Llama model
- **Language(s) (NLP):** en
- **License:** llama3
- **Finetuned from model [optional]:** Llama-3-8B-Instruct

### Model Sources

- **Repository:** https://github.com/Yufei-Xiang/Retrospex.git

## Training Details

### Training Data

AgentInstruct: https://huggingface.co/datasets/THUDM/AgentInstruct

ShareGPT: https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered

#### Training Hyperparameters

- **fp16:** True
- **lr:** 2e-5
- **batch size:** 8
- **lora r:** 16
- **lora alpha:** 64 


## Citation

**BibTeX:**

@inproceedings{yufei2024retrospex,\\
  title={Retrospex: Language Agent Meets Offline Reinforcement Learning Critic},\\
  author={Yufei Xiang, Yiqun Shen, Yeqin Zhang and Cam-Tu Nguyen},\\
  booktitle={Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, {EMNLP},\\
  year={2024}\\
}