longchat 13b 16k Model Card Usage Please use load model from FastChat or LongChat repo to load the model (or chatting API from FastChat). There is a monkey patch needed to use the model. Usage referece: (LongChat) python3 eval.py model name or path lmsys/longchat 13b 16k task topics (FastChat) python3 m fastchat.serve.cli model path lmsys/longchat 13b 16k Under the hood, the monkey patch is added in: https://github.com/lm sys/FastChat/blob/da0641e567cf93756b0978ab5a6b092e96f06240/fastchat/model/model adapter.py L429 Model details Model type: longchat 13b 16k is an open source chatbot trained by fine tuning llama 13b on user shared conversations collected from ShareGPT, using the condensing rotary embedding technique reported in the blog. Model date: longchat 13b 16k was trained on June 2023. Organizations developing the model: The LongChat developers: Dacheng Li , Rulin Shao , Anze Xie, Ying Sheng, Lianmin Zheng, Ion Stoica, Xuezhe Ma, and Hao Zhang Paper or resources for more information: https://github.com/DachengLi1/LongChat Where to send questions or comments about the model: https://github.com/DachengLi1/LongChat Intended use Primary intended uses: The primary use of longchat…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy