1 解决langchain-chatchat多功能对话报错an error accuerd during stream
解决方案:
1) 修改max_new_tokens在\anaconda3\envs\inference\Lib\site-packages\xinference\core\scheduler.py", line 241行
修改为
max_new_tokens = 1024
2)修改max_new_tokens在anaconda3\envs\inference\Lib\site-packages\xinference\model\llm\transformers\utils.py", line 134,
修改为
max_new_tokens = 1024
3)修改langchain-chatchat的Langchain-Chatchat\libs\chatchat-server下面的Model_settings里面的max_tokens=1024