What was the training setting of qformer, LLM?
#9
by deleted - opened
In the first stage of pre-training (QFormer), the configuration file can refer to the https://github.com/OpenGVLab/Ask-Anything/blob/main/video_chat2/scripts/videochat_vicuna/config_7b_stage1.py, in the stage2 of aligning with the Mistral LLM can refer to the https://github.com/OpenGVLab/Ask-Anything/blob/main/video_chat2/scripts/videochat_mistral/config_7b_stage2.py, in the stage3 of LORA SFT, the configuration file can refer to the https://github.com/OpenGVLab/Ask-Anything/blob/main/video_chat2/scripts/videochat_mistral/config_7b_stage3.py;