ShareGPT4Omni/ShareGPT4Video issues and pull requests

#42 - incomplete data

Issue - State: open - Opened by dazhangyu123 27 days ago

#41 - Finetuning

Issue - State: open - Opened by spidercatfly about 2 months ago - 1 comment

#40 - Enhance Image Resizing Efficiency

Pull Request - State: open - Opened by mandlinsarah 2 months ago

#39 - Enhanced image loading reliability with error handling

Pull Request - State: open - Opened by mandlinsarah 2 months ago

#38 - Frame concatenation methods are different between gradio demo and `fast_captioner_lmdeploy.py`?

Issue - State: open - Opened by Liam-lyr 3 months ago

#37 - Training script?

Issue - State: open - Opened by rrzhang139 3 months ago - 1 comment

#36 - Data Preprocessing

Issue - State: open - Opened by exiawsh 3 months ago

#35 - update

Pull Request - State: open - Opened by Niujunbo2002 3 months ago

#34 - The usage of ShareCaptioner-Video

Issue - State: open - Opened by huangyf530 3 months ago - 1 comment

#33 - The training cost of the ShareCaptioner-Video

Issue - State: open - Opened by ShiYaya 3 months ago

#32 - 拉了一个多模态大模型技术交流群，大家可以加入进来进行技术交流

Issue - State: closed - Opened by feihuamantian 4 months ago

#31 - What are the main differences between ShareGPT 4Video-8B and ShareCaptioner Video

Issue - State: open - Opened by lcc157 4 months ago - 2 comments

#30 - Dataset generated with the ShareCaptioner-Video

Issue - State: open - Opened by rohun-tripathi 4 months ago - 1 comment

#29 - Questions about lmdeploy version and GPU usage

Issue - State: open - Opened by YoungjaeDev 4 months ago - 6 comments

#28 - Which captions were used for the evaluation in Table 7 - Human Preference?

Issue - State: open - Opened by rohun-tripathi 4 months ago

#27 - Where can I find the prompts used for creating the 181K VQA dataset?

Issue - State: open - Opened by YoungjaeDev 4 months ago

#26 - How much VRAM size is required for fast_captioner inference?

Issue - State: open - Opened by WuTao-CS 4 months ago

#25 - Found a typo in Sec4.1

Issue - State: open - Opened by huskydoge 4 months ago

#24 - detail of slide_captioner_lmdeploy.py

Issue - State: open - Opened by meteorlium 4 months ago - 2 comments

#23 - panda video dataset

Issue - State: closed - Opened by Nastu-Ho 4 months ago - 1 comment

#22 - Question about "slide_captioner_lmdeploy.py"

Issue - State: closed - Opened by Joanna0123 4 months ago - 1 comment

#21 - Can you publish the code that uses the key frame extraction part?

Issue - State: closed - Opened by V1ncentDemo 4 months ago - 1 comment

#20 - add fast captioner with lmdeploy

Pull Request - State: closed - Opened by zehuichen123 4 months ago

#19 - Update README.md

Pull Request - State: closed - Opened by Wiselnn570 5 months ago

#18 - Great work! What is the difference between these two models?

Issue - State: closed - Opened by WilTay1 5 months ago - 1 comment

#17 - 153k video instruction data

Issue - State: closed - Opened by Nastu-Ho 5 months ago - 1 comment

#16 - What are the principles behind the selection of baseline models?

Issue - State: closed - Opened by ShiYaya 5 months ago - 1 comment

#15 - "num_frames = 16" in run.py means taking out an average of 16 frames of a video?

Issue - State: closed - Opened by NuyoaHygge 5 months ago - 1 comment

#14 - About VRAM SIZE

Issue - State: closed - Opened by joseph16388 5 months ago - 1 comment

#13 - question about "Batch inference code for captioner"

Issue - State: closed - Opened by zZer0o 5 months ago - 1 comment

#12 - Release for the obtained summary for 40K

Issue - State: closed - Opened by ermu2001 5 months ago - 1 comment

#11 - Do you plan to quantize the model/ reduce the size of the ShareCaptioner-Video model?

Issue - State: open - Opened by radna0 5 months ago - 1 comment

#10 - ValueError: Trying to set a tensor of shape torch.Size([577, 1024]) in "weight" (which has shape torch.Size([257, 1024])), this look incorrect.

Issue - State: closed - Opened by haruka-025 5 months ago - 3 comments

#9 - Data Preprocess pipeline

Issue - State: closed - Opened by jin-qq 5 months ago - 1 comment

#8 - Missing "panda"?

Issue - State: closed - Opened by linzhiqiu 5 months ago - 7 comments

#7 - Download error when trying to download from huggingface

Issue - State: closed - Opened by linzhiqiu 5 months ago - 1 comment

#6 - Demos about ShareCaptioner-Video

Issue - State: closed - Opened by hkunzhe 5 months ago - 2 comments

#5 - Map video_id (pexels/pixabay) back to its original url id

Issue - State: closed - Opened by hkunzhe 5 months ago - 1 comment

#4 - Caption data of ShareGPT4Video dataset

Issue - State: closed - Opened by Marlod390 5 months ago - 1 comment

#3 - Compare with LLaVANext-8B?

Issue - State: open - Opened by mu-cai 5 months ago

#2 - Inference returns null str.

Issue - State: closed - Opened by ChawDoe 5 months ago - 4 comments

#1 - Inference code of sharegpt4video?

Issue - State: closed - Opened by ChawDoe 5 months ago - 1 comment

GitHub / ShareGPT4Omni/ShareGPT4Video issues and pull requests