Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / vchitect/vbench issues and pull requests
#81 - why requires torch>=1.12,<2.0.0
Issue -
State: open - Opened by LukeLIN-web 9 days ago
#80 - human_action question
Issue -
State: open - Opened by zixian-wu 21 days ago
- 1 comment
#79 - prompt&video
Issue -
State: open - Opened by zwx211 21 days ago
- 3 comments
#78 - Are there plans to release sample videos generated by each model for each prompt, allowing everyone to compare them directly?
Issue -
State: open - Opened by gobigrassland 21 days ago
#77 - Questions about the input prompts used in the VBench leaderboard
Issue -
State: open - Opened by gobigrassland 21 days ago
#76 - How to calculate I2V final score?
Issue -
State: open - Opened by Ran0618 22 days ago
#75 - Question about object detection
Issue -
State: open - Opened by haoyi-duan 23 days ago
#74 - fix: handle zero-dimensional tensor
Pull Request -
State: open - Opened by Ricci084 29 days ago
#73 - Problem about installing detectron2 on CUDA Verson: 12.3
Issue -
State: open - Opened by ShootingWong about 1 month ago
- 1 comment
#72 - Can you tell me which metrics are needed to calculate with prompt?
Issue -
State: open - Opened by huangjch526 about 1 month ago
#71 - discriminability of the evaluation metrics
Issue -
State: open - Opened by HanLiii about 1 month ago
#70 - Is there a metric that takes into account the impact of video resolution?
Issue -
State: open - Opened by HanLiii about 2 months ago
#69 - There is still a lot of data missing from per catetory.
Issue -
State: open - Opened by dejian-lc about 2 months ago
#68 - Run evaluation suite on gen3 videos
Issue -
State: open - Opened by Syzygianinfern0 about 2 months ago
- 1 comment
#67 - Opensoraplan-v1.1 score
Issue -
State: closed - Opened by LWang1016 2 months ago
- 6 comments
#66 - How do I get the final score for i2V locally?
Issue -
State: open - Opened by Chuge0335 2 months ago
#65 - imaging_quality
Issue -
State: open - Opened by yja1 2 months ago
- 1 comment
#64 - Difference between i2v_subject and subject_consistency
Issue -
State: open - Opened by yjhong89 2 months ago
- 1 comment
#63 - error with torch.distributed for multiprocesssing
Issue -
State: open - Opened by quantumiracle 3 months ago
- 6 comments
#62 - Unrecognized arguments: --mode=custom_input when running vbench
Issue -
State: closed - Opened by ChengYoghurt 3 months ago
- 2 comments
#61 - Cogvideo2B score
Issue -
State: open - Opened by CacacaLalala 3 months ago
- 7 comments
#60 - What is the role of the trustworthiness folder at the same level as per_dimension and per_category?
Issue -
State: open - Opened by dejian-lc 3 months ago
#59 - Empirical Min
Issue -
State: open - Opened by lovelyczli 3 months ago
- 3 comments
#58 - Duplicate prompts in overall_consistency.txt and full.json
Issue -
State: open - Opened by lovelyczli 3 months ago
- 3 comments
#57 - Implementation Details
Issue -
State: closed - Opened by lovelyczli 3 months ago
- 5 comments
#56 - Can not download pretrained model for "overall consistency" evaluation
Issue -
State: open - Opened by haoyuhsu 3 months ago
- 4 comments
#55 - Can vbench_i2v support customized video evaluation?
Issue -
State: open - Opened by motor-x 3 months ago
#54 - Difference between "overall_consistency" and "temporal_style"?
Issue -
State: closed - Opened by 7thChord 4 months ago
- 2 comments
#53 - VBench-Long Leaderboard
Issue -
State: open - Opened by Epiphqny 4 months ago
- 3 comments
#52 - Fix a typo
Pull Request -
State: open - Opened by lmxyy 4 months ago
#51 - add support for multi-gpu parallel evaluation
Pull Request -
State: closed - Opened by TiankaiHang 4 months ago
- 2 comments
Labels: merged
#50 - speed up 'mp4' format video load
Pull Request -
State: closed - Opened by simplaj 4 months ago
- 2 comments
#49 - Update requirements.txt unzip
Pull Request -
State: closed - Opened by foreverpiano 4 months ago
- 1 comment
#49 - Update requirements.txt unzip
Pull Request -
State: closed - Opened by foreverpiano 4 months ago
- 1 comment
#48 - unzip missing
Issue -
State: closed - Opened by foreverpiano 4 months ago
- 4 comments
#48 - unzip missing
Issue -
State: closed - Opened by foreverpiano 4 months ago
- 4 comments
#47 - How to solve the problem "av.error.FileNotFoundError: [Errno 2] No such file or directory”
Issue -
State: closed - Opened by chaserRen 4 months ago
- 4 comments
#47 - How to solve the problem "av.error.FileNotFoundError: [Errno 2] No such file or directory”
Issue -
State: closed - Opened by chaserRen 4 months ago
- 4 comments
#46 - Can we withdraw the results in leaderboard?
Issue -
State: closed - Opened by jiaxiangc 5 months ago
- 5 comments
#45 - How to calculate total score?
Issue -
State: closed - Opened by jiaxiangc 5 months ago
- 1 comment
#44 - Great works. A question about detailed inference settings for animatediffv2.
Issue -
State: closed - Opened by jiaxiangc 5 months ago
- 9 comments
#43 - Where is the VLM-tuning model (VideoChat finetuned using human annotation)?
Issue -
State: closed - Opened by linzhiqiu 5 months ago
- 2 comments
#42 - Vbench Leaderboard
Issue -
State: open - Opened by BeachWang 5 months ago
- 2 comments
#41 - failed to get the output result
Issue -
State: open - Opened by mamianshusheng 5 months ago
- 1 comment
#40 - When evaluate aesthetic_quality, 'CUDA out of memory' always occur for multiple videos
Issue -
State: open - Opened by Crazy-wu-20 5 months ago
- 2 comments
#40 - When evaluate aesthetic_quality, 'CUDA out of memory' always occur for multiple videos
Issue -
State: open - Opened by Crazy-wu-20 5 months ago
- 2 comments
#39 - Pika, Gen2 latest results
Issue -
State: closed - Opened by somepago 5 months ago
- 4 comments
#38 - Division by 0 when directory only contains a single video
Pull Request -
State: closed - Opened by dsleo 5 months ago
- 1 comment
#37 - Division by 0 when directory only contains a single video
Issue -
State: closed - Opened by htnico 5 months ago
- 1 comment
#36 - Change the indent of demo codes
Pull Request -
State: closed - Opened by lmxyy 5 months ago
- 1 comment
#35 - KeyError: 'imaging_quality_preprocessing_mode'
Issue -
State: closed - Opened by quantumiracle 5 months ago
- 4 comments
#34 - Difference between "i2v_subject" and "subject_consistency" dimensions
Issue -
State: open - Opened by AshkanTaghipour 5 months ago
- 6 comments
#33 - Code for generating Figure 6
Issue -
State: closed - Opened by richard-peng-xia 6 months ago
- 2 comments
#32 - AssertionError: dimensions : {'background_consistency'} not supported for custom input
Issue -
State: closed - Opened by Jason-xin 6 months ago
- 1 comment
#31 - the score meaning
Issue -
State: closed - Opened by Jason-xin 6 months ago
- 2 comments
#30 - Request for detailed instructions for submitting evaluation results to the leaderboard
Issue -
State: closed - Opened by Ji4chenLi 6 months ago
- 13 comments
#29 - Fixed some bugs when using custom prompt and multiprocess processing
Pull Request -
State: closed - Opened by piddnad 6 months ago
#28 - score range for each dimension?
Issue -
State: open - Opened by rebuttalpapers 6 months ago
- 6 comments
#27 - run inference on customized video and prompt?
Issue -
State: closed - Opened by rebuttalpapers 6 months ago
- 2 comments
#26 - LeaderBoard sampled videos
Issue -
State: closed - Opened by GFENGG 7 months ago
#25 - LeaderBoard code
Issue -
State: closed - Opened by GFENGG 7 months ago
- 6 comments
#24 - Problems Encountered during Installation
Issue -
State: open - Opened by BeachWang 7 months ago
- 20 comments
#23 - About the size and number of frames
Issue -
State: closed - Opened by BeachWang 7 months ago
- 3 comments
#22 - Where is the human preference data?
Issue -
State: open - Opened by linzhiqiu 7 months ago
- 5 comments
#21 - Where can I find open source video data?
Issue -
State: closed - Opened by Mei0211 7 months ago
- 3 comments
#20 - Why is the SVD not included?
Issue -
State: closed - Opened by syguan96 7 months ago
- 2 comments
#19 - What does the result means?
Issue -
State: closed - Opened by chenerg 8 months ago
- 2 comments
#18 - provide the pretrained weights for reproducing the results in leaderboard
Issue -
State: closed - Opened by GFENGG 8 months ago
- 3 comments
#17 - Evaluation of True Videos
Issue -
State: closed - Opened by chenerg 8 months ago
- 4 comments
Labels: help wanted
#16 - how to use detectron2(which require torch<=1.10) and the torch>=1.12 in requirement
Issue -
State: closed - Opened by JHL328 8 months ago
- 2 comments
#15 - FileNotFoundError: [Errno 2] No such file or directory: './VBench_full_info.json'
Issue -
State: closed - Opened by JHL328 8 months ago
- 2 comments
Labels: documentation
#14 - how to execute the project ?
Issue -
State: closed - Opened by ParvAggarwal 9 months ago
- 2 comments
#13 - generating videos from images
Issue -
State: closed - Opened by cyy-1234 9 months ago
- 12 comments
#12 - Evaluation data issues
Issue -
State: closed - Opened by GFENGG 9 months ago
- 1 comment
Labels: documentation
#11 - Cannot find and process videos under provided directory
Issue -
State: closed - Opened by chenerg 10 months ago
- 2 comments
Labels: enhancement
#10 - FileNotFoundError: [Errno 2] No such file or directory: './VBench_full_info.json'
Issue -
State: closed - Opened by chenerg 10 months ago
- 3 comments
Labels: bug
#9 - how to calculate the total score of all metircs
Issue -
State: closed - Opened by xinyuxiao 10 months ago
- 3 comments
Labels: enhancement
#8 - single dimension running problem
Issue -
State: closed - Opened by GFENGG 10 months ago
- 6 comments
Labels: documentation
#7 - How to run inference for a new video?
Issue -
State: closed - Opened by yonatanbitton 10 months ago
- 6 comments
Labels: enhancement
#6 - How to run inference for a new data?
Issue -
State: closed - Opened by yonatanbitton 10 months ago
- 2 comments
Labels: enhancement
#5 - About sampled videos
Issue -
State: closed - Opened by Qiulin-W 10 months ago
- 2 comments
Labels: question
#4 - Evaluation issue:
Issue -
State: closed - Opened by Mei0211 10 months ago
- 3 comments
Labels: documentation
#3 - pretrained/umt_model
Issue -
State: closed - Opened by Mei0211 10 months ago
- 2 comments
Labels: documentation
#2 - sample_per_video function related
Issue -
State: closed - Opened by Mei0211 10 months ago
- 4 comments
#1 - conda environment issue
Issue -
State: closed - Opened by Mei0211 10 months ago
- 5 comments
Labels: documentation