Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / ml-energy/leaderboard issues and pull requests

#33 - A benchmark table for multimodal models

Issue - State: open - Opened by jaywonchung 10 months ago

#32 - Add citation information

Pull Request - State: closed - Opened by jaywonchung 10 months ago - 1 comment

#31 - Support for benchmarking of diffusion models

Pull Request - State: closed - Opened by SchwarzXia 11 months ago - 2 comments

#30 - A benchmark table for diffusion models

Issue - State: open - Opened by jaywonchung about 1 year ago

#29 - A benchmark table for code models

Issue - State: open - Opened by jaywonchung about 1 year ago

#28 - add xgen

Pull Request - State: closed - Opened by xzzWZY about 1 year ago

#27 - response_length of batch inference still decrease

Issue - State: closed - Opened by xzzWZY about 1 year ago - 2 comments

#26 - add attention mask; fix stop_str length

Pull Request - State: closed - Opened by xzzWZY about 1 year ago - 2 comments

#25 - add A40 batch inference; deal with OOM in compute_metrics

Pull Request - State: closed - Opened by xzzWZY about 1 year ago - 18 comments

#24 - new count items

Pull Request - State: closed - Opened by xzzWZY about 1 year ago

#23 - Make one model selectable by user

Pull Request - State: closed - Opened by jaywonchung about 1 year ago - 1 comment

#22 - The ML.ENERGY Colosseum

Pull Request - State: closed - Opened by jaywonchung over 1 year ago - 4 comments

#21 - Online Serving

Pull Request - State: closed - Opened by AmberLJC over 1 year ago - 1 comment

#20 - fix stop_str; response_length; add batch size in config

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 18 comments

#19 - add rwkv nlp score

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 2 comments

#18 - Llama 2/stablelm special token

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 3 comments

#16 - fix end-of-file; benchmark_batch

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 2 comments

#15 - Add batch

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 2 comments

#14 - More info in app and about page

Pull Request - State: closed - Opened by jaywonchung over 1 year ago - 12 comments

#13 - add naive batching to benchmark.py

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 9 comments

#12 - Only show model names on hover

Pull Request - State: closed - Opened by jaywonchung over 1 year ago - 4 comments

#11 - Remove clutter from plots

Issue - State: closed - Opened by tashrifbillah over 1 year ago - 2 comments

#9 - add nlp-eval

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 2 comments

#8 - add nlp score

Pull Request - State: closed - Opened by xzzWZY over 1 year ago

#7 - Benchmarking with Pegasus

Pull Request - State: closed - Opened by jaywonchung over 1 year ago - 2 comments

#6 - enable multiple setup/tables; add external table col

Pull Request - State: closed - Opened by AmberLJC over 1 year ago - 18 comments

#5 - add compute script

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 4 comments

#4 - add eight models

Pull Request - State: closed - Opened by xzzWZY over 1 year ago - 7 comments

#3 - Improve Gradio WebUI

Pull Request - State: closed - Opened by jaywonchung over 1 year ago - 19 comments

#2 - add running script shell

Pull Request - State: closed - Opened by xzzWZY over 1 year ago

#1 - Add benchmark.py, example data, README.md

Pull Request - State: closed - Opened by jaywonchung over 1 year ago - 2 comments