Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / shmsw25/FActScore issues and pull requests

#48 - My FactScore

Pull Request - State: closed - Opened by IdoAmit198 9 months ago

#47 - Maintaining core factscore in a new repository

Issue - State: open - Opened by armingh2000 10 months ago

#46 - Improved version for speed and openai updates

Issue - State: open - Opened by wj210 10 months ago

#45 - Batching for speed.

Issue - State: open - Opened by wj210 10 months ago

#44 - About the enwiki-20230401

Issue - State: open - Opened by Toblame 11 months ago - 5 comments

#43 - loosen overly restrictive dependencies

Pull Request - State: open - Opened by dojoteef 12 months ago

#42 - make factscore use chatgpt for atomic fact generation

Pull Request - State: open - Opened by dojoteef 12 months ago - 1 comment

#41 - #38 Groundwork for migration to new openai >=v1.0.0 python API

Pull Request - State: closed - Opened by GeroVanMi 12 months ago - 2 comments

#39 - InvalidRequestError: The model `text-davinci-003` has been deprecated

Issue - State: closed - Opened by shrusti-ghela 12 months ago - 2 comments

#36 - problem using the factscorer function with LLaMa

Issue - State: open - Opened by samuel-LP about 1 year ago - 1 comment

#35 - Some cases couldn't be found in the default db

Issue - State: open - Opened by Loose-Gu about 1 year ago

#34 - Any way to run without an OpenAI key?

Issue - State: open - Opened by mohummedalee about 1 year ago - 3 comments

#33 - Issue running get_score() on M1 Mac due to Torch build

Issue - State: closed - Opened by jcblsn about 1 year ago - 1 comment

#31 - Generation details for models under data/labeled

Issue - State: open - Opened by caiqizh about 1 year ago - 1 comment

#29 - Regarding human evaluation

Issue - State: closed - Opened by pat-jj about 1 year ago - 2 comments

#28 - FileNotFoundError (demons.json) for custom knowledge base

Issue - State: open - Opened by MathiasKraus over 1 year ago - 2 comments

#27 - Typo here

Issue - State: closed - Opened by CiaoHe over 1 year ago - 1 comment

#26 - Scoring existing generated text

Issue - State: closed - Opened by sofi444 over 1 year ago - 1 comment

#25 - Having issues on using LLAMA-7B model

Issue - State: open - Opened by mungg over 1 year ago - 2 comments

#24 - Small changes to ensure custom corpus addition works

Pull Request - State: closed - Opened by martiansideofthemoon over 1 year ago

#23 - FActScore can be slow to run

Issue - State: open - Opened by martiansideofthemoon over 1 year ago

#22 - Using unlabeled data to generate atomic facts and retrieving evidence

Issue - State: closed - Opened by rubaha96 over 1 year ago - 1 comment

#21 - add length penalty

Pull Request - State: closed - Opened by shmsw25 over 1 year ago - 1 comment

#20 - Moving abstain detection to a separate module.

Pull Request - State: closed - Opened by martiansideofthemoon over 1 year ago

#18 - Create LICENSE

Pull Request - State: closed - Opened by martiansideofthemoon over 1 year ago

#17 - Don’t understand how true_score and false_score are represented in logits

Issue - State: closed - Opened by rubaha96 over 1 year ago - 1 comment

#16 - License?

Issue - State: closed - Opened by brucewlee over 1 year ago

#15 - fix bugs in retrieval

Pull Request - State: closed - Opened by absolute-nil over 1 year ago - 1 comment

#14 - MAX_LENGTH is not defined in retrieval

Issue - State: closed - Opened by absolute-nil over 1 year ago - 2 comments

#13 - Better ranking between models

Issue - State: closed - Opened by martiansideofthemoon over 1 year ago - 1 comment

#12 - Adding cost estimates for OpenAI API usage

Pull Request - State: closed - Opened by martiansideofthemoon over 1 year ago

#11 - setup log, separating data_dir

Pull Request - State: closed - Opened by shmsw25 over 1 year ago

#10 - Improving logging, show different levels

Issue - State: closed - Opened by martiansideofthemoon over 1 year ago

#9 - Instruct LLAMA integration

Pull Request - State: closed - Opened by martiansideofthemoon over 1 year ago

#8 - added `% of responding` and `num_facts_per_response`

Pull Request - State: closed - Opened by shmsw25 over 1 year ago - 1 comment

#7 - Return respond rate and number of facts together with FActScore

Issue - State: closed - Opened by shmsw25 over 1 year ago - 1 comment

#6 - improve processing of Perplexity AI outputs

Issue - State: closed - Opened by martiansideofthemoon over 1 year ago - 2 comments

#4 - Add citation / bibtex to README

Issue - State: closed - Opened by martiansideofthemoon over 1 year ago - 1 comment

#3 - estimated cost for API before running API

Issue - State: closed - Opened by martiansideofthemoon over 1 year ago - 1 comment

#2 - small updates

Pull Request - State: closed - Opened by shmsw25 over 1 year ago

#1 - new data format + atomic fact gen integrated

Pull Request - State: closed - Opened by martiansideofthemoon over 1 year ago