facebookresearch/dynabench issues and pull requests

#910 - add support for chrf++ metric

Pull Request - State: closed - Opened by gwenzek about 2 years ago - 1 comment
Labels: CLA Signed

#909 - fix dockerfile port problem

Pull Request - State: closed - Opened by Ciroye about 2 years ago
Labels: CLA Signed

#908 - fix dockerfile port problem

Pull Request - State: closed - Opened by Ciroye about 2 years ago
Labels: CLA Signed

#907 - Added change of context when exiting sandbox mode into live mode

Pull Request - State: closed - Opened by maxbartolo about 2 years ago - 5 comments
Labels: CLA Signed

#906 - Included mlcommons hostname

Pull Request - State: closed - Opened by remg1997 about 2 years ago - 1 comment
Labels: CLA Signed

#905 - decentralized fixes

Pull Request - State: closed - Opened by gwenzek about 2 years ago - 1 comment
Labels: CLA Signed

#904 - Randomly initialize multiclass label selection when switching to a new context. Make it stay the same otherwise.

Issue - State: open - Opened by TristanThrush about 2 years ago

#903 - Adding instructions to recreate Dynabench API Gateway

Pull Request - State: closed - Opened by ktirumalafb about 2 years ago - 1 comment
Labels: CLA Signed

#902 - Give task owners the ability to choose default setting for getting random contexts

Issue - State: open - Opened by maxbartolo over 2 years ago - 2 comments

#901 - Ensuring that CORS configuration file cannot contain `endswidth`

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#900 - Recover Datasets for NLI Task

Issue - State: open - Opened by Rebecca-Qian over 2 years ago - 1 comment

#899 - [FairScore] Add fairness perturbation script for AugLy and TextFlint

Pull Request - State: closed - Opened by Rebecca-Qian over 2 years ago - 2 comments
Labels: CLA Signed

#898 - Bulk Create Interface Submission Feature

Issue - State: open - Opened by TristanThrush over 2 years ago

#897 - Update AboutPage.js

Pull Request - State: closed - Opened by adinawilliams over 2 years ago - 5 comments
Labels: CLA Signed

#896 - fix/get-random-example-api-call

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#895 - Refactor code in `/tasks/admin_or_owner`

Issue - State: open - Opened by ktirumalafb over 2 years ago

#894 - Speed up query for retrieving validation examples

Issue - State: open - Opened by ktirumalafb over 2 years ago

#893 - making `admin_or_owner` turk friendly endpoint

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#892 - Fix/token annotator whitespace and reset

Pull Request - State: closed - Opened by maxbartolo over 2 years ago
Labels: CLA Signed

#891 - adding correct preflight for turk endpoints

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#890 - adding turk endpoints decorator to all get context endpoints

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#889 - fix/remove-inconsistent-auths-in-context-getters

Pull Request - State: closed - Opened by TristanThrush over 2 years ago - 1 comment
Labels: CLA Signed

#888 - fix/context-string-selction-verifier

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#887 - Fixed typo: uncertianty

Pull Request - State: closed - Opened by maxbartolo over 2 years ago
Labels: CLA Signed

#886 - QA (not urgent): Clicking on an answer no longer removes that answer

Issue - State: closed - Opened by maxbartolo over 2 years ago

#885 - QA: getRandomContext() only seems to be returning from around 5 possible contexts

Issue - State: closed - Opened by maxbartolo over 2 years ago - 2 comments
Labels: bug, help wanted

#884 - QA: storeExample() not working

Issue - State: closed - Opened by maxbartolo over 2 years ago
Labels: bug, help wanted

#883 - Wrap `db.commits()` in a try/catch that `rollback` when failed to prevent directly throwing SQL errors to users

Issue - State: open - Opened by ktirumalafb over 2 years ago

#882 - Small print statement fixes in eval server decen

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#881 - adding check in migration script for local developers who will eventu…

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago - 3 comments
Labels: CLA Signed

#880 - Give users the capability to delete their own models

Issue - State: open - Opened by TristanThrush over 2 years ago

#880 - Give users the capability to delete their own models

Issue - State: open - Opened by TristanThrush over 2 years ago

#879 - Fixed name issue in task owner docs

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#879 - Fixed name issue in task owner docs

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#878 - Enable Admins to see user (and user email) associated with a task proposal

Issue - State: open - Opened by TristanThrush over 2 years ago

#878 - Enable Admins to see user (and user email) associated with a task proposal

Issue - State: open - Opened by TristanThrush over 2 years ago

#877 - Feat/yaml task config

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#877 - Feat/yaml task config

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#876 - added ability to download cloudwatch logs for each dataset and model

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#876 - added ability to download cloudwatch logs for each dataset and model

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#875 - improved usability of no-context tasks

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#874 - removed validate message that is not always true

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#874 - removed validate message that is not always true

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#873 - enabled overflow in create interface

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#872 - QA CreateInterface: Whitespace around punctuation

Issue - State: closed - Opened by maxbartolo over 2 years ago - 2 comments

#871 - rewrote verify_annotation functions to return specific error messages

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#871 - rewrote verify_annotation functions to return specific error messages

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#870 - Stopping sensitive data from getting logged in `/authenticate/refresh`

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago - 1 comment
Labels: CLA Signed

#870 - Stopping sensitive data from getting logged in `/authenticate/refresh`

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago - 1 comment
Labels: CLA Signed

#869 - Fix detect aws credentials

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#869 - Fix detect aws credentials

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#868 - fixed bug preventing communication with leaderboard models if there i…

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#868 - fixed bug preventing communication with leaderboard models if there i…

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#867 - added instructions for the generation of robustness and fairness scripts

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#867 - added instructions for the generation of robustness and fairness scripts

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#866 - removed line from model page

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#866 - removed line from model page

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#865 - redid evaluation status to be dataset-specific

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#865 - redid evaluation status to be dataset-specific

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#864 - Re-enabling data collection (not allowing include: credentials for turk endpoints)

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#864 - Re-enabling data collection (not allowing include: credentials for turk endpoints)

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#863 - Ensure login messages take you to the correct place after login

Issue - State: open - Opened by TristanThrush over 2 years ago

#863 - Ensure login messages take you to the correct place after login

Issue - State: open - Opened by TristanThrush over 2 years ago

#862 - added constraint for dataperf train size to be <= 1000. Added email s…

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#862 - added constraint for dataperf train size to be <= 1000. Added email s…

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#861 - added necessary info into submit file props

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#860 - fixed import issue

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#859 - renamed leaderboards to be more specific

Pull Request - State: closed - Opened by TristanThrush over 2 years ago - 1 comment
Labels: CLA Signed

#859 - renamed leaderboards to be more specific

Pull Request - State: closed - Opened by TristanThrush over 2 years ago - 1 comment
Labels: CLA Signed

#858 - added real dataperf dataset

Pull Request - State: closed - Opened by TristanThrush over 2 years ago - 1 comment
Labels: CLA Signed

#858 - added real dataperf dataset

Pull Request - State: closed - Opened by TristanThrush over 2 years ago - 1 comment
Labels: CLA Signed

#857 - Remove "you are on round" message

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#857 - Remove "you are on round" message

Pull Request - State: closed - Opened by TristanThrush over 2 years ago
Labels: CLA Signed

#856 - Edge-case bug with model interaction

Issue - State: closed - Opened by TristanThrush over 2 years ago - 1 comment

#856 - Edge-case bug with model interaction

Issue - State: closed - Opened by TristanThrush over 2 years ago - 1 comment

#855 - Securing endpoint from possible vulnerability

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#855 - Securing endpoint from possible vulnerability

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#854 - "You are on round x" message seems to be a different style than the rest of dynabench

Issue - State: closed - Opened by TristanThrush over 2 years ago

#853 - Quick CORS headers fix (forgot to include `api.dynabench.org` to list of valid CORS headers)

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#852 - Reverting set state changes

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#851 - update dataset name regex

Pull Request - State: closed - Opened by kokrui over 2 years ago
Labels: CLA Signed

#851 - update dataset name regex

Pull Request - State: closed - Opened by kokrui over 2 years ago
Labels: CLA Signed

#850 - dataset name issue again (my fault)

Issue - State: closed - Opened by TristanThrush over 2 years ago

#850 - dataset name issue again (my fault)

Issue - State: closed - Opened by TristanThrush over 2 years ago

#849 - we should remove a recently introduced warning

Issue - State: closed - Opened by TristanThrush over 2 years ago - 1 comment

#848 - Fix formatting on perturb + minor improvements

Pull Request - State: closed - Opened by EntilZha over 2 years ago - 1 comment
Labels: CLA Signed

#847 - dataset deletion doesn't work when there are already scores for it (foreign key constraint failure)

Issue - State: closed - Opened by TristanThrush over 2 years ago - 3 comments

#846 - new perturb script returns a format that doesn't quite work with the evaluation server

Issue - State: closed - Opened by TristanThrush over 2 years ago - 1 comment

#846 - new perturb script returns a format that doesn't quite work with the evaluation server

Issue - State: closed - Opened by TristanThrush over 2 years ago - 1 comment

#845 - Allow selecting contexts for a particular round by selecting tags.

Pull Request - State: closed - Opened by anandrajaram21 over 2 years ago - 2 comments
Labels: CLA Signed

#844 - Moving data collection to EC2Architect instead of heroku

Issue - State: open - Opened by ktirumalafb over 2 years ago

#843 - Fixing the potential query_dict["annotator_id"] = None issue in GET /examples/<tid:int>/<rid:int>

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#843 - Fixing the potential query_dict["annotator_id"] = None issue in GET /examples/<tid:int>/<rid:int>

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#842 - It seems that models that fail are not taken down anymore?

Issue - State: closed - Opened by TristanThrush over 2 years ago - 4 comments

#842 - It seems that models that fail are not taken down anymore?

Issue - State: closed - Opened by TristanThrush over 2 years ago - 4 comments

#841 - decentralized eaas v1

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago - 4 comments
Labels: CLA Signed

#840 - validate dataset names

Pull Request - State: closed - Opened by kokrui over 2 years ago - 2 comments
Labels: CLA Signed

#840 - validate dataset names

Pull Request - State: closed - Opened by kokrui over 2 years ago - 2 comments
Labels: CLA Signed

#839 - more domain-specific control over cors headers

Pull Request - State: closed - Opened by ktirumalafb over 2 years ago
Labels: CLA Signed

#838 - Dataset name issues

Issue - State: closed - Opened by TristanThrush over 2 years ago - 1 comment

GitHub / facebookresearch/dynabench issues and pull requests