Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / apartresearch/specificityplus issues and pull requests

#63 - Update README.md

Pull Request - State: closed - Opened by fbarez about 1 year ago - 1 comment

#62 - Update README.md

Pull Request - State: closed - Opened by fbarez about 1 year ago - 1 comment

#61 - Update README.md

Pull Request - State: open - Opened by fbarez over 1 year ago - 1 comment

#60 - Update index.html

Pull Request - State: closed - Opened by esbenkc over 1 year ago - 1 comment

#59 - Added the code and the figures along with updates to the website

Pull Request - State: closed - Opened by esbenkc over 1 year ago

#58 - The repository needs to be connected to the site

Issue - State: closed - Opened by esbenkc over 1 year ago - 6 comments

#56 - Update README and minor clean-up

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#55 - Add csv with statistics from bootstrap resampling

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#54 - Export statistics files used for generating confidence intervals (pt2)

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#53 - Export confidence intervals

Pull Request - State: closed - Opened by jas-ho over 1 year ago - 1 comment

#52 - Plot specificity results against model size

Pull Request - State: closed - Opened by jas-ho over 1 year ago - 3 comments

#50 - Extract common cli arg choices into constants

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#49 - Rename repo to Specificity+ and remove unwanted files

Issue - State: closed - Opened by fbarez over 1 year ago - 1 comment

#48 - Add errorbars to barplots grouped by dataset

Issue - State: open - Opened by jas-ho almost 2 years ago

#47 - Also produce barplots grouped by dataset

Pull Request - State: closed - Opened by jas-ho almost 2 years ago - 1 comment

#46 - Additional cleanups in e2e_analyze.py

Pull Request - State: closed - Opened by jas-ho almost 2 years ago

#45 - Plot specificity results against model size

Issue - State: closed - Opened by jas-ho almost 2 years ago

#44 - 43 prettify plots produced by e2e analyzepy

Pull Request - State: closed - Opened by jas-ho almost 2 years ago

#43 - Prettify plots produced by e2e_analyze.py

Issue - State: closed - Opened by jas-ho almost 2 years ago

#42 - Merge cluster-experiments

Pull Request - State: closed - Opened by jas-ho almost 2 years ago

#41 - Setup cluster experiments

Pull Request - State: closed - Opened by JuliaHPersson almost 2 years ago

#40 - Analyze combined results

Pull Request - State: closed - Opened by JuliaHPersson almost 2 years ago - 1 comment

#39 - Revert "merge main into cluster_experiments"

Pull Request - State: closed - Opened by JuliaHPersson almost 2 years ago

#38 - Merge pull request #37 from jas-ho/main

Pull Request - State: closed - Opened by JuliaHPersson almost 2 years ago

#37 - merge main into cluster_experiments

Pull Request - State: closed - Opened by JuliaHPersson almost 2 years ago

#36 - run and evaluate all edit algos on a given test set batch

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#35 - Get ROOT_DIR from env and update INSTRUCTIONS.md

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#34 - merge "Collect layers stats" into main

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#33 - merge "Cluster experiments" into main

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#32 - merge branch "experiments" into main

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#31 - get local dev setup running for Julia

Issue - State: closed - Opened by jas-ho about 2 years ago

#30 - discuss results from runs with bigger models

Issue - State: closed - Opened by jas-ho about 2 years ago - 1 comment

#29 - update paper with more systematic results

Issue - State: closed - Opened by jas-ho about 2 years ago

#28 - Summarize and plot chunked results

Issue - State: closed - Opened by jas-ho about 2 years ago

#27 - Run and evaluate all edit algos on a given test set batch

Issue - State: closed - Opened by jas-ho about 2 years ago - 1 comment

#26 - get all branches into main

Issue - State: closed - Opened by jas-ho about 2 years ago - 2 comments

#24 - fix overleaf errors/warnings

Issue - State: closed - Opened by fbarez about 2 years ago

#23 - add existing results

Issue - State: closed - Opened by fbarez about 2 years ago

#22 - Parallelize

Pull Request - State: closed - Opened by JuliaHPersson about 2 years ago

#21 - 20 improve logging progress bar reduced verbosity etc

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#20 - Improve logging: progress bar, reduced verbosity, etc

Issue - State: closed - Opened by jas-ho about 2 years ago
Labels: enhancement

#19 - Download data

Pull Request - State: closed - Opened by JuliaHPersson about 2 years ago

#17 - 15 implement specificity++

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#16 - Print model name to sys.stdout

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#15 - Implement specificity++

Issue - State: closed - Opened by jas-ho about 2 years ago - 1 comment

#14 - create analysis script for memitpp which works with specificity++

Issue - State: closed - Opened by jas-ho about 2 years ago - 2 comments

#13 - Run specificity++ on ROME and FT for gpt2-medium and compare to specificity+

Issue - State: closed - Opened by jas-ho about 2 years ago - 2 comments

#12 - Store names of model and editing alg in result json files

Pull Request - State: closed - Opened by jas-ho about 2 years ago - 1 comment

#11 - Store info about base model inside the run-dir

Issue - State: closed - Opened by jas-ho about 2 years ago - 2 comments

#10 - Allow to run unedited model by specifying "IDENTITY" as the model edit

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#9 - Allow to benchmark the unedited model

Issue - State: closed - Opened by jas-ho about 2 years ago

#8 - Improve CLI for evaluating experimental results

Pull Request - State: closed - Opened by jas-ho about 2 years ago

#7 - Improve CLI for evaluating experimental results

Issue - State: closed - Opened by jas-ho about 2 years ago

#6 - Guess params memit gpt2medium

Pull Request - State: closed - Opened by jas-ho about 2 years ago - 1 comment

#5 - Guess hyperparameters for MEMIT and gpt2-medium for quick sanity check

Issue - State: closed - Opened by jas-ho about 2 years ago - 2 comments

#4 - Make evaluations deterministic using seedbank.initialize

Pull Request - State: closed - Opened by jas-ho about 2 years ago
Labels: enhancement

#3 - Make evaluation deterministic

Issue - State: closed - Opened by jas-ho about 2 years ago - 1 comment

#2 - Implement specificity+

Pull Request - State: closed - Opened by jas-ho about 2 years ago - 1 comment

#1 - Port specificity+ to memitpp

Issue - State: closed - Opened by jas-ho about 2 years ago - 1 comment