apartresearch/specificityplus issues and pull requests

#63 - Update README.md

Pull Request - State: closed - Opened by fbarez 6 months ago - 1 comment

#62 - Update README.md

Pull Request - State: closed - Opened by fbarez 6 months ago - 1 comment

#61 - Update README.md

Pull Request - State: open - Opened by fbarez about 1 year ago - 1 comment

#60 - Update index.html

Pull Request - State: closed - Opened by esbenkc about 1 year ago - 1 comment

#59 - Added the code and the figures along with updates to the website

Pull Request - State: closed - Opened by esbenkc about 1 year ago

#58 - The repository needs to be connected to the site

Issue - State: closed - Opened by esbenkc about 1 year ago - 6 comments

#57 - Added the website as a subdirectory. Updated the links and the main figure.

Pull Request - State: closed - Opened by esbenkc about 1 year ago

#56 - Update README and minor clean-up

Pull Request - State: closed - Opened by jas-ho about 1 year ago

#55 - Add csv with statistics from bootstrap resampling

Pull Request - State: closed - Opened by jas-ho about 1 year ago

#54 - Export statistics files used for generating confidence intervals (pt2)

Pull Request - State: closed - Opened by jas-ho about 1 year ago

#53 - Export confidence intervals

Pull Request - State: closed - Opened by jas-ho about 1 year ago - 1 comment

#52 - Plot specificity results against model size

Pull Request - State: closed - Opened by jas-ho about 1 year ago - 3 comments

#51 - Add results for GPT2-{medium,xl}, GPT-J-6B for FT,ROME,MEMIT, and unedited

Pull Request - State: closed - Opened by jas-ho about 1 year ago

#50 - Extract common cli arg choices into constants

Pull Request - State: closed - Opened by jas-ho about 1 year ago

#49 - Rename repo to Specificity+ and remove unwanted files

Issue - State: closed - Opened by fbarez about 1 year ago - 1 comment

#48 - Add errorbars to barplots grouped by dataset

Issue - State: open - Opened by jas-ho over 1 year ago

#47 - Also produce barplots grouped by dataset

Pull Request - State: closed - Opened by jas-ho over 1 year ago - 1 comment

#46 - Additional cleanups in e2e_analyze.py

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#45 - Plot specificity results against model size

Issue - State: closed - Opened by jas-ho over 1 year ago

#44 - 43 prettify plots produced by e2e analyzepy

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#43 - Prettify plots produced by e2e_analyze.py

Issue - State: closed - Opened by jas-ho over 1 year ago

#42 - Merge cluster-experiments

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#41 - Setup cluster experiments

Pull Request - State: closed - Opened by JuliaHPersson over 1 year ago

#40 - Analyze combined results

Pull Request - State: closed - Opened by JuliaHPersson over 1 year ago - 1 comment

#39 - Revert "merge main into cluster_experiments"

Pull Request - State: closed - Opened by JuliaHPersson over 1 year ago

#38 - Merge pull request #37 from jas-ho/main

Pull Request - State: closed - Opened by JuliaHPersson over 1 year ago

#37 - merge main into cluster_experiments

Pull Request - State: closed - Opened by JuliaHPersson over 1 year ago

#36 - run and evaluate all edit algos on a given test set batch

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#35 - Get ROOT_DIR from env and update INSTRUCTIONS.md

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#34 - merge "Collect layers stats" into main

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#33 - merge "Cluster experiments" into main

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#32 - merge branch "experiments" into main

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#31 - get local dev setup running for Julia

Issue - State: closed - Opened by jas-ho over 1 year ago

#30 - discuss results from runs with bigger models

Issue - State: closed - Opened by jas-ho over 1 year ago - 1 comment

#29 - update paper with more systematic results

Issue - State: closed - Opened by jas-ho over 1 year ago

#28 - Summarize and plot chunked results

Issue - State: closed - Opened by jas-ho over 1 year ago

#27 - Run and evaluate all edit algos on a given test set batch

Issue - State: closed - Opened by jas-ho over 1 year ago - 1 comment

#26 - get all branches into main

Issue - State: closed - Opened by jas-ho over 1 year ago - 2 comments

#25 - Add plot of illustrative results using CounterFact+ vs CounterFact to Figure 1

Issue - State: closed - Opened by jas-ho over 1 year ago

#24 - fix overleaf errors/warnings

Issue - State: closed - Opened by fbarez over 1 year ago

#23 - add existing results

Issue - State: closed - Opened by fbarez over 1 year ago

#22 - Parallelize

Pull Request - State: closed - Opened by JuliaHPersson over 1 year ago

#21 - 20 improve logging progress bar reduced verbosity etc

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#20 - Improve logging: progress bar, reduced verbosity, etc

Issue - State: closed - Opened by jas-ho over 1 year ago
Labels: enhancement

#19 - Download data

Pull Request - State: closed - Opened by JuliaHPersson over 1 year ago

#18 - [WIP] Extract all results from .json and .pt result files and compute some …

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#17 - 15 implement specificity++

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#16 - Print model name to sys.stdout

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#15 - Implement specificity++

Issue - State: closed - Opened by jas-ho over 1 year ago - 1 comment

#14 - create analysis script for memitpp which works with specificity++

Issue - State: closed - Opened by jas-ho over 1 year ago - 2 comments

#13 - Run specificity++ on ROME and FT for gpt2-medium and compare to specificity+

Issue - State: closed - Opened by jas-ho over 1 year ago - 2 comments

#12 - Store names of model and editing alg in result json files

Pull Request - State: closed - Opened by jas-ho over 1 year ago - 1 comment

#11 - Store info about base model inside the run-dir

Issue - State: closed - Opened by jas-ho over 1 year ago - 2 comments

#10 - Allow to run unedited model by specifying "IDENTITY" as the model edit

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#9 - Allow to benchmark the unedited model

Issue - State: closed - Opened by jas-ho over 1 year ago

#8 - Improve CLI for evaluating experimental results

Pull Request - State: closed - Opened by jas-ho over 1 year ago

#7 - Improve CLI for evaluating experimental results

Issue - State: closed - Opened by jas-ho over 1 year ago

#6 - Guess params memit gpt2medium

Pull Request - State: closed - Opened by jas-ho over 1 year ago - 1 comment

#5 - Guess hyperparameters for MEMIT and gpt2-medium for quick sanity check

Issue - State: closed - Opened by jas-ho over 1 year ago - 2 comments

#4 - Make evaluations deterministic using seedbank.initialize

Pull Request - State: closed - Opened by jas-ho over 1 year ago
Labels: enhancement

GitHub / apartresearch/specificityplus issues and pull requests