Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / leigh-johnson/stanford-ssg-research issues and pull requests

#13 - Implement codellama-specific prompt formatter

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#12 - Implement clean_python_code / run_python_code utils

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#11 - First pass on result notebooks

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#10 - Implement auto-cot prompting

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#9 - Remove task description from zero-shot prompt (get baseline)

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#8 - Save annotated dataset to .cache/experiments

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#7 - Alphabetize cli params

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#6 - Accuracy metrics, start implementing perplexity metrics

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#5 - Implement batching

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#4 - Data exploration notebook + fix state leak in task runner

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#2 - Rename wizart -> llm_programs

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago

#1 - GSM8K benchmark / task scaffolding

Pull Request - State: closed - Opened by leigh-johnson about 1 year ago