Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / langchain-ai/auto-evaluator issues and pull requests

#100 - change wording in bias check prompt template

Pull Request - State: closed - Opened by mziru over 1 year ago - 2 comments

#100 - change wording in bias check prompt template

Pull Request - State: closed - Opened by mziru over 1 year ago - 2 comments

#99 - Add Anthropic 100k

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#99 - Add Anthropic 100k

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#98 - Streamlit app for Pinecone

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#98 - Streamlit app for Pinecone

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#97 - How generalizable is this framework?

Issue - State: open - Opened by samching over 1 year ago

#97 - How generalizable is this framework?

Issue - State: open - Opened by samching over 1 year ago

#96 - disable sidebar when the experiment is running

Issue - State: open - Opened by dankolesnikov over 1 year ago

#96 - disable sidebar when the experiment is running

Issue - State: open - Opened by dankolesnikov over 1 year ago

#95 - look into hosting vicuna 13B on EC2

Issue - State: open - Opened by dankolesnikov over 1 year ago

#95 - look into hosting vicuna 13B on EC2

Issue - State: open - Opened by dankolesnikov over 1 year ago

#94 - make demo environment mobile friendly

Issue - State: open - Opened by dankolesnikov over 1 year ago

#94 - make demo environment mobile friendly

Issue - State: open - Opened by dankolesnikov over 1 year ago

#92 - Add Vicuna 13b along w/ Transformer test set

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 3 comments

#92 - Add Vicuna 13b along w/ Transformer test set

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 3 comments

#91 - Back-end crashing

Issue - State: open - Opened by rlancemartin over 1 year ago

#91 - Back-end crashing

Issue - State: open - Opened by rlancemartin over 1 year ago

#90 - [Do Not Merge] Use compression in file transfer

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 2 comments
Labels: bug

#90 - [Do Not Merge] Use compression in file transfer

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 2 comments
Labels: bug

#89 - OpenAI invalid API key error

Issue - State: open - Opened by benisgold over 1 year ago - 1 comment

#89 - OpenAI invalid API key error

Issue - State: open - Opened by benisgold over 1 year ago - 1 comment

#88 - Update anthropic model

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#88 - Update anthropic model

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#87 - Anthropic model appears to be deprecated

Issue - State: open - Opened by rlancemartin over 1 year ago

#87 - Anthropic model appears to be deprecated

Issue - State: open - Opened by rlancemartin over 1 year ago

#86 - Missing logging / alert when back-end crashes

Issue - State: open - Opened by rlancemartin over 1 year ago

#86 - Missing logging / alert when back-end crashes

Issue - State: open - Opened by rlancemartin over 1 year ago

#85 - Fix expt summary refresh

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#85 - Fix expt summary refresh

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#84 - Remove Insight section

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#84 - Remove Insight section

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#82 - Restrict file size/quantity

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#82 - Restrict file size/quantity

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#81 - Experiment numbers are not refreshing correctly

Issue - State: closed - Opened by rlancemartin over 1 year ago

#81 - Experiment numbers are not refreshing correctly

Issue - State: closed - Opened by rlancemartin over 1 year ago

#80 - Remove catch for embedding failure

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 2 comments

#80 - Remove catch for embedding failure

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 2 comments

#79 - Catch server errors and return alert to the user

Issue - State: closed - Opened by rlancemartin over 1 year ago - 2 comments
Labels: good first issue

#79 - Catch server errors and return alert to the user

Issue - State: closed - Opened by rlancemartin over 1 year ago - 2 comments
Labels: good first issue

#78 - Add 50MB file limit and single file

Issue - State: closed - Opened by rlancemartin over 1 year ago

#78 - Add 50MB file limit and single file

Issue - State: closed - Opened by rlancemartin over 1 year ago

#75 - Analytics

Issue - State: closed - Opened by benisgold over 1 year ago

#74 - File transfer and reading time is slow in prod

Issue - State: open - Opened by rlancemartin over 1 year ago

#73 - Error handling

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#72 - Prod (likely) hitting OOM

Issue - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#71 - fix env

Pull Request - State: closed - Opened by benisgold over 1 year ago - 2 comments

#70 - Add back env vars

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#69 - Unbreak

Issue - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#68 - feat: move segment key to env file

Pull Request - State: closed - Opened by dankolesnikov over 1 year ago - 1 comment

#67 - Fix SVM in prod

Issue - State: closed - Opened by rlancemartin over 1 year ago

#66 - Move API Key

Issue - State: closed - Opened by benisgold over 1 year ago - 2 comments

#65 - logo + favicon

Pull Request - State: closed - Opened by benisgold over 1 year ago - 2 comments

#64 - Add horizontal scroll to tables

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#63 - Update baseline results

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#62 - Expt numbering is wrong after we start w/ 3 examples

Issue - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#61 - Reset "Summary" when # Eval Qs OR test set changes

Pull Request - State: closed - Opened by benisgold over 1 year ago - 3 comments

#60 - horizontal scroll is needed on Summary table

Issue - State: closed - Opened by dankolesnikov over 1 year ago

#59 - CSV fix

Pull Request - State: closed - Opened by benisgold over 1 year ago - 3 comments

#58 - Fix GPT-4 and expose QA prompt

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#57 - Anthropic model is failing on prod

Issue - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#56 - Update prompt for better speed and loading message

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#55 - Show intermediate states in the loading bar

Issue - State: closed - Opened by rlancemartin over 1 year ago - 2 comments

#54 - Add Langchain logo to top left and make brain emoji the favicon

Issue - State: closed - Opened by rlancemartin over 1 year ago - 4 comments

#53 - Minor docs cleanup on API

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#51 - Remove Doppler dep

Issue - State: closed - Opened by rlancemartin over 1 year ago - 2 comments

#50 - Prompt improvements

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#49 - Tune prompts and make Descriptive the default

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 2 comments

#48 - feat: add analytics and fix bug with demo env

Pull Request - State: closed - Opened by dankolesnikov over 1 year ago - 3 comments

#47 - Write-up on learnings / opportunities

Issue - State: closed - Opened by rlancemartin over 1 year ago

#46 - Past experimental results should be cleared when eval set changes

Issue - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#45 - @benisgold/prerelease

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#44 - Improve retrieval prompt

Pull Request - State: closed - Opened by rlancemartin over 1 year ago - 1 comment

#43 - a few things to get ready for release

Pull Request - State: closed - Opened by benisgold over 1 year ago - 1 comment

#42 - Add OpenAI grading prompt

Pull Request - State: closed - Opened by rlancemartin almost 2 years ago - 1 comment

#40 - Add instructions to the demo landing page

Issue - State: closed - Opened by rlancemartin almost 2 years ago

#39 - feat: improve UI

Pull Request - State: closed - Opened by dankolesnikov almost 2 years ago - 1 comment

#38 - feat: underline current menu item

Pull Request - State: closed - Opened by dankolesnikov almost 2 years ago - 1 comment

#37 - update labels in graph to match the axis labels

Issue - State: closed - Opened by dankolesnikov almost 2 years ago

#36 - current menu item should be underlines

Issue - State: closed - Opened by dankolesnikov almost 2 years ago

#35 - add a file to the demo envioronment

Issue - State: closed - Opened by dankolesnikov almost 2 years ago

#34 - chore: lfg

Pull Request - State: closed - Opened by dankolesnikov almost 2 years ago - 1 comment

#33 - Finish about page

Pull Request - State: closed - Opened by dankolesnikov almost 2 years ago - 1 comment

#32 - Make all side panels drop-down lists

Issue - State: closed - Opened by rlancemartin almost 2 years ago - 2 comments

#28 - Bug in the FAST scoring

Issue - State: closed - Opened by rlancemartin almost 2 years ago

#27 - [backlog] App re-generating index when it does not need to

Issue - State: closed - Opened by rlancemartin almost 2 years ago

#26 - Add sidebar scrolling

Issue - State: closed - Opened by rlancemartin almost 2 years ago
Labels: bug

#25 - Failure on upload of some PDFs

Issue - State: closed - Opened by rlancemartin almost 2 years ago - 3 comments
Labels: bug