Data

Tools

Indexes

Applications

Experiments

Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / langchain-ai/langchain-benchmarks issues and pull requests

#213 - Fix poetry version syntax in pyproject.toml file

Pull Request - State: open - Opened by legendof-selda 8 months ago

#211 - benchmarks[major]: bump core to 0.3

Pull Request - State: closed - Opened by ccurme 10 months ago

#209 - add faiss-cpu dependency

Pull Request - State: closed - Opened by isahers1 12 months ago

#208 - Isaac/realfixes

Pull Request - State: closed - Opened by isahers1 12 months ago

#207 - Isaac/realfixes

Pull Request - State: closed - Opened by isahers1 12 months ago

#206 - change wd

Pull Request - State: closed - Opened by isahers1 12 months ago

#205 - thanks erick

Pull Request - State: closed - Opened by isahers1 12 months ago

#204 - test

Pull Request - State: closed - Opened by isahers1 12 months ago

#203 - test

Pull Request - State: closed - Opened by isahers1 12 months ago

#202 - Isaac/tryingpoetryagain

Pull Request - State: closed - Opened by isahers1 12 months ago

#201 - Isaac/changepoetry

Pull Request - State: closed - Opened by isahers1 12 months ago

#200 - test

Pull Request - State: closed - Opened by isahers1 12 months ago

#199 - Isaac/fixbenchmarkaction

Pull Request - State: closed - Opened by isahers1 12 months ago

#198 - test

Pull Request - State: closed - Opened by isahers1 12 months ago

#197 - Issue #196 : Update evaluators.py

Pull Request - State: open - Opened by abhinav-kimothi about 1 year ago - 1 comment

#196 - Error in get_eval_config()

Issue - State: open - Opened by abhinav-kimothi about 1 year ago

#195 - docs: update README.md

Pull Request - State: closed - Opened by eltociear about 1 year ago

#194 - Release 0.0.14

Pull Request - State: closed - Opened by baskaryan about 1 year ago

#193 - infra: release permissions

Pull Request - State: closed - Opened by baskaryan about 1 year ago

#192 - Release 0.0.13

Pull Request - State: closed - Opened by baskaryan about 1 year ago

#191 - minor: bump to langchain v2

Pull Request - State: closed - Opened by baskaryan about 1 year ago

#190 - tool benchmarking

Pull Request - State: closed - Opened by isahers1 about 1 year ago

#189 - adding extraction task

Pull Request - State: closed - Opened by isahers1 about 1 year ago

#188 - automating tool benchmarks

Pull Request - State: closed - Opened by isahers1 about 1 year ago

#187 - Update README.md

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#186 - Update README.md

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#185 - Update README.md

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#184 - Update README.md

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#183 - Release 0.0.12

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#182 - Update README.md

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#181 - Update README.md

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#180 - Add security policy

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#179 - Update benchmarks all notebook to use {question} instead of {input}

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#178 - Simplify all tool usage notebooks

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#177 - Update intro, remove adapter

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#176 - Remove old code

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#175 - remove tiny multiverse dataset from registry

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#174 - Update benchmark all for agents

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#173 - Fix list of env variables in benchmark all notebook

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#172 - Test some other models

Issue - State: open - Opened by eyurtsev over 1 year ago

#171 - add tool calling benchmark notebook

Pull Request - State: closed - Opened by ccurme over 1 year ago - 1 comment

#170 - Update deps

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#169 - Add factory for regular tool using agents

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#168 - update model providers

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#167 - update dependencies

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#166 - docs: add high cardinality links

Pull Request - State: closed - Opened by baskaryan over 1 year ago

#165 - docs: include high cardinality

Pull Request - State: closed - Opened by baskaryan over 1 year ago

#164 - Add high cardinality benchmark

Pull Request - State: closed - Opened by baskaryan over 1 year ago

#163 - add notebook for custom chain benchmarking on extraction data

Pull Request - State: open - Opened by hwchase17 over 1 year ago - 1 comment

#162 - Update README.md to fix archived links

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#161 - Is it possible to change the model evaluator?

Issue - State: open - Opened by daniellefranca96 over 1 year ago

#160 - Missing Word in comparing_techniques.ipynb

Pull Request - State: closed - Opened by MaruthiKo over 1 year ago - 1 comment

#158 - [Feature req] Agents: comparing fine-tuning techniques

Issue - State: open - Opened by hinthornw over 1 year ago

#157 - Update evaluators

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#156 - Add runnable agent factory

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#155 - Register the new dataset

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#153 - updated `Makefile`

Pull Request - State: closed - Opened by leo-gan over 1 year ago - 1 comment

#152 - Update Math Evaluator

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#151 - Add Gemini

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#150 - Analysis

Pull Request - State: open - Opened by eyurtsev over 1 year ago

#149 - Add to toc

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#148 - Update Benchmark All

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#147 - Include assistant factory in benchmark all

Pull Request - State: closed - Opened by hinthornw over 1 year ago - 1 comment

#146 - Update notebooks

Pull Request - State: closed - Opened by eyurtsev over 1 year ago - 1 comment

#145 - Update example in multiverse math

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#144 - OAI Assistant

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#143 - Update openai function factory, update benchmark all

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#142 - Parser Fix

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#141 - Implementation of anthropic agent

Pull Request - State: open - Opened by eyurtsev over 1 year ago - 1 comment

#140 - Anthropic agent tool usage implementation

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#139 - Add anthropic agent based on tool user repo

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#138 - Fix openai output parser used

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#137 - Run w/o langsmith

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#136 - 🐶

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#135 - Add Anyscale Model

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#134 - Update benchmark all notebook

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#133 - Version 0.0.10

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#132 - Update min langsmith client

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#131 - Update notebooks, model registry and make release

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#130 - Add version

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#129 - Evaluate image resolution for multi-modal RAG

Pull Request - State: closed - Opened by rlancemartin over 1 year ago

#128 - Update fireworks models

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#127 - remove with_rate_limit from public api

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#126 - Add __contains__ to model registry

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#125 - Add gemini mm examples

Pull Request - State: closed - Opened by hinthornw over 1 year ago

#124 - Bump ruff fix up first party identity for import sorting

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#123 - Minor clean, add Mixtral

Pull Request - State: closed - Opened by rlancemartin over 1 year ago

#122 - Release 0.0.8

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#121 - Add rate limiter

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#120 - Adds custom agents to the langchain benchmarking repo

Pull Request - State: closed - Opened by eyurtsev over 1 year ago - 2 comments

#119 - Use `type` rather than `Type`

Pull Request - State: open - Opened by eyurtsev over 1 year ago - 1 comment

#118 - Benchmark all tool usage notebook

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#117 - Add gpt-4 models

Pull Request - State: closed - Opened by eyurtsev over 1 year ago

#116 - Fireworks additional models (WIP)

Pull Request - State: open - Opened by eyurtsev over 1 year ago

#115 - Move mixtral models

Pull Request - State: closed - Opened by hinthornw over 1 year ago