Data

Tools

Indexes

Applications

Experiments

Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / anaconda/llm-eval issues and pull requests

#92 - Refactor sik llms

Pull Request - State: closed - Opened by shane-kercheval about 2 months ago

#91 - Updated license to BSD-3

Pull Request - State: closed - Opened by shane-kercheval about 2 months ago

#90 - [Snyk] Fix for 3 vulnerabilities

Pull Request - State: open - Opened by anaconda-security-bot about 2 months ago

#89 - Added gpt 4.1 models and pricing to openai.py

Pull Request - State: closed - Opened by shane-kercheval 4 months ago

#87 - Added support for AWS Bedrock & Claude

Pull Request - State: closed - Opened by shane-kercheval 6 months ago

#86 - Update dependencies to fix env conflicts

Pull Request - State: closed - Opened by m-navarro93 8 months ago

#85 - updated linting based on latest version of ruff

Pull Request - State: closed - Opened by shane-kercheval 8 months ago

#84 - Dev shane

Pull Request - State: closed - Opened by shane-kercheval 8 months ago

#83 - Updated examples and docstrings based on the prior refactor

Pull Request - State: closed - Opened by shane-kercheval 9 months ago

#82 - Dev shane

Pull Request - State: closed - Opened by shane-kercheval 9 months ago

#81 - Dev shane

Pull Request - State: closed - Opened by shane-kercheval 9 months ago

#80 - Dev shane

Pull Request - State: closed - Opened by shane-kercheval 9 months ago

#79 - Eval refactor

Pull Request - State: closed - Opened by shane-kercheval 9 months ago

#78 - Kur 215/nvidia f1

Pull Request - State: closed - Opened by shane-kercheval 9 months ago

#76 - [Snyk] Fix for 4 vulnerabilities

Pull Request - State: closed - Opened by nwankwon 9 months ago

#75 - Kur 215/nvidia f1

Pull Request - State: closed - Opened by shane-kercheval 9 months ago

#74 - [Snyk] Fix for 4 vulnerabilities

Pull Request - State: closed - Opened by rmyers 9 months ago

#73 - [Snyk] Fix for 4 vulnerabilities

Pull Request - State: closed - Opened by elize-anaconda 9 months ago

#72 - Add Anthropic

Pull Request - State: closed - Opened by ahuang11 9 months ago - 1 comment

#71 - Feature/kur 215

Pull Request - State: closed - Opened by Prasidh 9 months ago

#70 - [Snyk] Security upgrade python from 3.11 to 3.14-rc-slim

Pull Request - State: closed - Opened by nwankwon 9 months ago

#69 - Feature/kur 215/Eval dataset generation + metric calculation

Pull Request - State: closed - Opened by Prasidh 9 months ago

#68 - Update test_mistralai.py

Pull Request - State: closed - Opened by ahuang11 10 months ago

#67 - Support MistralAI (service) calls

Pull Request - State: closed - Opened by ahuang11 10 months ago

#66 - [Snyk] Security upgrade python from 3.11 to 3.13.0rc1-slim

Pull Request - State: closed - Opened by nwankwon 10 months ago - 1 comment

#65 - Fix not string types with allow_regex

Pull Request - State: closed - Opened by ahuang11 11 months ago

#64 - gpt-4o-2024-08-06 openai pricing

Pull Request - State: closed - Opened by shane-kercheval 11 months ago

#63 - Prompt refactor

Pull Request - State: closed - Opened by shane-kercheval 12 months ago

#62 - A util to intercept messages and do evals statically

Issue - State: open - Opened by ahuang11 12 months ago - 2 comments

#61 - Do not require a assistant/user pair for previous_messages

Issue - State: closed - Opened by ahuang11 12 months ago - 1 comment

#59 - updated EvalHarness so that it works with async candidates

Pull Request - State: closed - Opened by shane-kercheval 12 months ago

#58 - Update Installation Instructions

Pull Request - State: closed - Opened by m-navarro93 about 1 year ago

#57 - updated pydantic from 2.5 to 2.8

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#56 - added `gpt-4o-mini-2024-07-18` model and pricing

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#55 - [Snyk] Security upgrade python from 3.11 to 3.13.0b2-slim

Pull Request - State: closed - Opened by nwankwon about 1 year ago

#54 - Example evaluations supported on README

Pull Request - State: closed - Opened by sadasant about 1 year ago

#53 - Update requirements.txt

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#52 - Fixed linting

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#51 - Fix issue #49 - Readme feedback

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#49 - Readme feedback

Issue - State: closed - Opened by kathatherine about 1 year ago - 1 comment

#48 - Fixed dependency changes after previous PR

Pull Request - State: closed - Opened by sadasant about 1 year ago

#46 - Updating OpenAI and Tiktoken dependencies

Pull Request - State: closed - Opened by sadasant about 1 year ago

#43 - added LambdaCheck for dynamic testing

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#42 - chore: Add OpenAIServerCandidate

Pull Request - State: closed - Opened by creeves-anaconda about 1 year ago

#41 - added value_extractor to Check

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#40 - updated examples

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#36 - added negate option to MatchCheck, ContainsCheck, and RegexCheck

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#33 - Fix f-string

Pull Request - State: closed - Opened by ahuang11 about 1 year ago

#32 - Support tool calls

Pull Request - State: closed - Opened by ahuang11 about 1 year ago - 7 comments

#31 - Documentation

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#30 - Documentation

Pull Request - State: closed - Opened by shane-kercheval about 1 year ago

#29 - Setup Project for Packaging

Pull Request - State: closed - Opened by m-navarro93 over 1 year ago - 1 comment

#25 - bug fixes and linting

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#24 - Idea for possibly fixing context limit reached error

Pull Request - State: closed - Opened by sadasant over 1 year ago

#23 - Fix to eval-specific system_message and previous_messages

Pull Request - State: closed - Opened by sadasant over 1 year ago

#22 - Add an llm-eval version to the yaml specifications

Issue - State: open - Opened by sadasant over 1 year ago

#20 - fixed hugging face issue and updated message formatting logic

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#17 - Initial soft metrics via LLMCheck

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#15 - Allowing evals to modify system parameters

Pull Request - State: closed - Opened by sadasant over 1 year ago

#14 - Dev shane

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#13 - added EvalResult to_json, from_json

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#11 - Dev shane

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#10 - various renaming for consistency

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#9 - added timestamp to EvalResult

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#7 - added filter functions for list of EvalResults

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#5 - Dev shane

Pull Request - State: closed - Opened by shane-kercheval over 1 year ago

#1 - chore: Configure Renovate

Pull Request - State: closed - Opened by anaconda-renovate[bot] over 1 year ago - 1 comment
Labels: renovate