Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / athina-ai/athina-evals issues and pull requests

#19 - Fix: Handle NaN values in Ragas evaluators

Pull Request - State: closed - Opened by shivsak 8 months ago - 2 comments

#18 - add llama index support for ragas ATH-751

Pull Request - State: closed - Opened by akshat-g 8 months ago - 1 comment

#17 - add support for openai < 1 version

Pull Request - State: closed - Opened by akshat-g 8 months ago - 2 comments

#16 - New Evals: Answer Similarity + Context Similarity

Pull Request - State: closed - Opened by vivek-athina 9 months ago - 3 comments

#15 - minor bug fix in function evals

Pull Request - State: closed - Opened by vivek-athina 9 months ago - 2 comments

#14 - ATH-720: Feature: Groundedness Evaluator

Pull Request - State: closed - Opened by shivsak 9 months ago - 1 comment

#13 - add ragas metrics

Pull Request - State: closed - Opened by akshat-g 9 months ago - 1 comment

#12 - added remaining functions from legacy sdk

Pull Request - State: closed - Opened by vivek-athina 9 months ago - 2 comments

#11 - Feature/integrate ragas

Pull Request - State: closed - Opened by akshat-g 9 months ago - 1 comment

#10 - move ragas and function evaluators to dev

Pull Request - State: closed - Opened by akshat-g 9 months ago - 1 comment

#9 - 0.1.5: FunctionEvaluators + RagasEvaluator + Refactored Base Evaluator

Pull Request - State: closed - Opened by vivek-athina 9 months ago - 1 comment

#7 - ATH-665: Updated names and constructor args for GradingCriteria and CustomPrompt evals

Pull Request - State: closed - Opened by shivsak 9 months ago - 1 comment

#6 - Feature/ath 603 function based evals

Pull Request - State: closed - Opened by vivek-athina 9 months ago - 3 comments

#4 - add metrics to llmevals ATH-613

Pull Request - State: closed - Opened by akshat-g 10 months ago - 1 comment

#3 - Feature: SummaryAccuracy evaluator with metrics + multiple question answerer classes

Pull Request - State: closed - Opened by shivsak 10 months ago - 1 comment

#2 - ATH-497: Added support for logging eval results to Athina API

Pull Request - State: closed - Opened by shivsak 10 months ago - 1 comment

#1 - [WIP] ATH-479: Added API Evaluator class that triggers eval via Athina API

Pull Request - State: closed - Opened by shivsak 10 months ago - 1 comment