Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / fixie-ai/ai-benchmarks issues and pull requests
#100 - Fix Anthropic param tweaking
Pull Request -
State: closed - Opened by juberti 5 months ago
#100 - Fix Anthropic param tweaking
Pull Request -
State: closed - Opened by juberti 5 months ago
#99 - Ignore errors when determining stats
Pull Request -
State: closed - Opened by juberti 5 months ago
#99 - Ignore errors when determining stats
Pull Request -
State: closed - Opened by juberti 5 months ago
#98 - Groq models are fp8
Pull Request -
State: closed - Opened by juberti 5 months ago
#98 - Groq models are fp8
Pull Request -
State: closed - Opened by juberti 5 months ago
#97 - Add function calling benchmarks
Pull Request -
State: closed - Opened by juberti 5 months ago
#97 - Add function calling benchmarks
Pull Request -
State: closed - Opened by juberti 5 months ago
#96 - Add GPT-4o Mini
Pull Request -
State: closed - Opened by juberti 5 months ago
#96 - Add GPT-4o Mini
Pull Request -
State: closed - Opened by juberti 5 months ago
#95 - Add Nvidia Llama 3 and Mixtral
Pull Request -
State: closed - Opened by juberti 5 months ago
#95 - Add Nvidia Llama 3 and Mixtral
Pull Request -
State: closed - Opened by juberti 5 months ago
#94 - OctoAI LoRA
Pull Request -
State: closed - Opened by juberti 5 months ago
#94 - OctoAI LoRA
Pull Request -
State: closed - Opened by juberti 5 months ago
#93 - Add Fireworks FP8 and LoRA performance
Pull Request -
State: closed - Opened by juberti 5 months ago
#93 - Add Fireworks FP8 and LoRA performance
Pull Request -
State: closed - Opened by juberti 5 months ago
#92 - Fix Gemini audio/video support - don't disable safety for audio inputs
Pull Request -
State: closed - Opened by juberti 5 months ago
#92 - Fix Gemini audio/video support - don't disable safety for audio inputs
Pull Request -
State: closed - Opened by juberti 5 months ago
#91 - use updated baseten url
Pull Request -
State: closed - Opened by rcano-baseten 5 months ago
#91 - use updated baseten url
Pull Request -
State: closed - Opened by rcano-baseten 5 months ago
#90 - Restore parallel default
Pull Request -
State: closed - Opened by juberti 5 months ago
#90 - Restore parallel default
Pull Request -
State: closed - Opened by juberti 5 months ago
#89 - Allow serial requests and control of connection reuse
Pull Request -
State: closed - Opened by juberti 5 months ago
#89 - Allow serial requests and control of connection reuse
Pull Request -
State: closed - Opened by juberti 5 months ago
#88 - Read entire stream before closing
Pull Request -
State: closed - Opened by juberti 5 months ago
#88 - Read entire stream before closing
Pull Request -
State: closed - Opened by juberti 5 months ago
#87 - Add Ultravox on Baseten
Pull Request -
State: closed - Opened by juberti 5 months ago
#87 - Add Ultravox on Baseten
Pull Request -
State: closed - Opened by juberti 5 months ago
#86 - Wire up Ultravox in audio models
Pull Request -
State: closed - Opened by juberti 5 months ago
#86 - Wire up Ultravox in audio models
Pull Request -
State: closed - Opened by juberti 5 months ago
#85 - Don't use OPENAI_API_KEY if we're using base_url
Pull Request -
State: closed - Opened by juberti 5 months ago
#85 - Don't use OPENAI_API_KEY if we're using base_url
Pull Request -
State: closed - Opened by juberti 5 months ago
#84 - Fix 401 Unauthorized on OVHcloud calls
Pull Request -
State: closed - Opened by Joffref 5 months ago
- 3 comments
#84 - Fix 401 Unauthorized on OVHcloud calls
Pull Request -
State: closed - Opened by Joffref 5 months ago
- 3 comments
#83 - Update to prod FireFunction v2
Pull Request -
State: closed - Opened by juberti 5 months ago
#83 - Update to prod FireFunction v2
Pull Request -
State: closed - Opened by juberti 5 months ago
#82 - [feat] add DeepInfra benchmarks
Pull Request -
State: closed - Opened by ovuruska 5 months ago
- 4 comments
#82 - [feat] add DeepInfra benchmarks
Pull Request -
State: closed - Opened by ovuruska 5 months ago
- 4 comments
#81 - add Claude Sonnet 3.5
Pull Request -
State: closed - Opened by juberti 5 months ago
#81 - add Claude Sonnet 3.5
Pull Request -
State: closed - Opened by juberti 5 months ago
#80 - Modify OVHcloud LLM URL
Pull Request -
State: closed - Opened by Joffref 6 months ago
#80 - Modify OVHcloud LLM URL
Pull Request -
State: closed - Opened by Joffref 6 months ago
#79 - Fix KeyError seen in logs
Pull Request -
State: closed - Opened by juberti 6 months ago
#78 - Add OVHcloud Llama 3 models
Pull Request -
State: closed - Opened by juberti 6 months ago
#78 - Add OVHcloud Llama 3 models
Pull Request -
State: closed - Opened by juberti 6 months ago
#77 - handle aiohttp client errors
Pull Request -
State: closed - Opened by juberti 6 months ago
#76 - Add Azure GPT-4o
Pull Request -
State: closed - Opened by juberti 6 months ago
#76 - Add Azure GPT-4o
Pull Request -
State: closed - Opened by juberti 6 months ago
#75 - add v2
Pull Request -
State: closed - Opened by juberti 6 months ago
#74 - Add OSS function call model
Pull Request -
State: closed - Opened by juberti 6 months ago
#74 - Add OSS function call model
Pull Request -
State: closed - Opened by juberti 6 months ago
#73 - Add Gemini Flash
Pull Request -
State: closed - Opened by juberti 7 months ago
#73 - Add Gemini Flash
Pull Request -
State: closed - Opened by juberti 7 months ago
#72 - remove azure mistral
Pull Request -
State: closed - Opened by juberti 7 months ago
#72 - remove azure mistral
Pull Request -
State: closed - Opened by juberti 7 months ago
#71 - Add gpt-4o
Pull Request -
State: closed - Opened by juberti 7 months ago
#71 - Add gpt-4o
Pull Request -
State: closed - Opened by juberti 7 months ago
#70 - Remove deprecated models
Pull Request -
State: closed - Opened by juberti 7 months ago
#70 - Remove deprecated models
Pull Request -
State: closed - Opened by juberti 7 months ago
#69 - Remove deprecated models
Pull Request -
State: closed - Opened by juberti 7 months ago
#69 - Remove deprecated models
Pull Request -
State: closed - Opened by juberti 7 months ago
#68 - Factor out LlmRequest to address timeout errors
Pull Request -
State: closed - Opened by juberti 7 months ago
#68 - Factor out LlmRequest to address timeout errors
Pull Request -
State: closed - Opened by juberti 7 months ago
#67 - Cleanup for error handling PR
Pull Request -
State: closed - Opened by juberti 7 months ago
#67 - Cleanup for error handling PR
Pull Request -
State: closed - Opened by juberti 7 months ago
#66 - Fix serialization, add test
Pull Request -
State: closed - Opened by juberti 7 months ago
#66 - Fix serialization, add test
Pull Request -
State: closed - Opened by juberti 7 months ago
#65 - Return error/timeout results in response
Pull Request -
State: closed - Opened by juberti 7 months ago
#65 - Return error/timeout results in response
Pull Request -
State: closed - Opened by juberti 7 months ago
#64 - Add built-in prompt for image suite
Pull Request -
State: closed - Opened by juberti 7 months ago
#64 - Add built-in prompt for image suite
Pull Request -
State: closed - Opened by juberti 7 months ago
#63 - Add timeout
Pull Request -
State: closed - Opened by juberti 7 months ago
#63 - Add timeout
Pull Request -
State: closed - Opened by juberti 7 months ago
#62 - disable together mixtral 8x22b, super slow
Pull Request -
State: closed - Opened by juberti 7 months ago
#62 - disable together mixtral 8x22b, super slow
Pull Request -
State: closed - Opened by juberti 7 months ago
#61 - Add mixtral 8x22b
Pull Request -
State: closed - Opened by juberti 7 months ago
#61 - Add mixtral 8x22b
Pull Request -
State: closed - Opened by juberti 7 months ago
#60 - Remove databricks hacks, not actually needed
Pull Request -
State: closed - Opened by juberti 7 months ago
#60 - Remove databricks hacks, not actually needed
Pull Request -
State: closed - Opened by juberti 7 months ago
#59 - Only set display_name when set
Pull Request -
State: closed - Opened by juberti 7 months ago
#59 - Only set display_name when set
Pull Request -
State: closed - Opened by juberti 7 months ago
#58 - Fix --store
Pull Request -
State: closed - Opened by juberti 7 months ago
#58 - Fix --store
Pull Request -
State: closed - Opened by juberti 7 months ago
#57 - Fix app
Pull Request -
State: closed - Opened by juberti 7 months ago
#57 - Fix app
Pull Request -
State: closed - Opened by juberti 7 months ago
#56 - Rework parsing to handle non-str args
Pull Request -
State: closed - Opened by juberti 7 months ago
#56 - Rework parsing to handle non-str args
Pull Request -
State: closed - Opened by juberti 7 months ago
#55 - Add spread parameter
Pull Request -
State: closed - Opened by juberti 7 months ago
#55 - Add spread parameter
Pull Request -
State: closed - Opened by juberti 7 months ago
#54 - Add phi-2 on Together
Pull Request -
State: closed - Opened by benlower 7 months ago
#53 - Add more Llama 3 hosts and fix deploy action
Pull Request -
State: closed - Opened by juberti 7 months ago
#53 - Add more Llama 3 hosts and fix deploy action
Pull Request -
State: closed - Opened by juberti 7 months ago
#52 - Adding GH action for deployment
Pull Request -
State: closed - Opened by benlower 7 months ago
#52 - Adding GH action for deployment
Pull Request -
State: closed - Opened by benlower 7 months ago
#51 - add phi-2 from Cloudflare
Pull Request -
State: closed - Opened by benlower 7 months ago
#51 - add phi-2 from Cloudflare
Pull Request -
State: closed - Opened by benlower 7 months ago
#50 - Canonicalize common model names and provider names
Pull Request -
State: closed - Opened by juberti 7 months ago
#49 - Add Databricks support
Pull Request -
State: closed - Opened by juberti 7 months ago
#49 - Add Databricks support
Pull Request -
State: closed - Opened by juberti 7 months ago
#48 - Fix Google auth on Fly
Pull Request -
State: closed - Opened by juberti 7 months ago