fixie-ai/ai-benchmarks issues and pull requests

#48 - Fix Google auth on Fly

Pull Request - State: closed - Opened by juberti 7 months ago

#47 - Just, anyscale, poetry

Pull Request - State: closed - Opened by juberti 7 months ago

#46 - Add Llama3

Pull Request - State: closed - Opened by juberti 7 months ago

#45 - Prettier names, fix Gemini, remove Gemini filters

Pull Request - State: closed - Opened by juberti 8 months ago

#45 - Prettier names, fix Gemini, remove Gemini filters

Pull Request - State: closed - Opened by juberti 8 months ago

#44 - Write output to GCS when requested

Pull Request - State: closed - Opened by juberti 8 months ago

#44 - Write output to GCS when requested

Pull Request - State: closed - Opened by juberti 8 months ago

#43 - Fix Gemini auth

Pull Request - State: closed - Opened by juberti 8 months ago

#43 - Fix Gemini auth

Pull Request - State: closed - Opened by juberti 8 months ago

#42 - add audio and video support

Pull Request - State: closed - Opened by juberti 8 months ago

#42 - add audio and video support

Pull Request - State: closed - Opened by juberti 8 months ago

#41 - add webapp, rework formatting

Pull Request - State: closed - Opened by juberti 8 months ago

#40 - Fix Markdown, add other Azure gpt-4 regions

Pull Request - State: closed - Opened by juberti 8 months ago

#39 - Add vision, JSON output to suite

Pull Request - State: closed - Opened by juberti 8 months ago

#39 - Add vision, JSON output to suite

Pull Request - State: closed - Opened by juberti 8 months ago

#38 - New suite benchmark with filtering

Pull Request - State: closed - Opened by juberti 8 months ago

#38 - New suite benchmark with filtering

Pull Request - State: closed - Opened by juberti 8 months ago

#37 - Add JSON output and Cohere chat support

Pull Request - State: closed - Opened by juberti 8 months ago

#37 - Add JSON output and Cohere chat support

Pull Request - State: closed - Opened by juberti 8 months ago

#36 - add gpt-4-turbo GA

Pull Request - State: closed - Opened by juberti 8 months ago

#36 - add gpt-4-turbo GA

Pull Request - State: closed - Opened by juberti 8 months ago

#35 - Add fireworks support

Pull Request - State: closed - Opened by juberti 8 months ago

#35 - Add fireworks support

Pull Request - State: closed - Opened by juberti 8 months ago

#34 - Add DallE cross-region test

Pull Request - State: closed - Opened by juberti 9 months ago

#33 - Fix Gemini vision

Pull Request - State: closed - Opened by juberti 9 months ago

#33 - Fix Gemini vision

Pull Request - State: closed - Opened by juberti 9 months ago

#32 - Add 512x512 image

Pull Request - State: closed - Opened by juberti 9 months ago

#32 - Add 512x512 image

Pull Request - State: closed - Opened by juberti 9 months ago

#31 - Update README.md

Pull Request - State: closed - Opened by juberti 9 months ago

#31 - Update README.md

Pull Request - State: closed - Opened by juberti 9 months ago

#30 - Fix Gemini to emit proper TPS reports

Pull Request - State: closed - Opened by juberti 9 months ago

#30 - Fix Gemini to emit proper TPS reports

Pull Request - State: closed - Opened by juberti 9 months ago

#29 - Add Groq support

Pull Request - State: closed - Opened by juberti 9 months ago

#29 - Add Groq support

Pull Request - State: closed - Opened by juberti 9 months ago

#28 - Minor cleanups on benchmarks

Pull Request - State: closed - Opened by juberti 9 months ago

#28 - Minor cleanups on benchmarks

Pull Request - State: closed - Opened by juberti 9 months ago

#27 - Add Claude-3 support (text and vision)

Pull Request - State: closed - Opened by juberti 9 months ago

#27 - Add Claude-3 support (text and vision)

Pull Request - State: closed - Opened by juberti 9 months ago

#26 - Use regular OpenAI protocol for Mistral/Llama

Pull Request - State: closed - Opened by juberti 9 months ago - 1 comment

#26 - Use regular OpenAI protocol for Mistral/Llama

Pull Request - State: closed - Opened by juberti 9 months ago - 1 comment

#25 - Add support for Mistral

Pull Request - State: closed - Opened by mdepinet 9 months ago - 1 comment

#25 - Add support for Mistral

Pull Request - State: closed - Opened by mdepinet 9 months ago - 1 comment

#24 - Add support for Gemini -pro and -pro-vision

Pull Request - State: closed - Opened by juberti 10 months ago

#24 - Add support for Gemini -pro and -pro-vision

Pull Request - State: closed - Opened by juberti 10 months ago

#23 - OAI updated it's Python SDK, so updating FT script to reflect those changes

Pull Request - State: open - Opened by zkoch 11 months ago

#23 - OAI updated it's Python SDK, so updating FT script to reflect those changes

Pull Request - State: open - Opened by zkoch 11 months ago

#22 - Mypy cleanup

Pull Request - State: closed - Opened by juberti 11 months ago

#21 - add support for input images for gpt-4 and gemini

Pull Request - State: closed - Opened by juberti 11 months ago

#21 - add support for input images for gpt-4 and gemini

Pull Request - State: closed - Opened by juberti 11 months ago

#20 - Add dalle support

Pull Request - State: closed - Opened by juberti 12 months ago

#20 - Add dalle support

Pull Request - State: closed - Opened by juberti 12 months ago

#19 - Add Gemini support

Pull Request - State: closed - Opened by juberti 12 months ago

#19 - Add Gemini support

Pull Request - State: closed - Opened by juberti 12 months ago

#18 - Add support for various Llama-13B models

Pull Request - State: closed - Opened by juberti 12 months ago

#18 - Add support for various Llama-13B models

Pull Request - State: closed - Opened by juberti 12 months ago

#17 - Fix text-embedding-ada-002

Pull Request - State: closed - Opened by juberti 12 months ago

#17 - Fix text-embedding-ada-002

Pull Request - State: closed - Opened by juberti 12 months ago

#16 - Add support for PaLM2 chat models

Pull Request - State: closed - Opened by juberti 12 months ago