Data

Tools

Indexes

Applications

Experiments

Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / microsoft/eureka-ml-insights issues and pull requests

#156 - Readme

Pull Request - State: closed - Opened by safooray 2 months ago

#155 - Readme

Pull Request - State: closed - Opened by safooray 2 months ago

#154 - aime readme

Pull Request - State: closed - Opened by lchen001 2 months ago

#153 - Updated hf file locations.

Pull Request - State: closed - Opened by vibhav-vineet 2 months ago

#152 - Adding BoN+WoN reporting to SAT config file.

Pull Request - State: closed - Opened by vibhav-vineet 2 months ago

#151 - Minorfixes

Pull Request - State: closed - Opened by safooray 2 months ago

#150 - TSP and SAT specs

Pull Request - State: closed - Opened by vibhav-vineet 2 months ago

#149 - update aime spec

Pull Request - State: closed - Opened by lchen001 2 months ago

#148 - LLM extractor for SAT problem

Pull Request - State: closed - Opened by vibhav-vineet 2 months ago - 2 comments

#147 - adding specs for omni math and ba_calendar

Pull Request - State: closed - Opened by vidhishanair 2 months ago

#146 - llm extraction

Pull Request - State: closed - Opened by lchen001 3 months ago

#145 - Small PR to add Sat metrics

Pull Request - State: closed - Opened by vibhav-vineet 3 months ago

#144 - Benushi/kitab updates

Pull Request - State: closed - Opened by nushib 3 months ago

#143 - Llm extract

Pull Request - State: closed - Opened by safooray 3 months ago

#142 - Update eureka-tests.yml

Pull Request - State: closed - Opened by vidhishanair 3 months ago

#141 - aime aggregation update

Pull Request - State: closed - Opened by lchen001 3 months ago

#140 - Data comps

Pull Request - State: closed - Opened by safooray 3 months ago

#139 - Metric args

Pull Request - State: closed - Opened by safooray 3 months ago

#138 - Vibhav/sat2

Pull Request - State: closed - Opened by vibhav-vineet 3 months ago

#137 - Vibhav/sat1

Pull Request - State: closed - Opened by vibhav-vineet 3 months ago

#136 - Vibhav/tsp1

Pull Request - State: closed - Opened by vibhav-vineet 3 months ago - 2 comments

#135 - update aime metric

Pull Request - State: closed - Opened by lchen001 3 months ago

#134 - Bump http-proxy-middleware from 2.0.7 to 2.0.9 in /website

Pull Request - State: closed - Opened by dependabot[bot] 3 months ago
Labels: dependencies, javascript

#133 - Add vision evals

Pull Request - State: closed - Opened by michaelharrisonmai 3 months ago

#131 - AIME update

Pull Request - State: closed - Opened by lchen001 4 months ago

#130 - Added parameter to take first or last answer

Pull Request - State: closed - Opened by neelsj 4 months ago

#129 - Phi4 answer parsing

Pull Request - State: closed - Opened by neelsj 4 months ago - 1 comment

#128 - Ifeval updates

Pull Request - State: closed - Opened by vidhishanair 4 months ago

#127 - Jsonlines

Pull Request - State: closed - Opened by safooray 4 months ago - 2 comments

#126 - Benushi/seed bugfix

Pull Request - State: closed - Opened by nushib 4 months ago

#125 - vllm version upgrade

Pull Request - State: closed - Opened by safooray 4 months ago

#124 - Bump estree-util-value-to-estree from 3.1.2 to 3.3.3 in /website

Pull Request - State: closed - Opened by dependabot[bot] 4 months ago
Labels: dependencies, javascript

#123 - Phi sys

Pull Request - State: closed - Opened by safooray 4 months ago

#122 - Phi sys

Pull Request - State: closed - Opened by safooray 4 months ago

#121 - Vllm hotfix

Pull Request - State: closed - Opened by safooray 4 months ago

#119 - Bump image-size from 1.1.1 to 1.2.1 in /website

Pull Request - State: closed - Opened by dependabot[bot] 4 months ago
Labels: dependencies, javascript

#118 - add max_concurrent as a model parameter

Pull Request - State: closed - Opened by michaelharrisonmai 4 months ago - 4 comments

#117 - minor fixes

Pull Request - State: closed - Opened by michaelharrisonmai 4 months ago

#116 - Bump vllm from 0.7.2 to 0.8.1

Pull Request - State: closed - Opened by dependabot[bot] 4 months ago - 1 comment
Labels: dependencies, python

#115 - Configs for bigger maze dataset and COT vs non COT prompt options

Pull Request - State: closed - Opened by neelsj 4 months ago

#114 - Report aggregation change for gpqa, Claude 3.7 config update

Pull Request - State: closed - Opened by nushib 5 months ago

#113 - Bump vllm from 0.7.2 to 0.8.0

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago - 1 comment
Labels: dependencies, python

#112 - Option to pass extra body to openai

Pull Request - State: closed - Opened by vidhishanair 5 months ago - 3 comments

#111 - Remove inference batching

Pull Request - State: closed - Opened by michaelharrisonmai 5 months ago

#110 - validate usage columns for extract usage

Pull Request - State: closed - Opened by vidhishanair 5 months ago

#109 - Bump @babel/runtime from 7.25.6 to 7.26.10 in /website

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies, javascript

#108 - Bump @babel/helpers from 7.25.6 to 7.26.10 in /website

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies, javascript

#107 - Bump @babel/runtime-corejs3 from 7.25.6 to 7.26.10 in /website

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies, javascript

#106 - Benushi/serverless r1 azure

Pull Request - State: closed - Opened by nushib 5 months ago

#105 - Addressing concurrency issues

Pull Request - State: closed - Opened by safooray 5 months ago

#104 - Bump prismjs from 1.29.0 to 1.30.0 in /website

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies, javascript

#103 - Add support for claude thinking models

Pull Request - State: closed - Opened by Holmeswww 5 months ago - 1 comment

#102 - LocalVLLMModel and deployment handler

Pull Request - State: closed - Opened by michaelharrisonmai 5 months ago - 1 comment

#101 - Gpqa security

Pull Request - State: closed - Opened by safooray 5 months ago

#100 - configuring the openai base url

Pull Request - State: closed - Opened by vidhishanair 5 months ago

#99 - GSM8K benchmark integration

Pull Request - State: closed - Opened by risaueno 5 months ago - 3 comments

#98 - use vllm's template conversion

Pull Request - State: closed - Opened by michaelharrisonmai 5 months ago - 2 comments

#97 - AIME Metric Update

Pull Request - State: closed - Opened by lchen001 5 months ago

#96 - Onboarding Omni_Math Benchmark

Pull Request - State: closed - Opened by vidhishanair 6 months ago

#95 - adding together ai models

Pull Request - State: closed - Opened by nushib 6 months ago

#94 - adding new configs for open ai, gemini, claude, and phi hf

Pull Request - State: closed - Opened by nushib 6 months ago

#93 - Adds support for vLLM-based models.

Pull Request - State: closed - Opened by gugarosa 6 months ago - 1 comment

#92 - o3 changes

Pull Request - State: closed - Opened by vidhishanair 6 months ago - 2 comments

#91 - Adding Phi4 model and configs and HF model cleanup

Pull Request - State: closed - Opened by neelsj 6 months ago

#90 - Aime seq

Pull Request - State: closed - Opened by safooray 6 months ago - 1 comment

#89 - adding timeout for rest endpoints

Pull Request - State: closed - Opened by vidhishanair 6 months ago

#88 - Vidhisha/ba benchmarks

Pull Request - State: closed - Opened by vidhishanair 6 months ago

#87 - Add TSP files

Pull Request - State: closed - Opened by vibhav-vineet 6 months ago

#86 - Aggregator fix

Pull Request - State: closed - Opened by safooray 6 months ago

#85 - Adding option to include pvt configs without tracking

Pull Request - State: closed - Opened by vidhishanair 6 months ago

#84 - Gpqa experiment pipeline updates

Pull Request - State: closed - Opened by nushib 6 months ago

#83 - Chat mode

Pull Request - State: closed - Opened by safooray 6 months ago

#82 - add random state for majority vote

Pull Request - State: closed - Opened by lchen001 6 months ago

#81 - break ties randomly for majority vote

Pull Request - State: closed - Opened by lchen001 6 months ago

#80 - Hotfix to skip dev/system and images messages for o1-preview

Pull Request - State: closed - Opened by neelsj 6 months ago

#79 - gemini models bug fix - error handling

Pull Request - State: closed - Opened by nushib 6 months ago

#78 - Add TSP files

Pull Request - State: closed - Opened by vibhav-vineet 6 months ago

#77 - Unknown args

Pull Request - State: closed - Opened by safooray 7 months ago

#76 - Resume from fix

Pull Request - State: closed - Opened by safooray 7 months ago

#75 - Neel/o1 imagefix

Pull Request - State: closed - Opened by neelsj 7 months ago

#74 - Hotfix

Pull Request - State: closed - Opened by safooray 7 months ago

#73 - Circular import

Pull Request - State: closed - Opened by safooray 8 months ago

#72 - numeric match and topic tag

Pull Request - State: closed - Opened by lchen001 8 months ago

#71 - add llava multigpu capability

Pull Request - State: closed - Opened by vibhav-vineet 8 months ago

#70 - small updates to llama model class

Pull Request - State: closed - Opened by vibhav-vineet 8 months ago

#69 - Bump cross-spawn from 7.0.3 to 7.0.6 in /website

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies, javascript

#68 - Bump nanoid from 3.3.7 to 3.3.8 in /website

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies, javascript

#67 - Bump path-to-regexp, serve-handler and express in /website

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies, javascript

#66 - Readme fix

Pull Request - State: closed - Opened by safooray 8 months ago - 1 comment

#65 - [refactor] try to make DefaultAzureCredential func configurable

Pull Request - State: open - Opened by lalo 8 months ago

#64 - Some pipeline configs in README.md lead to 404 error

Issue - State: closed - Opened by TolgaAktas 8 months ago

#63 - multi-turn conversations

Pull Request - State: closed - Opened by safooray 8 months ago

#62 - updated log dl links to huggingface

Pull Request - State: closed - Opened by neelsj 8 months ago

#61 - Updating website model colors

Pull Request - State: closed - Opened by jluey1 8 months ago

#60 - readme updates

Pull Request - State: closed - Opened by safooray 8 months ago

#59 - fixing accessibility issue and minor cleanup

Pull Request - State: closed - Opened by jluey1 8 months ago - 1 comment

#58 - Adding new benchmark - BA-Calendar

Pull Request - State: closed - Opened by vidhishanair 8 months ago - 1 comment

#57 - Neel/spatial map answer extraction

Pull Request - State: closed - Opened by neelsj 8 months ago