Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / iree-org/iree-comparative-benchmark issues and pull requests

#184 - Update contribution guidelines

Pull Request - State: closed - Opened by marbre 4 months ago

#183 - Bump certifi from 2023.7.22 to 2024.7.4 in /devtools/db_import

Pull Request - State: open - Opened by dependabot[bot] 5 months ago
Labels: dependencies

#182 - Fix Gemma artifact generation

Pull Request - State: closed - Opened by mariecwhite 5 months ago

#181 - Add dotprod microbenchmark artifacts.

Pull Request - State: open - Opened by mariecwhite 5 months ago

#180 - Add Gemma 2B IT models

Pull Request - State: closed - Opened by mariecwhite 5 months ago

#179 - Bump urllib3 from 1.26.18 to 1.26.19 in /devtools/db_import

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies

#178 - Fix build failures

Pull Request - State: closed - Opened by mariecwhite 6 months ago

#177 - Bump requests from 2.31.0 to 2.32.0 in /devtools/db_import

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: dependencies

#176 - SD_PIPELINE_FP16_JAX benchmark executes in FP32

Issue - State: open - Opened by ekuznetsov139 7 months ago

#175 - [DNS] Test CI

Pull Request - State: closed - Opened by pzread 7 months ago

#174 - Output 0 exceeds tolerance?

Issue - State: open - Opened by ekuznetsov139 7 months ago

#173 - Use stable URL for IREE pip-release-links.

Pull Request - State: closed - Opened by ScottTodd 7 months ago - 1 comment

#172 - Bump idna from 3.4 to 3.7 in /devtools/db_import

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#171 - Update JAX CUDA release

Pull Request - State: closed - Opened by mariecwhite 8 months ago

#170 - Clarify scope of the project in README.md

Pull Request - State: open - Opened by cheshire 8 months ago

#168 - Update JAX and TFLite artifacts

Pull Request - State: closed - Opened by mariecwhite 9 months ago - 2 comments

#167 - Enable softmax

Pull Request - State: closed - Opened by mariecwhite 10 months ago

#166 - Update JAX and TFLite Models

Pull Request - State: closed - Opened by mariecwhite 10 months ago - 1 comment

#165 - Re-enable previously failing benchmarks

Pull Request - State: closed - Opened by mariecwhite 10 months ago - 1 comment

#164 - Re-enable FP16 for Android

Pull Request - State: closed - Opened by mariecwhite 11 months ago

#163 - Fix JAX-IREE:CPU

Pull Request - State: closed - Opened by mariecwhite 11 months ago - 1 comment

#162 - Some benchmark maintenance

Pull Request - State: closed - Opened by mariecwhite 11 months ago

#161 - Update Pixel 8 Pro CPU feature flags

Pull Request - State: closed - Opened by mariecwhite 12 months ago - 2 comments

#160 - Update int8 TFLite model generation

Pull Request - State: closed - Opened by mariecwhite 12 months ago

#159 - Run benchmarks on Pixel-8-Pro

Pull Request - State: closed - Opened by mariecwhite 12 months ago - 2 comments

#157 - Revert Bazel version

Pull Request - State: closed - Opened by mariecwhite 12 months ago

#156 - Build TFLite benchmark_model with special flags

Pull Request - State: closed - Opened by mariecwhite 12 months ago - 1 comment

#155 - Regenerate TFLite FP16 models

Pull Request - State: closed - Opened by mariecwhite 12 months ago

#154 - Add documentation on current status

Pull Request - State: closed - Opened by mariecwhite 12 months ago

#153 - Generate IREE vs TFLite Comparison HTML

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#152 - Add TFLite benchmark workflow

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#151 - Add IREE Android benchmarks

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#150 - Add IREE benchmark workflow

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#149 - Update artifacts links

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#148 - Generate TFLite artifacts

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#147 - Add JAX Stable Diffusion Pipeline

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#146 - Add JAX ViT model

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#145 - Add Bert-Base models at various sequence lengths and data types

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#144 - Add T5-Small models that generate various output tokens

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#143 - Generate TFLite models from JAX

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#142 - Ensure artifacts are generated sequentially for HLO dumps to work

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#141 - Bump urllib3 from 1.26.17 to 1.26.18 in /devtools/db_import

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago
Labels: dependencies

#140 - Add GPT-2 JAX and TF pipeline

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#139 - Benchmark TFLite Models

Pull Request - State: open - Opened by mariecwhite about 1 year ago

#138 - Fix GGML Benchmark

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#137 - Generate TFLite files from Tensorflow models

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#136 - Bump urllib3 from 1.26.16 to 1.26.17 in /devtools/db_import

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago
Labels: dependencies

#135 - Fix cloud function deployment bug

Pull Request - State: closed - Opened by beckerhe about 1 year ago

#134 - Re-enable IREE-PJRT workloads to test accuracy

Pull Request - State: open - Opened by mariecwhite about 1 year ago

#133 - Disable comparative benchmarks

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#132 - Use iree-ir-tool from IREE release

Pull Request - State: closed - Opened by pzread about 1 year ago

#131 - Automate artifact generations

Pull Request - State: closed - Opened by pzread about 1 year ago - 1 comment

#130 - Add GPT-2 GGML x86 and Android Benchmarks

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#129 - Add GGML Benchmarks

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#128 - Run Comparative Benchmarks once a day instead of twice daily

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#127 - Add convperf

Pull Request - State: closed - Opened by mariecwhite about 1 year ago

#126 - Add mmperf

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#125 - [Tracking Bug] List of disabled workloads.

Issue - State: open - Opened by mariecwhite over 1 year ago - 1 comment

#124 - Update model artifacts

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#123 - Import TF to IREE directly instead of using iree-import-tf tool

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#120 - Upload artifacts to gcs automatically

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#119 - Retrieve output data from device

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#118 - Add NVIDIA1_3B training configuration

Pull Request - State: open - Opened by phoenix-meadowlark over 1 year ago

#117 - [XLA-HLO:GPU] Type errors on BERT_LARGE_FP16_JAX_* models

Issue - State: open - Opened by pzread over 1 year ago
Labels: bug

#116 - Reduce CPU benchmark run time

Pull Request - State: closed - Opened by pzread over 1 year ago

#115 - Keep files when torch-mlir fails to import model

Pull Request - State: closed - Opened by pzread over 1 year ago

#114 - Option to skip torch-mlir generation

Pull Request - State: closed - Opened by pzread over 1 year ago

#113 - Refactor model forward method to take parameters instead of tuple

Pull Request - State: closed - Opened by pzread over 1 year ago - 2 comments

#112 - Imcompatible version between tensorflow and iree-import-tf

Issue - State: closed - Opened by pzread over 1 year ago - 1 comment
Labels: bug

#111 - Incompatible version between JAX and transformers

Issue - State: open - Opened by pzread over 1 year ago - 1 comment
Labels: bug

#110 - Add IREE PJRT

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#109 - Refactor model interfaces to take parameters instead of tuples

Pull Request - State: closed - Opened by pzread over 1 year ago

#108 - Enable XLA:CPU Next benchmarks

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#107 - Add TF EfficientNetB7

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#106 - Add JAX GPT2LMHead

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#105 - Cpu next compiler level

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#104 - Automate artifact generation in CI

Issue - State: open - Opened by pzread over 1 year ago

#103 - Expose the filter option in `generate_model_artifacts.sh`

Pull Request - State: closed - Opened by pzread over 1 year ago

#102 - Add DB import config for comparative benchmarks

Pull Request - State: closed - Opened by beckerhe over 1 year ago - 2 comments

#101 - Spin out the import flags from PyTorch base model

Pull Request - State: closed - Opened by pzread over 1 year ago - 1 comment

#100 - Bump certifi from 2023.5.7 to 2023.7.22 in /devtools/db_import

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#99 - [Doc] Add example benchmarks for JAX and Tensorflow

Issue - State: open - Opened by pzread over 1 year ago

#97 - Add doc for onboarding new models and benchmarks

Pull Request - State: closed - Opened by pzread over 1 year ago

#96 - Add docs and example to onboard new benchmarks

Pull Request - State: closed - Opened by pzread over 1 year ago

#95 - Add JAX GPT2LMHead

Pull Request - State: closed - Opened by mariecwhite over 1 year ago

#94 - Drop preprocessed test data definitions

Pull Request - State: closed - Opened by pzread over 1 year ago

#93 - Make framework benchmarks locally runnable without downloading artifacts

Pull Request - State: closed - Opened by pzread over 1 year ago

#92 - Introduce URL of model artifacts dir

Pull Request - State: closed - Opened by pzread over 1 year ago - 1 comment

#91 - [NFC] Remove the unused ID field

Pull Request - State: closed - Opened by pzread over 1 year ago

#90 - [DNS] Test c2std601t

Pull Request - State: open - Opened by pzread over 1 year ago

#89 - Evaluate if we want to move to BuildKit for automatic Docker image handling

Issue - State: open - Opened by beckerhe over 1 year ago - 1 comment

#88 - [DNS] Test c2-standard-60 no-hyper-threading

Pull Request - State: closed - Opened by pzread over 1 year ago

#87 - [Ergonomic] Reduce name copies in model definitions

Issue - State: closed - Opened by pzread over 1 year ago - 1 comment

#85 - [Ergonomic] Simplify test data definition process

Issue - State: closed - Opened by pzread over 1 year ago