nod-ai/shark-testsuite issues and pull requests

#100 - Gemm support with and without bias

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#100 - Gemm support with and without bias

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#99 - add cleanup + uploading features

Pull Request - State: closed - Opened by saienduri 11 months ago

#99 - add cleanup + uploading features

Pull Request - State: closed - Opened by saienduri 11 months ago

#98 - layernorm e2e testcase

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#98 - layernorm e2e testcase

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#97 - [onnx] Gelu e2e testcase

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#97 - [onnx] Gelu e2e testcase

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#96 - Adding MatMul, elementwise Mul and Softmax

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#96 - Adding MatMul, elementwise Mul and Softmax

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#95 - Add onnx equal op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#95 - Add onnx equal op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#94 - Add onnx concat op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#94 - Add onnx concat op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#93 - Add onnx neg op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#93 - Add onnx neg op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#92 - Add onnx flatten op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#92 - Add onnx flatten op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#91 - Add onnx maxpool op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#91 - Add onnx maxpool op test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#90 - Convert ONNX models during import and run import in parallel.

Pull Request - State: closed - Opened by ScottTodd 11 months ago

#90 - Convert ONNX models during import and run import in parallel.

Pull Request - State: closed - Opened by ScottTodd 11 months ago

#89 - added gridsampler test case

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#89 - added gridsampler test case

Pull Request - State: closed - Opened by afalkenberg1 11 months ago

#88 - Fix XFAIL behavior in conftest.py.

Pull Request - State: closed - Opened by ScottTodd 11 months ago

#88 - Fix XFAIL behavior in conftest.py.

Pull Request - State: closed - Opened by ScottTodd 11 months ago

#87 - Add Space Efficient Testing with Cleanup Option

Pull Request - State: closed - Opened by saienduri 11 months ago

#87 - Add Space Efficient Testing with Cleanup Option

Pull Request - State: closed - Opened by saienduri 11 months ago

#86 - pytest xfail logic in iree_tests is buggy

Issue - State: closed - Opened by ScottTodd 11 months ago - 1 comment

#86 - pytest xfail logic in iree_tests is buggy

Issue - State: closed - Opened by ScottTodd 11 months ago - 1 comment

#85 - Consider standardizing ONNX versions for generated test cases

Issue - State: closed - Opened by ScottTodd 11 months ago - 2 comments

#85 - Consider standardizing ONNX versions for generated test cases

Issue - State: closed - Opened by ScottTodd 11 months ago - 2 comments

#84 - Regenerate ONNX tests using newer torch-mlir.

Pull Request - State: closed - Opened by ScottTodd 11 months ago - 2 comments

#84 - Regenerate ONNX tests using newer torch-mlir.

Pull Request - State: closed - Opened by ScottTodd 11 months ago - 2 comments

#83 - Add onnx Expand test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#83 - Add onnx Expand test

Pull Request - State: closed - Opened by jinchen62 11 months ago

#82 - Add directory + space checks for cache

Pull Request - State: closed - Opened by saienduri 11 months ago

#82 - Add directory + space checks for cache

Pull Request - State: closed - Opened by saienduri 11 months ago

#81 - IREE build is made optional, fix models to allow onnx export, handle multiple input onnx export

Pull Request - State: closed - Opened by kumardeepakamd 11 months ago

#81 - IREE build is made optional, fix models to allow onnx export, handle multiple input onnx export

Pull Request - State: closed - Opened by kumardeepakamd 11 months ago

#80 - Handling of Environment Variables

Pull Request - State: closed - Opened by saienduri 11 months ago

#80 - Handling of Environment Variables

Pull Request - State: closed - Opened by saienduri 11 months ago

#79 - Change --hfhome to be --cachedir and keep it as required argument and set all TORCH_HOME, HF_HOME etc. to be in the cache

Issue - State: closed - Opened by kumardeepakamd 11 months ago - 1 comment

#79 - Change --hfhome to be --cachedir and keep it as required argument and set all TORCH_HOME, HF_HOME etc. to be in the cache

Issue - State: closed - Opened by kumardeepakamd 11 months ago - 1 comment

#78 - Move Turbine Tank To Test Suite

Pull Request - State: closed - Opened by saienduri 11 months ago

#78 - Move Turbine Tank To Test Suite

Pull Request - State: closed - Opened by saienduri 11 months ago

#77 - update variable name

Pull Request - State: closed - Opened by saienduri 11 months ago

#77 - update variable name

Pull Request - State: closed - Opened by saienduri 11 months ago

#76 - add turbine mode + configurations and support for all models (image classification, t5 seq2seq, language)

Pull Request - State: closed - Opened by saienduri 12 months ago

#76 - add turbine mode + configurations and support for all models (image classification, t5 seq2seq, language)

Pull Request - State: closed - Opened by saienduri 12 months ago

#75 - Setup pytest and GHA workflow for IREE test suite.

Pull Request - State: closed - Opened by ScottTodd 12 months ago

#75 - Setup pytest and GHA workflow for IREE test suite.

Pull Request - State: closed - Opened by ScottTodd 12 months ago

#74 - Add ReduceProd test

Pull Request - State: closed - Opened by AmosLewis 12 months ago

#74 - Add ReduceProd test

Pull Request - State: closed - Opened by AmosLewis 12 months ago

#73 - Fix issue #46 and make post process pipeline use common code

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago - 2 comments

#72 - Fix float format to 3 digits and some cosmetic changes

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#71 - Fix typos in names

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#71 - Fix typos in names

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#70 - remove a debug print message

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#70 - remove a debug print message

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#69 - Complete the feature to compare and merge run reports

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago - 2 comments

#69 - Complete the feature to compare and merge run reports

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago - 2 comments

#68 - Add initial ONNX test suite with import, compile, run scripts.

Pull Request - State: closed - Opened by ScottTodd 12 months ago - 6 comments

#68 - Add initial ONNX test suite with import, compile, run scripts.

Pull Request - State: closed - Opened by ScottTodd 12 months ago - 6 comments

#67 - add ability to skip a list of tests or only include a given list of tests

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#67 - add ability to skip a list of tests or only include a given list of tests

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#66 - compare top 2 classification for int8 resnet50, fix post processing issues

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#66 - compare top 2 classification for int8 resnet50, fix post processing issues

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#65 - Allow selecting specific columns in report while merging or diffing

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#65 - Allow selecting specific columns in report while merging or diffing

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#64 - Add E2E test for Relu, Reshape, and Identity op

Pull Request - State: closed - Opened by vivekkhandelwal1 12 months ago - 3 comments

#64 - Add E2E test for Relu, Reshape, and Identity op

Pull Request - State: closed - Opened by vivekkhandelwal1 12 months ago - 3 comments

#63 - added ability to diff runs. enable passing args for post processing

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#62 - Create merged report of two different runs

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#61 - Create a seperate copy of E2ESHARK_CHECK dict. Enable post processing…

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#61 - Create a seperate copy of E2ESHARK_CHECK dict. Enable post processing…

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#60 - Use commonutils.py to share and apply post processing

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#60 - Use commonutils.py to share and apply post processing

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#59 - Organize test controlling vars in a dictionary

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#59 - Organize test controlling vars in a dictionary

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#58 - Plumbed option for running turbine flow. Updated gold passed.txt

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#58 - Plumbed option for running turbine flow. Updated gold passed.txt

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#57 - for pytorch direct mode, the input to iree is always torch MLIR

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#57 - for pytorch direct mode, the input to iree is always torch MLIR

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#56 - add test cases for pow, shape, and sigmoid

Pull Request - State: closed - Opened by renxida 12 months ago - 1 comment

#56 - add test cases for pow, shape, and sigmoid

Pull Request - State: closed - Opened by renxida 12 months ago - 1 comment

#55 - Update pytorchmodel.py

Pull Request - State: closed - Opened by PhaneeshB 12 months ago

#55 - Update pytorchmodel.py

Pull Request - State: closed - Opened by PhaneeshB 12 months ago

#54 - Do not cast input type to bfloat16 for llama2

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#54 - Do not cast input type to bfloat16 for llama2

Pull Request - State: closed - Opened by kumardeepakamd 12 months ago

#53 - onnx/operators comparisons fail

Issue - State: open - Opened by renxida 12 months ago - 1 comment

#53 - onnx/operators comparisons fail

Issue - State: open - Opened by renxida 12 months ago - 1 comment

#52 - add Unsqueeze onnx operator test

Pull Request - State: closed - Opened by renxida 12 months ago - 1 comment

#52 - add Unsqueeze onnx operator test

Pull Request - State: closed - Opened by renxida 12 months ago - 1 comment

#51 - Opt bf16 debug

Pull Request - State: closed - Opened by PhaneeshB 12 months ago

#51 - Opt bf16 debug

Pull Request - State: closed - Opened by PhaneeshB 12 months ago

#50 - Add a .gitignore with some common exclusions.

Pull Request - State: closed - Opened by ScottTodd 12 months ago

#50 - Add a .gitignore with some common exclusions.

Pull Request - State: closed - Opened by ScottTodd 12 months ago

#49 - Scripts should support installed packages, not just build directories

Issue - State: closed - Opened by ScottTodd 12 months ago - 11 comments

#49 - Scripts should support installed packages, not just build directories

Issue - State: closed - Opened by ScottTodd 12 months ago - 11 comments

GitHub / nod-ai/shark-testsuite issues and pull requests