Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / neuralmagic/compressed-tensors issues and pull requests

#108 - compute zp, scale if weight exists in module

Pull Request - State: closed - Opened by horheynm 5 months ago - 1 comment

#107 - Do not mutate config by `apply_quantization_config`

Pull Request - State: closed - Opened by dbogunowicz 5 months ago

#100 - Fix Decompress kwargs

Pull Request - State: closed - Opened by Satrat 5 months ago - 1 comment

#99 - [Fix] remove `tests/quantization`

Pull Request - State: closed - Opened by dbogunowicz 5 months ago

#97 - Activation Ordering

Pull Request - State: closed - Opened by horheynm 5 months ago

#96 - zp, scale g_idx propagation

Pull Request - State: closed - Opened by horheynm 5 months ago

#95 - default W4A16 alias to use group_size=128 (#94)

Pull Request - State: closed - Opened by bfineran 5 months ago

#94 - default W4A16 alias to use group_size=128

Pull Request - State: closed - Opened by bfineran 5 months ago

#93 - update default symmetry to True on presets (#92)

Pull Request - State: closed - Opened by bfineran 5 months ago

#92 - update default symmetry to True on presets

Pull Request - State: closed - Opened by bfineran 5 months ago

#91 - [compressor] Add packed int8 support

Pull Request - State: closed - Opened by dsikka 5 months ago

#89 - Add release build workflow

Pull Request - State: closed - Opened by dhuangnm 5 months ago

#88 - Restrict NumPy Version <2.0

Pull Request - State: closed - Opened by Satrat 5 months ago

#86 - [Quant KV Cache] Implementation

Pull Request - State: closed - Opened by dbogunowicz 5 months ago - 2 comments

#85 - import is_release from version.py

Pull Request - State: closed - Opened by horheynm 5 months ago

#84 - initialize zp, scale loaded from HF quantizer, applying quant_config

Pull Request - State: closed - Opened by horheynm 5 months ago - 2 comments

#83 - bump version to 0.4.0

Pull Request - State: closed - Opened by bfineran 5 months ago

#82 - [WIP] Autogptq checkpoint conversion support

Pull Request - State: open - Opened by rahul-tuli 5 months ago - 1 comment

#81 - Fix GPTQ Aliases

Pull Request - State: closed - Opened by Satrat 6 months ago

#80 - remove pydantic version cap

Pull Request - State: closed - Opened by bfineran 6 months ago

#79 - initial fixes for compatibility with HFQuantizer

Pull Request - State: closed - Opened by bfineran 6 months ago

#78 - Fix Compression Config Constant

Pull Request - State: closed - Opened by Satrat 6 months ago

#77 - Marlin24 Compressor

Pull Request - State: closed - Opened by Satrat 6 months ago - 1 comment

#76 - Remove version restriction on transformers

Pull Request - State: closed - Opened by mgoin 6 months ago

#75 - reduce appropriate dim

Pull Request - State: closed - Opened by horheynm 6 months ago

#74 - Update time for the runner

Pull Request - State: closed - Opened by dsikka 6 months ago

#73 - Update Compression Config for HfQuantizer Compatability

Pull Request - State: closed - Opened by Satrat 6 months ago - 2 comments

#72 - Update nightly build to run at 6pm

Pull Request - State: closed - Opened by dsikka 6 months ago

#71 - Fix Python 3.8 Compatability

Pull Request - State: closed - Opened by Satrat 6 months ago

#70 - Fix incorrect loading of dtype

Pull Request - State: closed - Opened by eldarkurtic 6 months ago - 2 comments

#69 - Prevent incorrect loading of model's dtype

Pull Request - State: closed - Opened by eldarkurtic 6 months ago - 1 comment

#68 - Fixed Grouped Quantization Reload

Pull Request - State: closed - Opened by Satrat 6 months ago

#67 - Make ZP int8 instead of int64

Pull Request - State: closed - Opened by Satrat 6 months ago

#66 - Add a function to check if a string is a preset scheme

Pull Request - State: closed - Opened by rahul-tuli 6 months ago

#65 - Additional Symmetric ZP Fix

Pull Request - State: closed - Opened by Satrat 6 months ago

#64 - Fix for Symmetric Zero Point Reloading

Pull Request - State: closed - Opened by Satrat 6 months ago

#63 - Rename Packed Weights

Pull Request - State: closed - Opened by Satrat 6 months ago - 1 comment

#62 - Fp8 Quantization Support

Pull Request - State: closed - Opened by Satrat 6 months ago

#61 - [GPTQ Modifier UX] Add default scheme

Pull Request - State: closed - Opened by rahul-tuli 6 months ago

#60 - fix group size min max tracking by adding tensor ids

Pull Request - State: closed - Opened by bfineran 6 months ago

#59 - Remove Symmetric Zero Point in Compressed Outputs

Pull Request - State: closed - Opened by Satrat 6 months ago

#58 - Fixes to enable FSDP one-shot

Pull Request - State: closed - Opened by dbogunowicz 6 months ago

#57 - Fix per_token slowdown

Pull Request - State: closed - Opened by Satrat 6 months ago

#56 - [BugFix][Again] Update code to be compatible with py38

Pull Request - State: closed - Opened by dbogunowicz 6 months ago

#55 - Misc Fixes

Pull Request - State: closed - Opened by Satrat 6 months ago

#54 - Fix for auto device map quantization

Pull Request - State: closed - Opened by Satrat 6 months ago

#53 - Enable generating `compressed-tensors-nightly`

Pull Request - State: closed - Opened by dbogunowicz 7 months ago

#52 - Group and Channelwise Compression Support

Pull Request - State: closed - Opened by Satrat 7 months ago

#51 - group size speedups + fixes

Pull Request - State: closed - Opened by bfineran 7 months ago

#50 - Bump the version before the release

Pull Request - State: closed - Opened by dbogunowicz 7 months ago

#49 - [Fix] Fix the messed-up test structure

Pull Request - State: closed - Opened by dbogunowicz 7 months ago

#48 - [BugFix] Update code to be compatible with py38

Pull Request - State: closed - Opened by rahul-tuli 7 months ago

#47 - Int4 Packed Compressor

Pull Request - State: closed - Opened by Satrat 7 months ago - 1 comment

#45 - Quantization Compressor Support

Pull Request - State: closed - Opened by Satrat 7 months ago

#44 - Update target match conditions; make public

Pull Request - State: closed - Opened by dsikka 7 months ago

#43 - [Release 0.3.2] Additional patches to enable compatibility with SparseML, UX changes

Pull Request - State: closed - Opened by Satrat 7 months ago - 3 comments

#42 - [WiP] Implementation of `SparseAutoModelForCausalLM`

Pull Request - State: closed - Opened by dbogunowicz 7 months ago

#40 - Support for aliased scheme settings in quant config

Pull Request - State: closed - Opened by bfineran 7 months ago - 1 comment

#39 - Per token

Pull Request - State: closed - Opened by horheynm 7 months ago

#38 - [Lifecycle][Tests] Feature Branch

Pull Request - State: closed - Opened by horheynm 7 months ago

#37 - bump version to 0.3.1 license an packaging updates

Pull Request - State: closed - Opened by bfineran 7 months ago

#36 - Final details for package

Pull Request - State: closed - Opened by mgoin 7 months ago - 1 comment

#35 - Quantization Fixes

Pull Request - State: closed - Opened by Satrat 7 months ago

#34 - [UX] Adding examples in jupyter notebook for quantization and bitmask application

Pull Request - State: closed - Opened by dbogunowicz 7 months ago - 2 comments

#33 - Compressed lifecycle implementation (INT8 only)

Pull Request - State: closed - Opened by bfineran 7 months ago

#32 - [Observers] group size + channel wise + per token

Pull Request - State: closed - Opened by horheynm 7 months ago

#31 - Pretrained Model Reload + SparseGPT Support

Pull Request - State: closed - Opened by Satrat 7 months ago

#30 - [Release 0.3.0] Basic Readme and user-facing pathways

Pull Request - State: closed - Opened by dbogunowicz 7 months ago - 1 comment

#29 - Fix failing GHA

Pull Request - State: closed - Opened by dbogunowicz 7 months ago

#28 - [Quant] ability to skip certain layer types on apply

Pull Request - State: closed - Opened by bfineran 7 months ago

#27 - Channel-wise Quantization

Pull Request - State: closed - Opened by bfineran 7 months ago

#26 - Quantization Examples and Correctness Fixes

Pull Request - State: closed - Opened by Satrat 7 months ago

#25 - fix style post rename PR

Pull Request - State: closed - Opened by bfineran 7 months ago

#24 - [DO NOT MERGE] per-token dynamic observer

Pull Request - State: closed - Opened by bfineran 7 months ago - 1 comment

#23 - Lifecycle/min max obs

Pull Request - State: closed - Opened by horheynm 7 months ago - 1 comment

#22 - signed quantized

Pull Request - State: closed - Opened by horheynm 7 months ago - 1 comment

#21 - lifecycle conftest

Pull Request - State: closed - Opened by horheynm 7 months ago

#20 - Lifecycle/min max obs

Pull Request - State: closed - Opened by horheynm 7 months ago

#19 - test lifecycle

Pull Request - State: closed - Opened by horheynm 7 months ago

#18 - test initalize

Pull Request - State: closed - Opened by horheynm 7 months ago

#17 - test frozen

Pull Request - State: closed - Opened by horheynm 7 months ago

#16 - test forward

Pull Request - State: closed - Opened by horheynm 7 months ago

#15 - Dyanmic Quantization

Pull Request - State: closed - Opened by bfineran 7 months ago - 1 comment

#14 - Rename the repo to `compressed-tensors`

Pull Request - State: closed - Opened by dbogunowicz 7 months ago - 1 comment

#13 - [Observers] pull shared logic into a helper function

Pull Request - State: closed - Opened by bfineran 7 months ago

#12 - Fix Device Mismatch

Pull Request - State: closed - Opened by Satrat 7 months ago

#11 - [lifecycle] docstrings + ux update to work with torch.apply

Pull Request - State: closed - Opened by bfineran 7 months ago

#10 - [WIP] Example PTQ flow with quant lifecycle

Pull Request - State: closed - Opened by bfineran 7 months ago - 1 comment

#9 - fix observer bugs

Pull Request - State: closed - Opened by bfineran 7 months ago

#8 - decorate fake quant with torch.no_grad

Pull Request - State: closed - Opened by bfineran 7 months ago

#7 - Serialize Config from Model

Pull Request - State: closed - Opened by Satrat 8 months ago

#6 - Lifecyle tests

Pull Request - State: closed - Opened by horheynm 8 months ago

#5 - Quantization refactor

Pull Request - State: closed - Opened by horheynm 8 months ago

#4 - Apply quantization config implementation

Pull Request - State: closed - Opened by bfineran 8 months ago

#3 - Define BaseModels for Quantization

Pull Request - State: closed - Opened by Satrat 8 months ago