Data

Tools

Indexes

Applications

Experiments

Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / neuralmagic/compressed-tensors issues and pull requests

#396 - [Transform] Fix config serialization

Pull Request - State: closed - Opened by kylesayrs 18 days ago

#371 - Fix nightly issues with python 3.11

Pull Request - State: open - Opened by dhuangnm about 1 month ago

#370 - [Transform] Saving with tied weights

Pull Request - State: open - Opened by kylesayrs about 1 month ago

#369 - FSDP + QLoRA use case

Issue - State: closed - Opened by kmehant about 1 month ago - 2 comments

#368 - [WIP] Initialize qparams with valid values

Pull Request - State: open - Opened by kylesayrs about 1 month ago

#367 - [Transform] Update tests to use conftest file

Pull Request - State: open - Opened by kylesayrs about 1 month ago

#366 - [Accelerate] Remove `is_module_offloaded` and `update_prefix_dict`

Pull Request - State: open - Opened by kylesayrs about 1 month ago

#365 - [Accelerate] Fix typos in `get_execution_device`

Pull Request - State: closed - Opened by kylesayrs about 1 month ago

#364 - [Accelerate] Support `get_offloaded_device` for models

Pull Request - State: open - Opened by kylesayrs about 1 month ago

#363 - [Accelerate] Expand `get_execution_device` to support models

Pull Request - State: closed - Opened by kylesayrs about 1 month ago

#362 - reference updated reportportal_submit_execution_results action

Pull Request - State: closed - Opened by derekk-nm about 1 month ago - 1 comment

#361 - [Bugfix] Fix updating parameters under `align_modules`

Pull Request - State: open - Opened by kylesayrs about 1 month ago

#360 - [Bugfix] Only update direct params in `disable_offloading`

Pull Request - State: closed - Opened by kylesayrs about 1 month ago

#359 - [Accelerate] Remove `align_modules`

Pull Request - State: closed - Opened by kylesayrs about 2 months ago - 1 comment

#358 - Optimize sparse 2:4 compression performance

Pull Request - State: open - Opened by rahul-tuli about 2 months ago

#357 - [Bugfix] Fix saving of models dispatched by `offloaded_dispatch`

Pull Request - State: closed - Opened by kylesayrs about 2 months ago - 1 comment

#356 - [Accelerate] Extend functionality of `register_offload_parameter`

Pull Request - State: closed - Opened by kylesayrs about 2 months ago - 3 comments

#355 - [Accelerate] Fix `offloaded_dispatch`, implement `disable_offloading`

Pull Request - State: closed - Opened by kylesayrs about 2 months ago - 1 comment

#354 - [Accelerate] Rename and simplify `force_cpu_offload`

Pull Request - State: closed - Opened by kylesayrs about 2 months ago

#352 - [Transform] Construct on GPU, cache on CPU

Pull Request - State: open - Opened by kylesayrs about 2 months ago

#351 - [Transform] Extend set of known Hadamard matrices

Pull Request - State: closed - Opened by kylesayrs about 2 months ago - 5 comments

#350 - [Transform] [Bugfix] Fix enum value serialization in python>=3.11

Pull Request - State: closed - Opened by kylesayrs about 2 months ago

#349 - Remove redundant call

Pull Request - State: closed - Opened by eldarkurtic about 2 months ago - 1 comment

#348 - [Transform] `apply_transform_config`

Pull Request - State: open - Opened by kylesayrs about 2 months ago

#346 - [Bugfix] Fix `find_name_or_class_matches` return type

Pull Request - State: open - Opened by kylesayrs about 2 months ago

#345 - [Hotfix] Implement method on dense compressor

Pull Request - State: closed - Opened by kylesayrs about 2 months ago

#344 - [Hotfix] Implement quantization compressor methods on dense compressor

Pull Request - State: closed - Opened by kylesayrs about 2 months ago - 2 comments

#343 - relax setuptools_scm version requirement

Pull Request - State: open - Opened by envolution about 2 months ago

#342 - Fix error on import whenever accelerate is absent

Pull Request - State: closed - Opened by maresb about 2 months ago - 1 comment

#341 - [NVFP4] Small Nits

Pull Request - State: closed - Opened by dsikka about 2 months ago

#340 - [Decompression] Keep unused parameters when decompressing from memory

Pull Request - State: closed - Opened by kylesayrs about 2 months ago

#339 - [NVFP4] update global scale generation

Pull Request - State: closed - Opened by dsikka about 2 months ago

#338 - [Tests] Fix test scale init for group quant

Pull Request - State: closed - Opened by dsikka about 2 months ago

#337 - [Tests] Update test_fp8_quant.py

Pull Request - State: closed - Opened by dsikka about 2 months ago

#336 - [Quantization] Update group quantization

Pull Request - State: closed - Opened by dsikka 2 months ago

#335 - [NVFP4][Quantization] Speed up group quant/dequant

Pull Request - State: closed - Opened by dsikka 2 months ago - 1 comment

#334 - [WIP] [Transform] q_attn and k_cache locations

Pull Request - State: open - Opened by kylesayrs 2 months ago

#333 - [WIP] [Transform] Compress, decompress

Pull Request - State: open - Opened by kylesayrs 2 months ago

#332 - [Misc] Remove unused config name definitions

Pull Request - State: open - Opened by kylesayrs 2 months ago

#331 - [NVFP4] Use torch.compile when rounding to NVFP4

Pull Request - State: closed - Opened by dsikka 2 months ago

#330 - [Transform] Hadamard and Matrix Transform Utils

Pull Request - State: closed - Opened by kylesayrs 2 months ago

#329 - [Transform] Hadamard Permutations

Pull Request - State: open - Opened by kylesayrs 2 months ago

#328 - [Transform] Accelerate Utilities

Pull Request - State: closed - Opened by kylesayrs 2 months ago - 1 comment

#327 - Use different runner for UPLOAD job

Pull Request - State: closed - Opened by dbarbuzzi 2 months ago

#325 - [NVFP4] Expand dynamic types, clean-up conditions

Pull Request - State: closed - Opened by dsikka 2 months ago - 1 comment

#324 - Make MSE the default

Pull Request - State: open - Opened by dsikka 2 months ago - 2 comments

#323 - Revert "Update default observer to be `MSE` (#300)"

Pull Request - State: closed - Opened by dsikka 2 months ago

#322 - [NVFP4] Skip fused global scale calculation if already fused

Pull Request - State: closed - Opened by dsikka 2 months ago

#321 - [Transforms] Transform Args, Scheme, and Config

Pull Request - State: closed - Opened by kylesayrs 2 months ago - 1 comment

#320 - [Misc] Generics typehinting for `RegistryMixin`

Pull Request - State: closed - Opened by kylesayrs 2 months ago - 4 comments

#319 - Model Compression: Delete offload

Pull Request - State: closed - Opened by kylesayrs 2 months ago

#318 - Model Compression: Set compression status

Pull Request - State: closed - Opened by kylesayrs 2 months ago

#317 - [NVFP4] Add `tensor_group` strategy; enable NVFP4 Activations

Pull Request - State: closed - Opened by dsikka 3 months ago

#316 - [Transform] Factory classes with shared memory and offloading

Pull Request - State: closed - Opened by kylesayrs 3 months ago

#315 - [NVFP4] Enable Fp4 Quantization; introduce / apply global_scales

Pull Request - State: closed - Opened by dsikka 3 months ago

#314 - fix signatures on model_validator functions

Pull Request - State: closed - Opened by brian-dellabetta 3 months ago - 1 comment

#313 - [NVFP4] Update FloatArgs and NVFP4

Pull Request - State: closed - Opened by dsikka 3 months ago - 1 comment

#312 - Clarify `match_param_name` return type

Pull Request - State: closed - Opened by kylesayrs 3 months ago

#311 - [Compressor][NVFP4] Support FP4 Compression

Pull Request - State: closed - Opened by dsikka 3 months ago

#310 - Clarify decompression return type

Pull Request - State: closed - Opened by kylesayrs 3 months ago

#309 - Optimize pack_fp4_to_uint8 for fp4

Pull Request - State: closed - Opened by mgoin 3 months ago

#308 - [Bugfix] Fix shape calculation for group quantization

Pull Request - State: closed - Opened by kylesayrs 3 months ago - 2 comments

#307 - Enable module state_dict compression, simplify compression logic

Pull Request - State: closed - Opened by kylesayrs 3 months ago

#305 - Why here no W8-only provided in scheme?

Issue - State: closed - Opened by shuxiaobo 3 months ago - 4 comments

#304 - Updates to build system

Pull Request - State: closed - Opened by dbarbuzzi 3 months ago

#302 - Enable module state_dict compression, simplify compression logic

Pull Request - State: closed - Opened by kylesayrs 3 months ago - 1 comment

#301 - [Performance] Add memory compression and decompression pathways

Pull Request - State: closed - Opened by kylesayrs 4 months ago - 3 comments

#300 - Update default observer to be `MSE`

Pull Request - State: closed - Opened by shanjiaz 4 months ago - 4 comments

#299 - Pick up fix from nm-actions

Pull Request - State: closed - Opened by dhuangnm 4 months ago

#298 - Update action tags

Pull Request - State: closed - Opened by dhuangnm 4 months ago

#297 - Fix upload issue when package already existed on PyPI

Pull Request - State: closed - Opened by dhuangnm 4 months ago

#296 - [Compressor] Update packed compressor to support zp packing

Pull Request - State: closed - Opened by dsikka 4 months ago

#295 - Fix `_initialize_scale_zero_point` initializing on the wrong device

Pull Request - State: closed - Opened by mgoin 4 months ago - 1 comment

#294 - fix a few minor issues

Pull Request - State: closed - Opened by dhuangnm 4 months ago

#293 - Remove compression_ratio calculation

Pull Request - State: closed - Opened by dsikka 4 months ago

#292 - Build with setuptools scm

Pull Request - State: closed - Opened by dhuangnm 4 months ago

#291 - [WIP][NVFP4] Add compression/decompression code

Pull Request - State: closed - Opened by dsikka 4 months ago

#290 - Reduce memory requirements of sparsified compression

Pull Request - State: closed - Opened by kylesayrs 4 months ago

#289 - Reduce memory requirements of quantized compression

Pull Request - State: closed - Opened by kylesayrs 4 months ago

#288 - Bump CT Version

Pull Request - State: closed - Opened by dsikka 4 months ago

#287 - [NVFP4][WIP] Add NVFp4 Support

Pull Request - State: closed - Opened by dsikka 4 months ago

#285 - [Decompression] Update Decompression Lifecycle

Pull Request - State: closed - Opened by dsikka 4 months ago

#284 - [Transforms] Enable shared memory and introduce permutations

Pull Request - State: open - Opened by dsikka 4 months ago

#283 - use fine-grained token for workflow

Pull Request - State: closed - Opened by dhuangnm 4 months ago

#282 - [Utils] add align_modules

Pull Request - State: closed - Opened by kylesayrs 5 months ago

#281 - Cannot allocate memory

Issue - State: closed - Opened by QingshuiL 5 months ago - 3 comments

#280 - Would consider support candle for efficient inference?

Issue - State: closed - Opened by lucasjinreal 5 months ago - 1 comment

#279 - bug: minimal python version should be 3.10

Issue - State: closed - Opened by jmkuebler 5 months ago - 2 comments

#278 - Fix case when using weight_packed, not weight

Pull Request - State: closed - Opened by dsikka 5 months ago

#277 - [Transforms] Initial Implementation

Pull Request - State: open - Opened by dsikka 5 months ago

#276 - [Transforms] Apply, serialize, deserialize

Pull Request - State: open - Opened by dsikka 5 months ago

#275 - [Transforms] Transform Arg, Scheme, and Data support

Pull Request - State: closed - Opened by dsikka 5 months ago - 2 comments

#274 - [Transforms] Transform Registry Support

Pull Request - State: closed - Opened by dsikka 5 months ago - 2 comments

#273 - [BugFix]: `AttributeError` in `CompressedLinear`

Pull Request - State: closed - Opened by rahul-tuli 5 months ago - 1 comment