feifeibear/colobloom issues and pull requests

#36 - Add FP16-TP support & polish

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#36 - Add FP16-TP support & polish

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#35 - shard_leaf_modules

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#35 - shard_leaf_modules

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#34 - use AutoModelForCausalLM

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#34 - use AutoModelForCausalLM

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#33 - add class ModelScatter

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#33 - add class ModelScatter

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#32 - polish code

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#32 - polish code

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#31 - use a common scatter_model

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#31 - use a common scatter_model

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#30 - add some comments

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#30 - add some comments

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#29 - polish init context

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#29 - polish init context

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#28 - polish test.py & utils.py

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#28 - polish test.py & utils.py

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#27 - [NFC] polish format

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#27 - [NFC] polish format

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#26 - polish test.py

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#26 - polish test.py

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#25 - Optimize time cost & some context

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#25 - Optimize time cost & some context

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#24 - Fix LinearTP to solve memory usage exception

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#24 - Fix LinearTP to solve memory usage exception

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#23 - Rebuild get_8bit_tp_model_list()

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#23 - Rebuild get_8bit_tp_model_list()

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#22 - CPU mem reducing with cpu communication and meta_init

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#22 - CPU mem reducing with cpu communication and meta_init

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#21 - monitor bloom_int8_tp

Pull Request - State: closed - Opened by CsRic about 2 years ago

#21 - monitor bloom_int8_tp

Pull Request - State: closed - Opened by CsRic about 2 years ago

#20 - monitor bloom_int8_tp memory

Pull Request - State: closed - Opened by CsRic about 2 years ago

#20 - monitor bloom_int8_tp memory

Pull Request - State: closed - Opened by CsRic about 2 years ago

#19 - reduce cai int8 peak memory

Pull Request - State: closed - Opened by CsRic about 2 years ago

#19 - reduce cai int8 peak memory

Pull Request - State: closed - Opened by CsRic about 2 years ago

#18 - polish acc int8 inference model loading

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#18 - polish acc int8 inference model loading

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#17 - CAI-Accelerate Benchmark

Pull Request - State: closed - Opened by CsRic about 2 years ago

#17 - CAI-Accelerate Benchmark

Pull Request - State: closed - Opened by CsRic about 2 years ago

#16 - Polish bloom_cai.py and readme

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#16 - Polish bloom_cai.py and readme

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#15 - [int8] Memory Optimization

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#15 - [int8] Memory Optimization

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#14 - [dev] add shard init for fp32 TP

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#13 - New Context TP

Pull Request - State: closed - Opened by CsRic about 2 years ago

#13 - New Context TP

Pull Request - State: closed - Opened by CsRic about 2 years ago

#12 - Add TP-support for embedding and lm_head

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#11 - our int8 implement using dist context from colossali

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#10 - [polish]bloom_int8_tp.py complete_compare

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#9 - Update bloom_int8_tp.py

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#8 - [hotfix] real TP

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#7 - Linear-int8+TP

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#6 - test_tp

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#5 - change colossalai/tensor/colo_parameter ; change basic to colo_init after quantize

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#4 - energonai wrapped bloom-accelerate-inference

Pull Request - State: closed - Opened by CsRic about 2 years ago

#3 - add CAI to accelerate inference

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#2 - Add int8 support

Pull Request - State: closed - Opened by ht-zhou about 2 years ago

#1 - add pytorch version as reference

Pull Request - State: closed - Opened by feifeibear about 2 years ago

GitHub / feifeibear/colobloom issues and pull requests