Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / linkedin/Liger-Kernel issues and pull requests
#251 - [Easy] Cast program_id to int64 in SwiGLU/GeGLU kernels
Pull Request -
State: closed - Opened by hansonw 2 days ago
#250 - AutoLigerKernelForCausalLM.from_pretrained discards hub_kwargs_names
Issue -
State: open - Opened by uris-opti 3 days ago
- 3 comments
#249 - ValueError when Loading Qwen2-VL Model with Liger Kernel
Issue -
State: open - Opened by rahatarinasir 4 days ago
- 1 comment
#248 - Support for Cohere models
Issue -
State: open - Opened by nyxkrage 5 days ago
- 1 comment
#247 - Remove debug print statement
Pull Request -
State: closed - Opened by EdoardoLuciani 5 days ago
- 1 comment
#246 - Release Liger-Kernel version 0.3.0
Pull Request -
State: closed - Opened by qingquansong 6 days ago
#245 - Is not compatible with DoRA?
Issue -
State: open - Opened by gotzmann 8 days ago
- 1 comment
Labels: bug
#244 - Add label smoothing to FLCE and unit tests
Pull Request -
State: closed - Opened by Tcc0403 8 days ago
- 1 comment
#243 - Lable smoothing is not applied and tested in flce
Issue -
State: closed - Opened by Tcc0403 8 days ago
#242 - Patch Application Relies on Global State and `AutoLigerKernelForCausalLM.from_config` doesn't work properly
Issue -
State: closed - Opened by lapp0 9 days ago
- 7 comments
#241 - Reasons for upcasting the logits dtype outside the kernel
Issue -
State: open - Opened by yzhangcs 9 days ago
- 7 comments
#240 - SWIFT Trainer Integration
Pull Request -
State: closed - Opened by tastelikefeet 10 days ago
#239 - Support Z Loss in CE
Pull Request -
State: open - Opened by Tcc0403 10 days ago
- 3 comments
Labels: reviewing
#238 - fused_linear_cross_entropy: Move float32 cast into kernel
Pull Request -
State: open - Opened by hansonw 10 days ago
- 3 comments
#237 - Optimize fused_linear_cross_entropy when weight does not require grads
Pull Request -
State: closed - Opened by hansonw 10 days ago
#236 - Benchmarking phi3 on single A100 40gb GPU: unable to reproduce benchmark results
Issue -
State: open - Opened by cosmicBboy 10 days ago
- 3 comments
#235 - Compatibility Issue: PEFT and BitsAndBytesConfig with Liger Kernel. Seeking Alternatives for Quantization and LoRA Fine-Tuning.
Issue -
State: closed - Opened by GianottiGustavo 10 days ago
- 12 comments
#234 - Support Z Loss in CE
Pull Request -
State: closed - Opened by Tcc0403 11 days ago
- 1 comment
#232 - Restore monkey patched modules
Pull Request -
State: closed - Opened by austin362667 12 days ago
- 4 comments
#231 - Triton error on AMD GPUs
Issue -
State: open - Opened by eminorhan 12 days ago
- 8 comments
#230 - added `reduction` argument in Cross Entropy Kernel
Pull Request -
State: closed - Opened by Ankur-singh 12 days ago
- 6 comments
#229 - Feat: add kl div to readme
Pull Request -
State: closed - Opened by S1ro1 12 days ago
#228 - [Operator] conv2d
Pull Request -
State: open - Opened by AndreSlavescu 12 days ago
- 1 comment
#227 - Torch compiled FLCE is 2x faster than the current FLCE
Issue -
State: open - Opened by ByronHsu 13 days ago
- 12 comments
#226 - (fix) fix pyproject.toml
Pull Request -
State: closed - Opened by wizyoung 13 days ago
- 11 comments
#225 - added group norm
Pull Request -
State: open - Opened by denti 13 days ago
Labels: reviewing
#224 - Add license in ack section
Pull Request -
State: closed - Opened by ByronHsu 13 days ago
#223 - Added HF use-case benchmark script
Pull Request -
State: closed - Opened by shimizust 13 days ago
#222 - Elaborate ack section
Pull Request -
State: closed - Opened by ByronHsu 13 days ago
#221 - Elaborate ack section
Pull Request -
State: closed - Opened by ByronHsu 13 days ago
#220 - add repr infomation for layer_norm and rms_norm
Pull Request -
State: closed - Opened by wizyoung 13 days ago
- 2 comments
#219 - Fix compatibility issue on triton=2.3.1
Pull Request -
State: closed - Opened by Tcc0403 13 days ago
#218 - (fix) fix pyproject.toml
Pull Request -
State: closed - Opened by wizyoung 14 days ago
- 1 comment
#217 - Update swiglu and geglu forward: zeros_like -> empty_like
Pull Request -
State: closed - Opened by IvanYashchuk 14 days ago
- 9 comments
#216 - Reference Unsloth in header
Pull Request -
State: closed - Opened by momochen 14 days ago
- 4 comments
#215 - LayerNorm error: TypeError: missing a required argument: 'num_warps'
Issue -
State: closed - Opened by wizyoung 14 days ago
- 6 comments
Labels: bug, triton
#214 - Add support for jamba model with Liger Kernel
Pull Request -
State: open - Opened by yubofredwang 15 days ago
- 2 comments
#213 - minor refactor of rms and layernorm
Pull Request -
State: closed - Opened by lancerts 15 days ago
#212 - Refactor/benchmarking visualizer
Pull Request -
State: closed - Opened by S1ro1 15 days ago
- 4 comments
#211 - Refactor: Benchmark visualizer
Issue -
State: closed - Opened by S1ro1 15 days ago
#210 - Uplift kernel APIs to top level
Pull Request -
State: closed - Opened by austin362667 15 days ago
#209 - Add `--decimal` flag to benchmarking
Pull Request -
State: closed - Opened by austin362667 15 days ago
- 2 comments
#208 - Support Yi-Coder
Issue -
State: open - Opened by ryankert01 15 days ago
- 6 comments
Labels: feature
#207 - Update layer_norm.py
Pull Request -
State: closed - Opened by lancerts 15 days ago
#206 - MoE kernel
Issue -
State: open - Opened by ByronHsu 16 days ago
- 4 comments
Labels: feature
#205 - Uplift kernel api to top level
Issue -
State: closed - Opened by ByronHsu 16 days ago
- 1 comment
#204 - Documentation improvement
Issue -
State: closed - Opened by merryHunter 16 days ago
- 4 comments
#203 - Update test_rms_norm.py
Pull Request -
State: closed - Opened by lancerts 16 days ago
#202 - ci fix
Pull Request -
State: closed - Opened by AndreSlavescu 16 days ago
#201 - Update the casting logic of RMSNorm
Pull Request -
State: closed - Opened by lancerts 16 days ago
- 2 comments
#200 - Ci
Pull Request -
State: closed - Opened by AndreSlavescu 16 days ago
#199 - Support for patching post-model initialization
Pull Request -
State: closed - Opened by shimizust 16 days ago
- 1 comment
#198 - Add label smoothing for cross entropy
Pull Request -
State: closed - Opened by Tcc0403 16 days ago
- 9 comments
#197 - Z Loss in CE
Issue -
State: open - Opened by Fr0do 16 days ago
- 2 comments
Labels: feature
#196 - Refactored benchmark tests
Pull Request -
State: closed - Opened by shimizust 16 days ago
- 3 comments
#195 - FEAT Adding experimental feature : Triton mm int8xint2
Pull Request -
State: open - Opened by MekkCyber 17 days ago
- 6 comments
#194 - Feat: Kl Divergence kernel
Pull Request -
State: closed - Opened by S1ro1 17 days ago
- 7 comments
#193 - Switch Lightning 1 GPU example to Qwen2 0.5B instruct model with 1024 max seq length
Pull Request -
State: closed - Opened by qingquansong 17 days ago
#192 - Lenient Test
Issue -
State: open - Opened by jon-chuang 17 days ago
- 1 comment
#191 - TypoFixed repo_foward -> rope_forward
Pull Request -
State: closed - Opened by LucioPalmucci 17 days ago
#190 - Typo fixed: rope_forward
Pull Request -
State: closed - Opened by LucioPalmucci 17 days ago
#189 - Fix typo: repo_foward
Issue -
State: closed - Opened by ByronHsu 17 days ago
- 1 comment
Labels: good first issue
#188 - Support KL divergence kernel
Issue -
State: closed - Opened by ByronHsu 18 days ago
#187 - compute quantiles for memory usage
Pull Request -
State: closed - Opened by kvignesh1420 18 days ago
#186 - [Docs] Update README to include LigerEmbedding
Pull Request -
State: closed - Opened by AndreSlavescu 19 days ago
#185 - gemm fp8 e4m3
Pull Request -
State: open - Opened by AndreSlavescu 20 days ago
- 3 comments
#184 - [SFTTrainer] Add doc in huggingface sfttrainer website
Issue -
State: closed - Opened by ByronHsu 20 days ago
- 4 comments
Labels: documentation, p0
#183 - Remove torch compile from benchmark scripts
Pull Request -
State: closed - Opened by shimizust 20 days ago
#182 - Feat/faster rms norm
Pull Request -
State: open - Opened by S1ro1 20 days ago
- 3 comments
#181 - Updated wave snippet to use AutoLigerKernelForCausalLM
Pull Request -
State: closed - Opened by shimizust 20 days ago
#180 - [Documentation] LayerNorm added to README
Pull Request -
State: closed - Opened by AndreSlavescu 20 days ago
#179 - Improve the efficiency of the RMSNorm aggregation
Issue -
State: open - Opened by lancerts 20 days ago
- 5 comments
#178 - Extract forward/backward core computation bits outside of torch autograd context for easy reuse
Pull Request -
State: closed - Opened by qingquansong 21 days ago
- 1 comment
#177 - Division by zero when total_n_ignore = 0
Issue -
State: open - Opened by 44670 21 days ago
- 1 comment
Labels: bug, p0
#176 - [testing bug] Many convergence tests are incorrect - comparing LigerKernel against itself
Issue -
State: closed - Opened by tyler-romero 21 days ago
- 3 comments
Labels: p0
#175 - Monkeypatch for Qwen2-VL
Pull Request -
State: closed - Opened by tyler-romero 21 days ago
- 6 comments
#174 - torch.compile() throws exception when LigerKernel is used
Issue -
State: closed - Opened by tyler-romero 21 days ago
- 6 comments
#173 - Test for compatibility with torch.compile
Pull Request -
State: open - Opened by tyler-romero 21 days ago
- 3 comments
#172 - Feat/functional api
Pull Request -
State: closed - Opened by S1ro1 21 days ago
- 7 comments
#171 - bump patch ver
Pull Request -
State: closed - Opened by yundai424 21 days ago
#170 - README: ensure modeling code is patched before model instantiation
Pull Request -
State: closed - Opened by tmm1 21 days ago
- 10 comments
#169 - [Operators] LayerNorm Kernels + LigerLayerNorm
Pull Request -
State: closed - Opened by AndreSlavescu 21 days ago
#168 - Bug fix for gemma: fused_linear_cross_entropy flag and cross_entropy flag are mutual exclusive
Pull Request -
State: closed - Opened by JasonZhu1313 21 days ago
#167 - Update release guide
Pull Request -
State: closed - Opened by yundai424 21 days ago
#166 - Add gemma 7b it benchmark
Pull Request -
State: closed - Opened by JasonZhu1313 21 days ago
#165 - [feat/multimodal] support for Qwen2-VL
Issue -
State: closed - Opened by hiyouga 21 days ago
- 3 comments
Labels: multimodal
#164 - Update version in setup.py to 0.2.0
Pull Request -
State: closed - Opened by yundai424 21 days ago
#163 - Bump package ver
Pull Request -
State: closed - Opened by yundai424 21 days ago
#162 - FlexAttention integration
Pull Request -
State: open - Opened by davidgonmar 21 days ago
#161 - Add missing tf_keras to req.txt
Pull Request -
State: closed - Opened by JasonZhu1313 21 days ago
#160 - test_fused_linear_cross_entropy: @pytest.mark.parametrize("bias", [True, False]) test_correctness is failing on CI
Issue -
State: closed - Opened by helloworld1 21 days ago
- 3 comments
#159 - Skip Tests for GPUs Not Supporting `bf16`
Pull Request -
State: closed - Opened by austin362667 22 days ago
- 2 comments
#158 - bump lowest HF version
Pull Request -
State: closed - Opened by yundai424 22 days ago
#157 - update readme to use absolute paths
Pull Request -
State: closed - Opened by shaoruu 22 days ago
#156 - [fun] mamba.triton
Issue -
State: open - Opened by ByronHsu 22 days ago
Labels: fun
#155 - fix convergence test, phi3 import and update benchmark
Pull Request -
State: closed - Opened by yundai424 22 days ago
#154 - Softcap support in Flce[WIP]
Pull Request -
State: open - Opened by troy1729 22 days ago
- 2 comments
#153 - Reduction support for CrossEntropy and Division by 0 Fix
Pull Request -
State: closed - Opened by shivam15s 22 days ago
- 3 comments
Labels: reviewing
#152 - [easy] logo not shown on pypi
Issue -
State: closed - Opened by ByronHsu 22 days ago
- 2 comments
#151 - [feat] functional API for the ops
Issue -
State: closed - Opened by yundai424 22 days ago
- 3 comments
Labels: good first issue