Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / linkedin/Liger-Kernel issues and pull requests

#286 - Release version 0.3.1

Pull Request - State: closed - Opened by shimizust 5 months ago - 1 comment

#285 - 2024 Q4 Roadmap

Issue - State: open - Opened by ByronHsu 5 months ago

#285 - 2024 Q4 Roadmap

Issue - State: open - Opened by ByronHsu 5 months ago

#284 - poke tests

Pull Request - State: closed - Opened by tyler-romero 5 months ago

#283 - Add missing Qwen2-VL monkey patch test

Pull Request - State: closed - Opened by tyler-romero 5 months ago - 1 comment

#282 - Monkeypatch for Llama 3.2-Vision

Pull Request - State: closed - Opened by tyler-romero 5 months ago - 13 comments

#281 - Add TVD (Total variation distance) Kernel

Issue - State: open - Opened by qingquansong 5 months ago - 3 comments
Labels: feature

#281 - Add TVD (Total variation distance) Kernel

Issue - State: open - Opened by qingquansong 5 months ago - 1 comment
Labels: feature

#280 - Post-init model patching fix

Pull Request - State: closed - Opened by shimizust 5 months ago - 1 comment

#280 - Post-init model patching fix

Pull Request - State: closed - Opened by shimizust 5 months ago - 1 comment

#279 - Weights are not copied when model is already instantiated

Issue - State: closed - Opened by ByronHsu 5 months ago - 1 comment

#278 - Add general JSD (w/ beta) support

Issue - State: closed - Opened by qingquansong 5 months ago - 4 comments
Labels: feature

#277 - Adding ignore index support for divergence losses

Issue - State: closed - Opened by qingquansong 5 months ago
Labels: feature

#277 - Adding ignore index support for divergence losses

Issue - State: open - Opened by qingquansong 5 months ago
Labels: feature

#275 - [Kernel] Flash attention 2

Pull Request - State: open - Opened by remi-or 5 months ago - 4 comments

#274 - FIX: tl.program_id() does indeed not have a cast method in triton2.3.1

Pull Request - State: closed - Opened by wizyoung 5 months ago - 1 comment

#273 - Ensure In-place correctness checks work properly

Pull Request - State: open - Opened by Tcc0403 5 months ago - 6 comments

#272 - In-place operations in triton kernel might result in incorrect gradient calculations

Issue - State: open - Opened by Tcc0403 5 months ago - 3 comments
Labels: bug

#271 - Encountered errors when reproducing lightning training example

Issue - State: closed - Opened by ReginaZh 5 months ago - 3 comments

#270 - Relaxed transformers dependency

Pull Request - State: closed - Opened by shimizust 5 months ago

#269 - Fix sharing a ResBlock layer for each head in Medusa example

Pull Request - State: closed - Opened by chiwanpark 5 months ago - 2 comments

#267 - rename cuda mode to gpu mode

Pull Request - State: closed - Opened by msaroufim 5 months ago

#266 - Choice of num_warps

Issue - State: closed - Opened by Edenzzzz 5 months ago - 7 comments

#265 - chore: Add Qwen2.5 and Phi3.5 to Readme

Pull Request - State: closed - Opened by tyler-romero 5 months ago

#264 - Add JSD kernel

Pull Request - State: closed - Opened by Tcc0403 5 months ago - 6 comments

#263 - Fix AutoLigerKernelForCausalLM to pass through original kwargs

Pull Request - State: closed - Opened by shimizust 5 months ago - 1 comment

#262 - Fix/kldiv

Pull Request - State: closed - Opened by S1ro1 5 months ago - 13 comments

#261 - Fix assert_verbose_allclose bugs

Pull Request - State: closed - Opened by Tcc0403 5 months ago

#260 - Update contributing guide for adding a new model

Pull Request - State: closed - Opened by shivam15s 5 months ago

#259 - test.utils.assert_verbose_allclose has multiple bugs

Issue - State: closed - Opened by Tcc0403 5 months ago - 4 comments

#258 - Optional dependency on transformers

Issue - State: closed - Opened by DuarteMRAlves 5 months ago - 6 comments

#257 - Loss does not drop when using Liger Kernel at Qwen2.5

Issue - State: open - Opened by Se-Hun 5 months ago - 12 comments

#256 - Fix a comment typo in flce

Pull Request - State: closed - Opened by Tcc0403 5 months ago

#255 - RMSNorm aggregation

Pull Request - State: closed - Opened by Tcc0403 5 months ago - 3 comments

#254 - Are you even allowed to do these ops inplace?

Issue - State: closed - Opened by mayank31398 5 months ago - 4 comments

#253 - [Model] Pixtral Support

Pull Request - State: open - Opened by AndreSlavescu 5 months ago - 3 comments

#252 - reverse KL and JSD

Issue - State: closed - Opened by yundai424 5 months ago - 1 comment
Labels: feature

#251 - [Easy] Cast program_id to int64 in SwiGLU/GeGLU kernels

Pull Request - State: closed - Opened by hansonw 5 months ago

#250 - AutoLigerKernelForCausalLM.from_pretrained discards hub_kwargs_names

Issue - State: closed - Opened by uris-opti 5 months ago - 5 comments

#249 - ValueError when Loading Qwen2-VL Model with Liger Kernel

Issue - State: closed - Opened by rahatarinasir 5 months ago - 1 comment

#248 - Support for Cohere models

Issue - State: open - Opened by nyxkrage 5 months ago - 1 comment

#247 - Remove debug print statement

Pull Request - State: closed - Opened by EdoardoLuciani 5 months ago - 1 comment

#246 - Release Liger-Kernel version 0.3.0

Pull Request - State: closed - Opened by qingquansong 5 months ago

#245 - Is not compatible with DoRA?

Issue - State: closed - Opened by gotzmann 5 months ago - 1 comment
Labels: bug

#244 - Add label smoothing to FLCE and unit tests

Pull Request - State: closed - Opened by Tcc0403 5 months ago - 1 comment

#243 - Lable smoothing is not applied and tested in flce

Issue - State: closed - Opened by Tcc0403 5 months ago

#241 - Reasons for upcasting the logits dtype outside the kernel

Issue - State: closed - Opened by yzhangcs 5 months ago - 8 comments

#240 - SWIFT Trainer Integration

Pull Request - State: closed - Opened by tastelikefeet 5 months ago

#239 - Support Z Loss in CE

Pull Request - State: closed - Opened by Tcc0403 5 months ago - 4 comments

#238 - fused_linear_cross_entropy: Move float32 cast into kernel

Pull Request - State: closed - Opened by hansonw 5 months ago - 9 comments

#234 - Support Z Loss in CE

Pull Request - State: closed - Opened by Tcc0403 5 months ago - 1 comment

#232 - Restore monkey patched modules

Pull Request - State: closed - Opened by austin362667 5 months ago - 4 comments

#231 - Triton error on AMD GPUs

Issue - State: closed - Opened by eminorhan 5 months ago - 8 comments

#230 - added `reduction` argument in Cross Entropy Kernel

Pull Request - State: closed - Opened by Ankur-singh 5 months ago - 6 comments

#229 - Feat: add kl div to readme

Pull Request - State: closed - Opened by S1ro1 5 months ago

#228 - [Operator] conv2d

Pull Request - State: open - Opened by AndreSlavescu 6 months ago - 1 comment

#227 - Torch compiled FLCE is 2x faster than the current FLCE

Issue - State: closed - Opened by ByronHsu 6 months ago - 12 comments

#226 - (fix) fix pyproject.toml

Pull Request - State: closed - Opened by wizyoung 6 months ago - 11 comments

#225 - added group norm

Pull Request - State: closed - Opened by denti 6 months ago - 1 comment
Labels: reviewing

#224 - Add license in ack section

Pull Request - State: closed - Opened by ByronHsu 6 months ago

#223 - Added HF use-case benchmark script

Pull Request - State: closed - Opened by shimizust 6 months ago

#222 - Elaborate ack section

Pull Request - State: closed - Opened by ByronHsu 6 months ago

#221 - Elaborate ack section

Pull Request - State: closed - Opened by ByronHsu 6 months ago

#220 - add repr infomation for layer_norm and rms_norm

Pull Request - State: closed - Opened by wizyoung 6 months ago - 2 comments

#219 - Fix compatibility issue on triton=2.3.1

Pull Request - State: closed - Opened by Tcc0403 6 months ago

#218 - (fix) fix pyproject.toml

Pull Request - State: closed - Opened by wizyoung 6 months ago - 1 comment

#217 - Update swiglu and geglu forward: zeros_like -> empty_like

Pull Request - State: closed - Opened by IvanYashchuk 6 months ago - 9 comments

#216 - Reference Unsloth in header

Pull Request - State: closed - Opened by momochen 6 months ago - 4 comments

#215 - LayerNorm error: TypeError: missing a required argument: 'num_warps'

Issue - State: closed - Opened by wizyoung 6 months ago - 6 comments
Labels: bug, triton

#214 - Add support for jamba model with Liger Kernel

Pull Request - State: open - Opened by yubofredwang 6 months ago - 2 comments

#213 - minor refactor of rms and layernorm

Pull Request - State: closed - Opened by lancerts 6 months ago

#212 - Refactor/benchmarking visualizer

Pull Request - State: closed - Opened by S1ro1 6 months ago - 4 comments

#211 - Refactor: Benchmark visualizer

Issue - State: closed - Opened by S1ro1 6 months ago

#210 - Uplift kernel APIs to top level

Pull Request - State: closed - Opened by austin362667 6 months ago

#209 - Add `--decimal` flag to benchmarking

Pull Request - State: closed - Opened by austin362667 6 months ago - 2 comments

#208 - Support Yi-Coder

Issue - State: closed - Opened by ryankert01 6 months ago - 7 comments
Labels: feature

#207 - Update layer_norm.py

Pull Request - State: closed - Opened by lancerts 6 months ago

#206 - MoE kernel

Issue - State: open - Opened by ByronHsu 6 months ago - 5 comments
Labels: feature

#205 - Uplift kernel api to top level

Issue - State: closed - Opened by ByronHsu 6 months ago - 1 comment

#204 - Documentation improvement

Issue - State: closed - Opened by merryHunter 6 months ago - 4 comments

#203 - Update test_rms_norm.py

Pull Request - State: closed - Opened by lancerts 6 months ago

#202 - ci fix

Pull Request - State: closed - Opened by AndreSlavescu 6 months ago

#201 - Update the casting logic of RMSNorm

Pull Request - State: closed - Opened by lancerts 6 months ago - 2 comments

#200 - Ci

Pull Request - State: closed - Opened by AndreSlavescu 6 months ago

#199 - Support for patching post-model initialization

Pull Request - State: closed - Opened by shimizust 6 months ago - 1 comment

#198 - Add label smoothing for cross entropy

Pull Request - State: closed - Opened by Tcc0403 6 months ago - 9 comments

#197 - Z Loss in CE

Issue - State: closed - Opened by Fr0do 6 months ago - 2 comments
Labels: feature

#196 - Refactored benchmark tests

Pull Request - State: closed - Opened by shimizust 6 months ago - 3 comments

#195 - FEAT Adding experimental feature : Triton mm int8xint2

Pull Request - State: closed - Opened by MekkCyber 6 months ago - 7 comments

#194 - Feat: Kl Divergence kernel

Pull Request - State: closed - Opened by S1ro1 6 months ago - 7 comments

#192 - Lenient Test

Issue - State: closed - Opened by jon-chuang 6 months ago - 1 comment

#191 - TypoFixed repo_foward -> rope_forward

Pull Request - State: closed - Opened by LucioPalmucci 6 months ago