Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / linkedin/Liger-Kernel issues and pull requests

#132 - CI Test

Pull Request - State: closed - Opened by helloworld1 2 months ago

#131 - [feat] Add support for encoder-only transformers (e.g. BERT)

Issue - State: open - Opened by OxxoCodes 2 months ago
Labels: feature

#129 - [feat] support for DeepseekV2

Issue - State: open - Opened by tmm1 2 months ago - 4 comments
Labels: help wanted, huggingface, feature

#127 - [feat] FusedLinearCrossEntropy support for Gemma2

Issue - State: open - Opened by yundai424 2 months ago - 5 comments
Labels: feature

#120 - Add gemma lightning example for single L40 GPU

Pull Request - State: closed - Opened by qingquansong 2 months ago - 3 comments

#119 - [fun] llama.triton

Issue - State: open - Opened by ByronHsu 2 months ago - 7 comments
Labels: fun

#117 - Update rms_norm.py

Pull Request - State: closed - Opened by lancerts 3 months ago

#103 - Add FusedLinerCrossEntropy support for Phi3

Pull Request - State: closed - Opened by tyler-romero 3 months ago - 3 comments

#102 - jamba liger fused linear+xentropy

Pull Request - State: open - Opened by winglian 3 months ago - 6 comments

#100 - [feat] FusedLinearCrossEntropy support for Mistral

Issue - State: closed - Opened by yundai424 3 months ago - 2 comments
Labels: good first issue, feature

#99 - [feat] FusedLinearCrossEntropy support for Mixtral

Issue - State: closed - Opened by yundai424 3 months ago - 3 comments
Labels: good first issue, feature

#98 - [feat] FusedLinearCrossEntropy support for phi-3

Issue - State: closed - Opened by ByronHsu 3 months ago - 3 comments
Labels: good first issue, feature

#97 - [Fix package version in setup.py]

Issue - State: closed - Opened by yushengsu-thu 3 months ago - 1 comment

#96 - LigerGEGLUMLP error with torch.compile

Issue - State: open - Opened by Luke-Chesley 3 months ago - 6 comments
Labels: bug

#95 - pytest without need to dealing with PYTHONPATH

Pull Request - State: closed - Opened by helloworld1 3 months ago

#94 - Update test_cross_entropy.py

Pull Request - State: closed - Opened by lancerts 3 months ago

#93 - Add FusedLinerCrossEntropy support for Mistral

Pull Request - State: closed - Opened by Tcc0403 3 months ago - 5 comments

#92 - feat: correct casts in RMSNorm to match references

Pull Request - State: closed - Opened by davidgonmar 3 months ago - 14 comments

#91 - modified: README.md

Pull Request - State: closed - Opened by leaf-soba 3 months ago

#90 - Make tests passing on AMD GPU with 24GB ram

Pull Request - State: closed - Opened by helloworld1 3 months ago

#89 - Fix Dtype Issue of Gemma RMSNorm

Issue - State: closed - Opened by lancerts 3 months ago - 3 comments
Labels: bug, good first issue

#88 - Fix example bugs

Pull Request - State: closed - Opened by qingquansong 3 months ago

#87 - Add `pytest` filtering based on GPU types

Issue - State: closed - Opened by austin362667 3 months ago - 1 comment

#86 - update install from source guide

Pull Request - State: closed - Opened by yundai424 3 months ago

#85 - Fix Gemma RMSNorm

Pull Request - State: closed - Opened by davidgonmar 3 months ago - 2 comments

#84 - chore: update cross_entropy.py

Pull Request - State: closed - Opened by eltociear 3 months ago

#83 - Support reduction = None and "sum" in Cross Entropy

Issue - State: closed - Opened by ByronHsu 3 months ago - 2 comments
Labels: p0, feature

#82 - Support passing bias term in fused linear cross entropy

Issue - State: closed - Opened by ByronHsu 3 months ago - 1 comment

#81 - Label Smoothing Cross Entropy

Issue - State: closed - Opened by zzw-zwzhang 3 months ago - 2 comments
Labels: enhancement

#80 - Add logo

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#79 - Fix incorrect import for triton 3

Pull Request - State: closed - Opened by arvindsun 3 months ago - 5 comments

#78 - Remove unused images in `examples/medusa/docs/images/`

Pull Request - State: closed - Opened by pchng 3 months ago - 1 comment

#77 - Fix typos

Pull Request - State: closed - Opened by pchng 3 months ago

#76 - Monkeypatch for Phi3

Pull Request - State: closed - Opened by tyler-romero 3 months ago - 5 comments

#75 - Move from setup.py to pyproject.toml.

Pull Request - State: closed - Opened by mohammadpagard 3 months ago - 4 comments

#74 - [bug fix] Gemma needs RMSNorm with 1.0 offset

Issue - State: closed - Opened by yundai424 3 months ago
Labels: bug, good first issue

#73 - Request to support the Flux model (T2I diffusion transformer)

Issue - State: open - Opened by RefractAI 3 months ago - 1 comment
Labels: feature

#72 - Move from setup.py to pyproject.toml

Issue - State: closed - Opened by ByronHsu 3 months ago - 2 comments
Labels: good first issue, operation

#71 - GPU CI

Issue - State: closed - Opened by ByronHsu 3 months ago - 1 comment
Labels: operation

#70 - Model Agnostic Patching?

Issue - State: closed - Opened by lapp0 3 months ago - 14 comments
Labels: enhancement, huggingface

#69 - Add monkey patch for Qwen2 models

Pull Request - State: closed - Opened by chiwanpark 3 months ago

#68 - Add pytest and datasets to dev dependencies

Pull Request - State: closed - Opened by chiwanpark 3 months ago - 3 comments

#67 - Inquiry about FSDP and PP

Issue - State: closed - Opened by SeungyounShin 3 months ago - 1 comment

#66 - [feat] Int8 Matmul Training kernel

Issue - State: open - Opened by qingquansong 3 months ago
Labels: feature

#65 - [feat] FP8 Matmul Training Kernel

Issue - State: open - Opened by qingquansong 3 months ago
Labels: feature

#64 - Python autodoc

Issue - State: open - Opened by ByronHsu 3 months ago - 3 comments
Labels: documentation, good first issue, p0

#63 - [feat] Add jamba support

Issue - State: open - Opened by yundai424 3 months ago
Labels: feature

#62 - [feat] FusedLinearCrossEntropy support for Mixtral, Mistral, Gemma, Qwen

Issue - State: closed - Opened by yundai424 3 months ago - 1 comment

#61 - [feat] on-paper form of RoPE

Issue - State: open - Opened by yundai424 3 months ago - 1 comment
Labels: enhancement, good first issue, feature

#60 - Add star graph

Pull Request - State: closed - Opened by shivam15s 3 months ago

#59 - Update benchmark result of Medusa for batch size = 6 setup

Pull Request - State: closed - Opened by JasonZhu1313 3 months ago

#58 - Update README.md

Pull Request - State: closed - Opened by lancerts 3 months ago

#57 - Benchmark against unsloth

Issue - State: closed - Opened by ccdv-ai 3 months ago - 2 comments

#56 - Remove benchmark png/html and only store csv

Issue - State: closed - Opened by ByronHsu 3 months ago - 2 comments
Labels: good first issue

#55 - Updated test tolerances for H100

Pull Request - State: closed - Opened by shimizust 3 months ago

#54 - Added H100 benchmarks

Pull Request - State: closed - Opened by shimizust 3 months ago - 5 comments

#53 - Replace model / data with public HF path, update readme

Pull Request - State: closed - Opened by JasonZhu1313 3 months ago

#52 - Added metadata for PyPI and bumped version

Pull Request - State: closed - Opened by shimizust 3 months ago

#51 - Which GPUs does this work on?

Issue - State: open - Opened by nbroad1881 3 months ago - 10 comments
Labels: documentation, help wanted

#49 - Release version 0.1.0

Pull Request - State: closed - Opened by shimizust 3 months ago - 1 comment

#48 - Unable to use FLCE with FSDP+PEFT+embeddings layers

Issue - State: open - Opened by winglian 3 months ago - 5 comments
Labels: bug

#47 - Update CONTRIBUTING.md

Pull Request - State: closed - Opened by lancerts 3 months ago - 3 comments

#46 - Changed pointer variable names for clarity for SwiGLU

Pull Request - State: closed - Opened by zain-merchant 3 months ago - 1 comment

#45 - Remove override dependency

Pull Request - State: closed - Opened by shivam15s 3 months ago - 1 comment

#44 - Update README

Pull Request - State: closed - Opened by JacobHelwig 3 months ago

#43 - improve rms norm code quality

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#42 - Added more generic monkey patch function

Pull Request - State: closed - Opened by shimizust 3 months ago - 4 comments
Labels: huggingface

#41 - Refactored convergence tests to be portable

Pull Request - State: closed - Opened by shimizust 3 months ago - 4 comments
Labels: p0

#40 - Add MODEL_TO_LIGER_KERNEL_PATCHING_FUNC to minimize dependencies from external code

Pull Request - State: closed - Opened by JasonZhu1313 3 months ago - 1 comment
Labels: huggingface

#39 - Update README.md

Pull Request - State: closed - Opened by lancerts 3 months ago

#38 - Zain/singletest

Pull Request - State: closed - Opened by zain-merchant 3 months ago

#37 - Byhsu/readme 3

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#36 - Add deepspeed to lightning example

Pull Request - State: closed - Opened by yundai424 3 months ago - 2 comments

#35 - remove mfu and non used methods

Pull Request - State: closed - Opened by zain-merchant 3 months ago

#34 - Update README.md with Kernel descriptions

Pull Request - State: closed - Opened by qingquansong 3 months ago

#33 - Update README.md

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#32 - use correct fsdp act ckpt & redo benchmark

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#31 - update gif

Pull Request - State: closed - Opened by zain-merchant 3 months ago

#30 - Update feature_request.yaml and bug_report.yaml

Pull Request - State: closed - Opened by lancerts 3 months ago

#29 - Create bug_report.yaml and feature_request.yaml

Pull Request - State: closed - Opened by lancerts 3 months ago

#28 - break checkstyle

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#27 - Added CI workflow with checkstyle job

Pull Request - State: closed - Opened by shimizust 3 months ago

#26 - Polish test/ and others

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#25 - ignore e203 in flake8 to resolve black conflict

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#24 - forward compatibility with triton 3.0.0 for tanh

Pull Request - State: closed - Opened by yundai424 3 months ago

#23 - src directory polishing

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#22 - make fused linear+CE default for llama

Pull Request - State: closed - Opened by yundai424 3 months ago

#21 - create rms norm tensor at input.device instead of device 0

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#20 - Update PR template and contribution guide

Pull Request - State: closed - Opened by lancerts 3 months ago

#19 - Update README.md

Pull Request - State: closed - Opened by lancerts 3 months ago

#18 - Updated readme gif

Pull Request - State: closed - Opened by zain-merchant 3 months ago

#17 - Add lightning trainer and HF trainer fine-tuning example

Pull Request - State: closed - Opened by yundai424 3 months ago

#16 - update

Pull Request - State: closed - Opened by ByronHsu 3 months ago

#15 - Update README.md bib

Pull Request - State: closed - Opened by qingquansong 3 months ago

#14 - Update pull_request_template.md

Pull Request - State: closed - Opened by lancerts 3 months ago

#13 - Update README.md with bib cite

Pull Request - State: closed - Opened by qingquansong 3 months ago

#12 - Test GitHub PR setting

Pull Request - State: closed - Opened by ByronHsu 3 months ago