sgl-project/sglang issues and pull requests

#1239 - Update README.md

Pull Request - State: closed - Opened by merrymercy 23 days ago

#1239 - Update README.md

Pull Request - State: closed - Opened by merrymercy 23 days ago

#1238 - [Bug] get jammed when deploy Qwen2-72b ：UserWarning: resource_tracker: There appear to be 1 leaked shared_memory objects to clean up at shutdown warnings.warn('resource_tracker: There appear to be %d '

Issue - State: open - Opened by ArtificialZeng 23 days ago - 7 comments

#1238 - [Bug] get jammed when deploy Qwen2-72b ：UserWarning: resource_tracker: There appear to be 1 leaked shared_memory objects to clean up at shutdown warnings.warn('resource_tracker: There appear to be %d '

Issue - State: open - Opened by ArtificialZeng 23 days ago - 5 comments

#1237 - [Minor] Add more type annotations

Pull Request - State: closed - Opened by merrymercy 23 days ago

#1237 - [Minor] Add more type annotations

Pull Request - State: closed - Opened by merrymercy 23 days ago

#1236 - Fix readme

Pull Request - State: closed - Opened by ArtificialZeng 23 days ago

#1236 - Fix readme

Pull Request - State: closed - Opened by ArtificialZeng 23 days ago

#1234 - feat: replace GeluAndMul

Pull Request - State: closed - Opened by zhyncs 23 days ago - 3 comments

#1234 - feat: replace GeluAndMul

Pull Request - State: closed - Opened by zhyncs 23 days ago - 3 comments

#1233 - feat: support sm75 with FlashInfer v0.1.6

Pull Request - State: closed - Opened by zhyncs 23 days ago - 2 comments

#1233 - feat: support sm75 with FlashInfer v0.1.6

Pull Request - State: closed - Opened by zhyncs 23 days ago - 2 comments

#1232 - feat: update GemmaRMSNorm

Pull Request - State: closed - Opened by zhyncs 24 days ago - 1 comment
Labels: enhancement

#1232 - feat: update GemmaRMSNorm

Pull Request - State: closed - Opened by zhyncs 24 days ago - 1 comment
Labels: enhancement

#1231 - feat: replace get_act_fn for gpt_bigcode

Pull Request - State: closed - Opened by zhyncs 24 days ago

#1231 - feat: replace get_act_fn for gpt_bigcode

Pull Request - State: closed - Opened by zhyncs 24 days ago

#1230 - [FIX] Wrong logger

Pull Request - State: closed - Opened by havetc 24 days ago - 1 comment

#1230 - [FIX] Wrong logger

Pull Request - State: closed - Opened by havetc 24 days ago - 1 comment

#1228 - Some questions about TTFT and TPOT benchmarks

Issue - State: closed - Opened by sitabulaixizawaluduo 24 days ago

#1228 - Some questions about TTFT and TPOT benchmarks

Issue - State: closed - Opened by sitabulaixizawaluduo 24 days ago

#1227 - [Minor] add delete test and delete tmp file on ci server

Pull Request - State: closed - Opened by yichuan520030910320 24 days ago

#1227 - [Minor] add delete test and delete tmp file on ci server

Pull Request - State: closed - Opened by yichuan520030910320 24 days ago

#1226 - No such file or directory: '/sbin/ldconfig'

Issue - State: closed - Opened by zwc163 24 days ago - 2 comments

#1226 - No such file or directory: '/sbin/ldconfig'

Issue - State: closed - Opened by zwc163 24 days ago - 2 comments

#1225 - Fix bench latency benchmark

Pull Request - State: closed - Opened by hnyls2002 24 days ago - 4 comments

#1225 - Fix bench latency benchmark

Pull Request - State: closed - Opened by hnyls2002 24 days ago - 4 comments

#1224 - Openvla

Pull Request - State: closed - Opened by hnyls2002 24 days ago

#1224 - Openvla

Pull Request - State: closed - Opened by hnyls2002 24 days ago

#1223 - Torch compile CI throughput test

Pull Request - State: closed - Opened by hnyls2002 24 days ago

#1223 - Torch compile CI throughput test

Pull Request - State: closed - Opened by hnyls2002 24 days ago

#1222 - [FEAT] Support batches cancel

Pull Request - State: closed - Opened by caiyueliang 25 days ago - 1 comment

#1222 - [FEAT] Support batches cancel

Pull Request - State: closed - Opened by caiyueliang 25 days ago - 1 comment

#1221 - Safety test

Pull Request - State: closed - Opened by hnyls2002 25 days ago

#1221 - Safety test

Pull Request - State: closed - Opened by hnyls2002 25 days ago

#1220 - 在A6000上启动，14bqwen1.5，发现有问题，多GPU启动，只能用1张卡或者2张卡，如果设置3,4,5,6会报错，

Issue - State: closed - Opened by yawzhe 25 days ago

#1220 - 在A6000上启动，14bqwen1.5，发现有问题，多GPU启动，只能用1张卡或者2张卡，如果设置3,4,5,6会报错，

Issue - State: closed - Opened by yawzhe 25 days ago

#1219 - [CI] Parallelize unit tests in CI

Pull Request - State: closed - Opened by wisclmy0611 25 days ago

#1219 - [CI] Parallelize unit tests in CI

Pull Request - State: closed - Opened by wisclmy0611 25 days ago

#1218 - [Fix] Multi-images loading error

Pull Request - State: closed - Opened by kcz358 25 days ago

#1218 - [Fix] Multi-images loading error

Pull Request - State: closed - Opened by kcz358 25 days ago

#1217 - [CI] Fix CI

Pull Request - State: closed - Opened by wisclmy0611 25 days ago

#1217 - [CI] Fix CI

Pull Request - State: closed - Opened by wisclmy0611 25 days ago

#1216 - [Feature] add option to use liger triton kernel

Issue - State: closed - Opened by binarycrayon 25 days ago - 5 comments
Labels: await-response

#1216 - [Feature] add option to use liger triton kernel

Issue - State: open - Opened by binarycrayon 25 days ago - 3 comments
Labels: await-response

#1215 - improve the threshold and ports in tests

Pull Request - State: closed - Opened by wisclmy0611 25 days ago