Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / efeslab/Nanoflow issues and pull requests

#32 - Issues with running serve.sh

Issue - State: open - Opened by palebluedot19 16 days ago

#31 - How to run on A100 40G?

Issue - State: open - Opened by TopIdiot about 1 month ago - 2 comments

#30 - core dumped when running serve_8B.py

Issue - State: closed - Opened by yjw258 2 months ago - 1 comment

#29 - typo

Issue - State: open - Opened by yjw258 2 months ago

#28 - unreadable generation results

Issue - State: open - Opened by Fonsifa 2 months ago

#27 - code for automated parametric search

Issue - State: open - Opened by yjw258 2 months ago

#26 - Gemm Performance loss due to RowMajor

Issue - State: closed - Opened by chenhongyu2048 3 months ago - 1 comment

#26 - Gemm Performance loss due to RowMajor

Issue - State: closed - Opened by chenhongyu2048 3 months ago - 1 comment

#25 - The implementation difficulty is high.

Issue - State: open - Opened by xddun 3 months ago - 1 comment

#24 - How do you set the number of SMs for a cutlass kernel?

Issue - State: closed - Opened by ZZBoom 4 months ago - 1 comment

#24 - How do you set the number of SMs for a cutlass kernel?

Issue - State: closed - Opened by ZZBoom 4 months ago - 1 comment

#23 - CUDA Error: misaligned address

Issue - State: open - Opened by jinluyang 4 months ago

#23 - CUDA Error: misaligned address

Issue - State: open - Opened by jinluyang 4 months ago

#22 - error: peer access is not supported between these two device

Issue - State: closed - Opened by Ox0400 4 months ago - 4 comments

#22 - error: peer access is not supported between these two device

Issue - State: closed - Opened by Ox0400 4 months ago - 4 comments

#21 - illegal memory access in genEmbedding kernel

Issue - State: closed - Opened by jinluyang 4 months ago - 2 comments

#20 - No online serving code yet?

Issue - State: closed - Opened by HarryWu99 4 months ago - 2 comments

#19 - Fix: wrong content for offloadKernel

Pull Request - State: closed - Opened by serendipity-zk 5 months ago

#18 - Fix: offload kernels

Pull Request - State: open - Opened by serendipity-zk 5 months ago

#16 - setup.sh not working

Issue - State: closed - Opened by didlawowo 5 months ago - 2 comments

#15 - A question about PF in the paper

Issue - State: closed - Opened by kme2698 5 months ago - 1 comment

#14 - How to handle comp-comm overlapping?

Issue - State: closed - Opened by chenhongyu2048 5 months ago - 3 comments

#13 - How will this framwork control SMs for each kernel?

Issue - State: closed - Opened by chenhongyu2048 5 months ago - 5 comments

#12 - How much CPU RAM to compile?

Issue - State: closed - Opened by benjamin-marie 5 months ago - 3 comments

#12 - How much CPU RAM to compile?

Issue - State: closed - Opened by benjamin-marie 5 months ago - 3 comments

#11 - Question about the Performance

Issue - State: closed - Opened by chenhongyu2048 5 months ago - 2 comments

#11 - Question about the Performance

Issue - State: closed - Opened by chenhongyu2048 5 months ago - 2 comments

#10 - support multimodal models such as qwen2 vl, llava series

Issue - State: closed - Opened by Jack47 5 months ago - 1 comment

#10 - support multimodal models such as qwen2 vl, llava series

Issue - State: closed - Opened by Jack47 5 months ago - 1 comment

#9 - docs: update README.md

Pull Request - State: closed - Opened by eltociear 5 months ago

#9 - docs: update README.md

Pull Request - State: closed - Opened by eltociear 5 months ago

#8 - How to support qwen2 ?

Issue - State: open - Opened by njuptpz 5 months ago

#8 - How to support qwen2 ?

Issue - State: closed - Opened by njuptpz 5 months ago

#7 - Does this method have the same benefit when tp=1 or tp=2?

Issue - State: closed - Opened by CSEEduanyu 5 months ago - 1 comment

#7 - Does this method have the same benefit when tp=1 or tp=2?

Issue - State: closed - Opened by CSEEduanyu 5 months ago - 1 comment

#6 - Fix link error and auto build library.

Pull Request - State: open - Opened by AlongWY 5 months ago

#6 - Fix link error and auto build library.

Pull Request - State: open - Opened by AlongWY 5 months ago

#5 - The output is wrong when using serve.py.

Issue - State: closed - Opened by alexngng 5 months ago - 6 comments

#5 - The output is wrong when using serve.py.

Issue - State: closed - Opened by alexngng 5 months ago - 6 comments

#4 - How to reproduce the benchmark?

Issue - State: closed - Opened by alexngng 5 months ago - 3 comments

#3 - Benchmark scripts

Issue - State: closed - Opened by SunflowerAries 5 months ago - 1 comment

#2 - No license?

Issue - State: closed - Opened by aikitoria 5 months ago - 1 comment

#1 - A question while reading the paper

Issue - State: closed - Opened by JasonJ2021 5 months ago - 5 comments