Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / tpoisonooo/llama.onnx issues and pull requests
#29 - Error in converting llama
Issue -
State: open - Opened by purejomo 3 months ago
#28 - llama => onnx => tensorrt
Issue -
State: closed - Opened by tp-nan about 1 year ago
#27 - 一种改进next_token计算的方式
Issue -
State: open - Opened by luchangli03 over 1 year ago
- 1 comment
#26 - 如何分段转换llama模型为onnx？
Issue -
State: open - Opened by jxcomeon over 1 year ago
- 5 comments
#25 - GPU Inference
Issue -
State: open - Opened by tpoisonooo over 1 year ago
- 3 comments
#24 - fix(demo_llama): import error
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#23 - cannot import name 'MemoryPoolSimple' from 'public'
Issue -
State: open - Opened by JiangFeng07 over 1 year ago
- 1 comment
#22 - 请问如何支持batch的推理？
Issue -
State: open - Opened by VincentJYZhang over 1 year ago
- 1 comment
#21 - onnx模型推理
Issue -
State: open - Opened by hhhh70 over 1 year ago
- 1 comment
#20 - Could you add torch.onnx.export() in tools/export-onnx.py
Issue -
State: open - Opened by foreveronehundred over 1 year ago
- 2 comments
#19 - 7B onnx模型(float16) 占用显存超过32G
Issue -
State: open - Opened by iamhere1 over 1 year ago
#18 - transfer fp32 to fp16 error
Issue -
State: open - Opened by Ted8000 over 1 year ago
#17 - Alternative RWKV onnx converter
Issue -
State: closed - Opened by harrisonvanderbyl over 1 year ago
- 1 comment
#16 - Inference with GPU took too much GPU RAM
Issue -
State: open - Opened by DungMinhDao over 1 year ago
- 4 comments
#15 - Inference super slow
Issue -
State: open - Opened by SinanAkkoyun over 1 year ago
- 4 comments
#14 - demo_llama.py: No module named public
Issue -
State: closed - Opened by SinanAkkoyun over 1 year ago
- 1 comment
#13 - Add rwkv script
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#12 - convert Onnx problem
Issue -
State: open - Opened by xcxhy over 1 year ago
- 11 comments
#11 - Maybe some thing wrong with the script "demo_single.py"
Issue -
State: closed - Opened by yingzhao27 over 1 year ago
- 3 comments
#10 - feat(tools): add convert to tvm
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#9 - 关于ONNX转换
Issue -
State: open - Opened by lingffff over 1 year ago
- 17 comments
#8 - feat(tools): support fp16
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#7 - feat(llama): support memory pool
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#6 - feat(project): reduce onnx model size
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#5 - docs(project): add doc
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#4 - feat(project): add logits warp
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#3 - some questions about llama.onnx
Issue -
State: closed - Opened by dvc94ch over 1 year ago
- 13 comments
Labels: documentation
#2 - docs(project): add README
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago
#1 - feat(demo): add onnxruntime script
Pull Request -
State: closed - Opened by tpoisonooo over 1 year ago