Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / hpcaitech/EnergonAI issues and pull requests

#225 - Added parallel code for chatglm-6B

Pull Request - State: open - Opened by Caesar1993 about 1 year ago

#222 - OPT-125m problem

Issue - State: open - Opened by Yummy813 over 1 year ago

#221 - Location of logs

Issue - State: closed - Opened by Yummy813 over 1 year ago

#217 - Failed to load pre-trained model weights for OPT_125M

Issue - State: closed - Opened by zhengmk321 over 1 year ago - 2 comments

#216 - Where is InferenceEngine definition?

Issue - State: open - Opened by yehx1 over 1 year ago

#214 - Is there an example of the http client?

Issue - State: open - Opened by frankxyy over 1 year ago - 1 comment

#213 - question about load model state_dict in multi-gpus

Issue - State: closed - Opened by irasin over 1 year ago - 2 comments

#212 - Concrete doc of this project

Issue - State: open - Opened by frankxyy over 1 year ago - 1 comment

#211 - _pickle.UnpicklingError: invalid load key, '{'.

Issue - State: open - Opened by RundongCao over 1 year ago - 4 comments

#210 - Where is InferenceEngine definition?

Issue - State: open - Opened by liujuncn over 1 year ago - 2 comments

#208 - [hotfix] fix rpc init and opt checkpoint key mapping

Pull Request - State: closed - Opened by ver217 over 1 year ago
Labels: bug

#207 - polish code and add setup script

Pull Request - State: open - Opened by juncongmoo over 1 year ago - 2 comments

#206 - an error caused by running the example of the opt

Issue - State: open - Opened by LemonSqi over 1 year ago - 4 comments

#205 - failure to compile energonai by the command : python setup.py build

Issue - State: open - Opened by LemonSqi over 1 year ago - 1 comment

#204 - fail to install EnergonAI

Issue - State: open - Opened by NewDriverLee over 1 year ago - 3 comments

#203 - OPT demo TEST

Issue - State: open - Opened by Batizhao8899 over 1 year ago - 2 comments

#202 - Add a sync version of wait()

Pull Request - State: closed - Opened by juncongmoo over 1 year ago - 1 comment

#201 - miss cache error when pose generation opt

Issue - State: open - Opened by tycallen over 1 year ago - 2 comments

#200 - [misc] add license

Pull Request - State: closed - Opened by ver217 over 1 year ago
Labels: documentation

#199 - How to use dynamic batch features

Issue - State: open - Opened by hudengjunai over 1 year ago - 1 comment

#198 - OPT inference

Issue - State: open - Opened by Joanna-0421 over 1 year ago - 2 comments

#197 - Fix bloom-int8 for v100

Pull Request - State: closed - Opened by Oliver-ss over 1 year ago - 1 comment

#196 - Doesn't run gpt reference?

Issue - State: open - Opened by YuchengWang over 1 year ago - 1 comment

#195 - [kernal] remove redundant cuda kernal

Pull Request - State: closed - Opened by binmakeswell over 1 year ago - 1 comment

#194 - Maybe you should add license for using OneFlow's LayerNorm Kernel implement？

Issue - State: closed - Opened by MARD1NO almost 2 years ago - 2 comments

#193 - Does not support Cuda 10.2 ?

Issue - State: open - Opened by 0-1CxH almost 2 years ago - 1 comment

#192 - Not compatible with the latest version of transformers? (4.26.1)

Issue - State: open - Opened by skiingpacman almost 2 years ago - 2 comments

#191 - Can not start the Bloom server

Issue - State: open - Opened by SAI990323 almost 2 years ago - 3 comments

#190 - fix typo in p2p.py

Pull Request - State: closed - Opened by eltociear almost 2 years ago - 1 comment

#189 - How to inference BLOOM-176B by multi-node multi-card？

Issue - State: open - Opened by vicwer almost 2 years ago - 2 comments

#188 - [doc] fix typo of BLOOM

Pull Request - State: closed - Opened by binmakeswell almost 2 years ago

#187 - Why does it unreadable generated by OPT-30B inferring with EnergonAI

Issue - State: closed - Opened by ericxsun almost 2 years ago - 11 comments

#186 - Cannot run opt 125m examples with latest energonai docker images

Issue - State: open - Opened by zhanghaoie almost 2 years ago - 2 comments

#185 - [example] fix requirements

Pull Request - State: closed - Opened by binmakeswell almost 2 years ago

#184 - Support OPT-IML model

Issue - State: closed - Opened by ericxsun almost 2 years ago - 1 comment

#183 - Failed to load OPT-30B checkpoint

Issue - State: closed - Opened by ericxsun almost 2 years ago - 2 comments

#182 - Detected RRef Leaks during shutdown, empty pipe, tests_engine failed

Issue - State: open - Opened by nostalgicimp almost 2 years ago - 1 comment

#181 - Update bloom/README with Generate time tesing

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#180 - Update README.md

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#179 - Update README

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#178 - polish

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#177 - [bloom] remove config.json

Pull Request - State: closed - Opened by feifeibear almost 2 years ago

#176 - Add Bloom-int8-tp support

Pull Request - State: closed - Opened by ht-zhou almost 2 years ago

#175 - trpc.rpc_sync consumed most time

Issue - State: open - Opened by fanlongbd almost 2 years ago

#173 - Update LICENSE

Pull Request - State: closed - Opened by binmakeswell about 2 years ago

#172 - Bloom int8 mode prototype

Pull Request - State: closed - Opened by CsRic about 2 years ago

#171 - bloom fp16 + tp server

Pull Request - State: closed - Opened by CsRic about 2 years ago

#170 - add shard init for tp

Pull Request - State: closed - Opened by CsRic about 2 years ago

#169 - TP shared cpu model

Pull Request - State: closed - Opened by CsRic about 2 years ago

#168 - update batch process

Pull Request - State: closed - Opened by CsRic about 2 years ago

#167 - [doc] polish readme

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#166 - add TP for bloom

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#165 - [bloom]update batch process

Pull Request - State: closed - Opened by CsRic about 2 years ago

#164 - bloom service

Pull Request - State: closed - Opened by CsRic about 2 years ago

#163 - [docs] add guide to pre-processing opt-175b weights

Pull Request - State: closed - Opened by ver217 about 2 years ago
Labels: documentation

#162 - [opt] add opt-6.7b and add fastapi server

Pull Request - State: closed - Opened by ver217 about 2 years ago

#161 - need guidelines on converting OPT-17B checkpoint

Issue - State: closed - Opened by gulzainali98 about 2 years ago

#160 - can't find server.sh

Issue - State: open - Opened by zhangyilalala about 2 years ago - 3 comments

#159 - torch.load() hangs indefinitely when reading OPT pre-trained model weights

Issue - State: open - Opened by larry-fuy about 2 years ago - 1 comment

#158 - does EnergonAI support gpt model with int8 quantitation in model parallel?

Issue - State: open - Opened by dearowen about 2 years ago - 1 comment

#157 - [engine] Async engine and pipeline based on RPC

Pull Request - State: closed - Opened by ver217 about 2 years ago - 1 comment

#156 - [setup] add version control

Pull Request - State: closed - Opened by ver217 about 2 years ago

#155 - [utils] fix checkpointing import

Pull Request - State: closed - Opened by ver217 about 2 years ago

#154 - [utils] remove useless utils

Pull Request - State: closed - Opened by ver217 about 2 years ago

#153 - [logging] remove logging module

Pull Request - State: closed - Opened by ver217 about 2 years ago

#152 - CUDA error: no kernel image is available for execution on the device

Issue - State: open - Opened by KastanDay about 2 years ago - 3 comments

#151 - [RFC] Async engine and pipeline based on RPC

Issue - State: closed - Opened by ver217 about 2 years ago - 1 comment

#150 - prometheus

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#149 - Add prometheus endpoint for opt_server.py

Pull Request - State: closed - Opened by ofey404 about 2 years ago - 1 comment

#148 - update readme

Pull Request - State: closed - Opened by dujiangsu about 2 years ago

#147 - [nn] replace energonai.nn with colossalai.nn

Pull Request - State: closed - Opened by ver217 about 2 years ago

#146 - [opt] add queue size option

Pull Request - State: closed - Opened by ver217 about 2 years ago

#145 - [opt] add timeout option

Pull Request - State: closed - Opened by ver217 about 2 years ago

#144 - update readme

Pull Request - State: closed - Opened by dujiangsu about 2 years ago

#143 - [docker] rm source code after pip install

Pull Request - State: closed - Opened by feifeibear about 2 years ago

#142 - [opt] refactor server

Pull Request - State: closed - Opened by ver217 about 2 years ago

#141 - processing 66b ckpt

Pull Request - State: closed - Opened by dujiangsu about 2 years ago

#140 - [opt] allow disabling multi procs loading

Pull Request - State: closed - Opened by ver217 about 2 years ago

#139 - [opt] fit opt-175b

Pull Request - State: closed - Opened by ver217 about 2 years ago

#138 - num_beams for beam search

Issue - State: open - Opened by shammmmmless about 2 years ago - 1 comment

#137 - 66B model load checkpoint

Pull Request - State: closed - Opened by dujiangsu about 2 years ago

#136 - fit the opt_66B

Pull Request - State: closed - Opened by dujiangsu about 2 years ago

#135 - [opt] add cache and modify api

Pull Request - State: closed - Opened by ver217 about 2 years ago

#134 - improve the cache implementation

Pull Request - State: closed - Opened by dujiangsu over 2 years ago

#133 - [opt] executor update making batch policy

Pull Request - State: closed - Opened by ver217 over 2 years ago

#132 - [opt] add data validator and cors middleware

Pull Request - State: closed - Opened by ver217 over 2 years ago

#131 - add a flag for disable cache

Pull Request - State: closed - Opened by dujiangsu over 2 years ago

#129 - [hotfix] fix worker server shutdown

Pull Request - State: closed - Opened by ver217 over 2 years ago

#128 - [opt] remove useless api

Pull Request - State: closed - Opened by ver217 over 2 years ago

#127 - [opt] add 175b model

Pull Request - State: closed - Opened by ver217 over 2 years ago

#126 - [opt] add left padding

Pull Request - State: closed - Opened by ver217 over 2 years ago