Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / microsoft/DeepSpeed-MII issues and pull requests
#221 - Srsaggam/conversational hf
Pull Request -
State: closed - Opened by srsaggam about 1 year ago
#220 - Lazy loading
Pull Request -
State: open - Opened by TosinSeg about 1 year ago
#219 - Lazy loading
Pull Request -
State: closed - Opened by TosinSeg about 1 year ago
#218 - Refactor Configs
Pull Request -
State: closed - Opened by mrwyattii about 1 year ago
#217 - Fix error of creating session
Pull Request -
State: closed - Opened by tohtana about 1 year ago
#216 - Hostfile not found
Issue -
State: closed - Opened by mrwyattii about 1 year ago
Labels: bug
#215 - Chat Session (multi-turn) example is not work.
Issue -
State: closed - Opened by jason9693 about 1 year ago
- 1 comment
#214 - hack: add llama2 models
Pull Request -
State: closed - Opened by stillmatic about 1 year ago
- 3 comments
#213 - Add Pydantic v2 support
Pull Request -
State: closed - Opened by mrwyattii about 1 year ago
- 2 comments
#212 - Feature Request: support THUDM/ChatGLM2-6B
Issue -
State: open - Opened by jinchihe about 1 year ago
#211 - Update AML Deployment
Pull Request -
State: closed - Opened by mrwyattii about 1 year ago
#210 - NON_PERSISTENT deployment type giving AttributeError
Issue -
State: closed - Opened by anandsriraman about 1 year ago
- 2 comments
#209 - Improve unit tests
Pull Request -
State: closed - Opened by mrwyattii over 1 year ago
#208 - Multi model deployment
Pull Request -
State: open - Opened by TosinSeg over 1 year ago
#207 - load_models() missing 1 required positional argument: 'provider'
Issue -
State: closed - Opened by adutwumk over 1 year ago
- 4 comments
#206 - add llama and update readme counts
Pull Request -
State: closed - Opened by jeffra over 1 year ago
#205 - Always enable load balancing
Pull Request -
State: closed - Opened by TosinSeg over 1 year ago
#204 - Benchmarking MII performance
Issue -
State: open - Opened by Mutinifni over 1 year ago
- 3 comments
#203 - Adding trust_remote_code support
Pull Request -
State: closed - Opened by msinha251 over 1 year ago
- 5 comments
#202 - Refactored all grpc methods in method_table
Pull Request -
State: closed - Opened by TosinSeg over 1 year ago
- 1 comment
#201 - OPT, GPT-neo accuracy drops
Issue -
State: open - Opened by yuchen2580 over 1 year ago
#200 - Refactor task methods
Pull Request -
State: closed - Opened by mrwyattii over 1 year ago
- 1 comment
#199 - Generalize meta tensor pipeline
Pull Request -
State: closed - Opened by mrwyattii over 1 year ago
#198 - Return code -9 for OPT with 8x40GB A100 GPUs
Issue -
State: open - Opened by Mutinifni over 1 year ago
- 15 comments
#197 - Add Non-persistent deployment type
Pull Request -
State: closed - Opened by TosinSeg over 1 year ago
- 1 comment
#196 - Update CI
Pull Request -
State: closed - Opened by mrwyattii over 1 year ago
#195 - feature request : supporting for GPTBigCode model
Issue -
State: open - Opened by Xingxiangrui over 1 year ago
- 1 comment
Labels: enhancement
#194 - [Bug] Garbage output from StableLM and Pythia
Issue -
State: open - Opened by tienthanhdhcn over 1 year ago
- 2 comments
#193 - Fix deployment name in AML examples
Pull Request -
State: closed - Opened by novaturient95 over 1 year ago
#192 - Fix hostfile generation for replicas
Pull Request -
State: closed - Opened by tohtana over 1 year ago
#191 - Feature Request: Add support for Mosaic MPT models
Issue -
State: open - Opened by jenkspt over 1 year ago
Labels: enhancement
#190 - Fix kwargs passing for `conversational` tasks
Pull Request -
State: closed - Opened by sakoush over 1 year ago
- 3 comments
#189 - High Memory Usage for MII compared to HF
Issue -
State: closed - Opened by satpalsr over 1 year ago
- 1 comment
#188 - Run mii-sd.py failed
Issue -
State: closed - Opened by 15925473068 over 1 year ago
- 4 comments
#187 - Eleuther AI provider (Neox Support)
Issue -
State: open - Opened by satpalsr over 1 year ago
- 5 comments
Labels: bug
#186 - HF API calls
Issue -
State: closed - Opened by satpalsr over 1 year ago
- 1 comment
Labels: enhancement
#185 - Query DeepSpeed MII with GRPC ERROR WHEN USE MULTI GPU CARDS
Issue -
State: open - Opened by zhaotyer over 1 year ago
- 1 comment
#184 - Add "deploy.py" file for deployment in AzureML into documentation
Issue -
State: open - Opened by natasha-savic-msft over 1 year ago
- 1 comment
#183 - Dynamic batch support
Issue -
State: open - Opened by chuckhope over 1 year ago
- 1 comment
#182 - Weird images for stable diffusion 2.1
Issue -
State: open - Opened by DhruvThu over 1 year ago
Labels: bug
#181 - Unable to deploy Dolly-v2 models
Issue -
State: open - Opened by msinha251 over 1 year ago
- 3 comments
Labels: enhancement
#180 - Unable to deploy model with loadbalancer enabled.
Issue -
State: closed - Opened by msinha251 over 1 year ago
- 2 comments
Labels: bug
#179 - run more then 4 tensor_parallel error
Issue -
State: closed - Opened by ychy00001 over 1 year ago
- 1 comment
#178 - Extra fields are not permitted:
Issue -
State: closed - Opened by msinha251 over 1 year ago
- 1 comment
#177 - Add session to enable multi-turn conversation
Pull Request -
State: closed - Opened by tohtana over 1 year ago
#176 - Add lock to serialize pipeline execution
Pull Request -
State: closed - Opened by tohtana over 1 year ago
#175 - Fix condition to terminate RESTful API gateway
Pull Request -
State: closed - Opened by tohtana over 1 year ago
#174 - [Feature Request] Support for token streaming
Issue -
State: open - Opened by bharatv007 over 1 year ago
- 4 comments
Labels: enhancement
#173 - Why I can't see the other models?
Issue -
State: closed - Opened by tienthanhdhcn over 1 year ago
- 1 comment
#172 - Fix for Stable Diffusion deployments
Pull Request -
State: open - Opened by mrwyattii over 1 year ago
#171 - How to get list of all deployed models ?
Issue -
State: open - Opened by msinha251 over 1 year ago
- 2 comments
Labels: enhancement
#170 - Unable to run benchmark
Issue -
State: closed - Opened by CrossNox over 1 year ago
- 5 comments
#169 - Unable to query running model on deepspeed-mii.
Issue -
State: closed - Opened by msinha251 over 1 year ago
- 1 comment
#168 - Error Deploying with MII-Azure in AzureML
Issue -
State: open - Opened by IamVarma over 1 year ago
- 2 comments
#167 - Docker in VertexAI
Issue -
State: open - Opened by TahaBinhuraib over 1 year ago
- 2 comments
#166 - Raise "f'No hosts found in {hostfile_path}'' when deploy local without RESTful or load_balancing
Issue -
State: closed - Opened by Wohoholo over 1 year ago
#165 - Add Apache 2.0 License
Pull Request -
State: closed - Opened by mrwyattii over 1 year ago
#164 - How to deploy a RESTful API deepspeed MII on one node?
Issue -
State: open - Opened by shaoxuefeng over 1 year ago
- 2 comments
#163 - Serving in Azure
Issue -
State: open - Opened by TahaBinhuraib over 1 year ago
#162 - Can't run from inside Docker
Issue -
State: open - Opened by TahaBinhuraib over 1 year ago
- 1 comment
#160 - Fix checkpoint str type expected (type=type_error.str) (#150)
Pull Request -
State: closed - Opened by alvin-c-shih over 1 year ago
- 3 comments
#159 - stable diffusion fails looking for `SAFE_WEIGHTS_NAME`
Issue -
State: open - Opened by lizelive over 1 year ago
- 1 comment
#158 - Non-blocking client API
Pull Request -
State: open - Opened by tohtana over 1 year ago
- 4 comments
#157 - Load 2 different models in 1 gpu
Issue -
State: closed - Opened by TahaBinhuraib over 1 year ago
- 2 comments
#156 - Pydantic Validation Failed When Running examples/local/text-generation-bloom-example.py
Issue -
State: closed - Opened by knwng over 1 year ago
- 6 comments
#155 - Int8 deployment does not work for GPTJ
Issue -
State: open - Opened by mallorbc over 1 year ago
- 9 comments
#154 - RESTful API support
Pull Request -
State: closed - Opened by tohtana over 1 year ago
#153 - About serving DeepSpeed-MII on Azure ML endpoint
Issue -
State: open - Opened by bingjie3216 over 1 year ago
#152 - non blocking query
Pull Request -
State: closed - Opened by lcw99 over 1 year ago
- 3 comments
#151 - About Serving OPT66B using mii
Issue -
State: closed - Opened by itsogkyc over 1 year ago
- 2 comments
#150 - checkpoint str type expected (type=type_error.str)
Issue -
State: closed - Opened by vamsikrishnav over 1 year ago
- 2 comments
#149 - serving OPT 175B
Issue -
State: open - Opened by Emerald01 over 1 year ago
- 3 comments
Labels: enhancement
#148 - Fix for CPU device error
Pull Request -
State: closed - Opened by mrwyattii over 1 year ago
#147 - Load balancing and multiple replicas
Pull Request -
State: closed - Opened by tohtana over 1 year ago
#146 - Image Save - Error
Issue -
State: closed - Opened by Ahmer-444 over 1 year ago
- 1 comment
#145 - num_return_sequences is getting ignored
Issue -
State: open - Opened by Mahyar-Ali over 1 year ago
- 1 comment
#144 - MII does not use DeepSpeed config when running DeepSpeed-Inference
Issue -
State: open - Opened by rex-asabor over 1 year ago
- 1 comment
#143 - Add AML local deployment type
Pull Request -
State: closed - Opened by mrwyattii over 1 year ago
- 1 comment
#142 - Separate server and client
Pull Request -
State: closed - Opened by tohtana over 1 year ago
#141 - Unable to execute mii-sd.py in benchmark
Issue -
State: closed - Opened by Yanxing-Shi over 1 year ago
- 2 comments
#140 - don't work with stable diffusion 2.1
Issue -
State: open - Opened by 0xDing over 1 year ago
- 1 comment
#139 - Is there any plan to support dynamic batching or dynamic batching with different args ?
Issue -
State: open - Opened by dumpmemory over 1 year ago
#138 - Decouple conversions for gRPC from server/client code
Pull Request -
State: closed - Opened by tohtana over 1 year ago
- 1 comment
#137 - How to deal with imbalanced GPU memories?
Issue -
State: open - Opened by rookielxy over 1 year ago
#136 - Allow `model_path` only to deploy "local" models
Issue -
State: open - Opened by philschmid over 1 year ago
- 3 comments
#135 - `AssertionError` when running examples from readme
Issue -
State: closed - Opened by HeyangQin over 1 year ago
- 3 comments
#134 - txt2img-example.py failed with unexpected keyword argument 'encoder_hidden_states'
Issue -
State: closed - Opened by chenwaynepaul over 1 year ago
- 4 comments
#133 - How to do the batch inference
Issue -
State: open - Opened by Emerald01 over 1 year ago
- 7 comments
Labels: enhancement
#132 - MII Text to Image Task Issue
Issue -
State: open - Opened by gvijqb over 1 year ago
- 3 comments
#131 - Question about a custom MII task
Issue -
State: open - Opened by pablogranolabar almost 2 years ago
- 3 comments
#130 - Query DeepSpeed MII with FastAPI and GRPC crashing
Issue -
State: closed - Opened by mallorbc almost 2 years ago
- 7 comments
#129 - Add max_tokens option to mii_config
Pull Request -
State: closed - Opened by mallorbc almost 2 years ago
- 11 comments
#128 - Add release tag 0.05
Issue -
State: closed - Opened by mallorbc almost 2 years ago
- 1 comment
#127 - Some generate parameters do not work for query
Issue -
State: open - Opened by mallorbc almost 2 years ago
- 3 comments
#126 - Add distilbert support
Pull Request -
State: closed - Opened by jeffra almost 2 years ago
#125 - Change number of max_tokens from 1024
Issue -
State: open - Opened by mallorbc almost 2 years ago
- 1 comment
#124 - Support text2text-generation pipelines and T5 models in particular
Pull Request -
State: open - Opened by philhchen almost 2 years ago
- 3 comments
#123 - RuntimeError: server crashed for some reason, unable to proceed
Issue -
State: closed - Opened by underlines almost 2 years ago
- 4 comments
#122 - Tests use transformers cache for model storage
Pull Request -
State: closed - Opened by mrwyattii almost 2 years ago
#121 - Free torch cache after loading model
Pull Request -
State: closed - Opened by mrwyattii almost 2 years ago