Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / microsoft/DeepSpeed-MII issues and pull requests

#221 - Srsaggam/conversational hf

Pull Request - State: closed - Opened by srsaggam about 1 year ago

#220 - Lazy loading

Pull Request - State: open - Opened by TosinSeg about 1 year ago

#219 - Lazy loading

Pull Request - State: closed - Opened by TosinSeg about 1 year ago

#218 - Refactor Configs

Pull Request - State: closed - Opened by mrwyattii about 1 year ago

#217 - Fix error of creating session

Pull Request - State: closed - Opened by tohtana about 1 year ago

#216 - Hostfile not found

Issue - State: closed - Opened by mrwyattii about 1 year ago
Labels: bug

#215 - Chat Session (multi-turn) example is not work.

Issue - State: closed - Opened by jason9693 about 1 year ago - 1 comment

#214 - hack: add llama2 models

Pull Request - State: closed - Opened by stillmatic about 1 year ago - 3 comments

#213 - Add Pydantic v2 support

Pull Request - State: closed - Opened by mrwyattii about 1 year ago - 2 comments

#212 - Feature Request: support THUDM/ChatGLM2-6B

Issue - State: open - Opened by jinchihe about 1 year ago

#211 - Update AML Deployment

Pull Request - State: closed - Opened by mrwyattii about 1 year ago

#210 - NON_PERSISTENT deployment type giving AttributeError

Issue - State: closed - Opened by anandsriraman about 1 year ago - 2 comments

#209 - Improve unit tests

Pull Request - State: closed - Opened by mrwyattii over 1 year ago

#208 - Multi model deployment

Pull Request - State: open - Opened by TosinSeg over 1 year ago

#207 - load_models() missing 1 required positional argument: 'provider'

Issue - State: closed - Opened by adutwumk over 1 year ago - 4 comments

#206 - add llama and update readme counts

Pull Request - State: closed - Opened by jeffra over 1 year ago

#205 - Always enable load balancing

Pull Request - State: closed - Opened by TosinSeg over 1 year ago

#204 - Benchmarking MII performance

Issue - State: open - Opened by Mutinifni over 1 year ago - 3 comments

#203 - Adding trust_remote_code support

Pull Request - State: closed - Opened by msinha251 over 1 year ago - 5 comments

#202 - Refactored all grpc methods in method_table

Pull Request - State: closed - Opened by TosinSeg over 1 year ago - 1 comment

#201 - OPT, GPT-neo accuracy drops

Issue - State: open - Opened by yuchen2580 over 1 year ago

#200 - Refactor task methods

Pull Request - State: closed - Opened by mrwyattii over 1 year ago - 1 comment

#199 - Generalize meta tensor pipeline

Pull Request - State: closed - Opened by mrwyattii over 1 year ago

#198 - Return code -9 for OPT with 8x40GB A100 GPUs

Issue - State: open - Opened by Mutinifni over 1 year ago - 15 comments

#197 - Add Non-persistent deployment type

Pull Request - State: closed - Opened by TosinSeg over 1 year ago - 1 comment

#196 - Update CI

Pull Request - State: closed - Opened by mrwyattii over 1 year ago

#195 - feature request : supporting for GPTBigCode model

Issue - State: open - Opened by Xingxiangrui over 1 year ago - 1 comment
Labels: enhancement

#194 - [Bug] Garbage output from StableLM and Pythia

Issue - State: open - Opened by tienthanhdhcn over 1 year ago - 2 comments

#193 - Fix deployment name in AML examples

Pull Request - State: closed - Opened by novaturient95 over 1 year ago

#192 - Fix hostfile generation for replicas

Pull Request - State: closed - Opened by tohtana over 1 year ago

#191 - Feature Request: Add support for Mosaic MPT models

Issue - State: open - Opened by jenkspt over 1 year ago
Labels: enhancement

#190 - Fix kwargs passing for `conversational` tasks

Pull Request - State: closed - Opened by sakoush over 1 year ago - 3 comments

#189 - High Memory Usage for MII compared to HF

Issue - State: closed - Opened by satpalsr over 1 year ago - 1 comment

#188 - Run mii-sd.py failed

Issue - State: closed - Opened by 15925473068 over 1 year ago - 4 comments

#187 - Eleuther AI provider (Neox Support)

Issue - State: open - Opened by satpalsr over 1 year ago - 5 comments
Labels: bug

#186 - HF API calls

Issue - State: closed - Opened by satpalsr over 1 year ago - 1 comment
Labels: enhancement

#185 - Query DeepSpeed MII with GRPC ERROR WHEN USE MULTI GPU CARDS

Issue - State: open - Opened by zhaotyer over 1 year ago - 1 comment

#183 - Dynamic batch support

Issue - State: open - Opened by chuckhope over 1 year ago - 1 comment

#182 - Weird images for stable diffusion 2.1

Issue - State: open - Opened by DhruvThu over 1 year ago
Labels: bug

#181 - Unable to deploy Dolly-v2 models

Issue - State: open - Opened by msinha251 over 1 year ago - 3 comments
Labels: enhancement

#180 - Unable to deploy model with loadbalancer enabled.

Issue - State: closed - Opened by msinha251 over 1 year ago - 2 comments
Labels: bug

#179 - run more then 4 tensor_parallel error

Issue - State: closed - Opened by ychy00001 over 1 year ago - 1 comment

#178 - Extra fields are not permitted:

Issue - State: closed - Opened by msinha251 over 1 year ago - 1 comment

#177 - Add session to enable multi-turn conversation

Pull Request - State: closed - Opened by tohtana over 1 year ago

#176 - Add lock to serialize pipeline execution

Pull Request - State: closed - Opened by tohtana over 1 year ago

#175 - Fix condition to terminate RESTful API gateway

Pull Request - State: closed - Opened by tohtana over 1 year ago

#174 - [Feature Request] Support for token streaming

Issue - State: open - Opened by bharatv007 over 1 year ago - 4 comments
Labels: enhancement

#173 - Why I can't see the other models?

Issue - State: closed - Opened by tienthanhdhcn over 1 year ago - 1 comment

#172 - Fix for Stable Diffusion deployments

Pull Request - State: open - Opened by mrwyattii over 1 year ago

#171 - How to get list of all deployed models ?

Issue - State: open - Opened by msinha251 over 1 year ago - 2 comments
Labels: enhancement

#170 - Unable to run benchmark

Issue - State: closed - Opened by CrossNox over 1 year ago - 5 comments

#169 - Unable to query running model on deepspeed-mii.

Issue - State: closed - Opened by msinha251 over 1 year ago - 1 comment

#168 - Error Deploying with MII-Azure in AzureML

Issue - State: open - Opened by IamVarma over 1 year ago - 2 comments

#167 - Docker in VertexAI

Issue - State: open - Opened by TahaBinhuraib over 1 year ago - 2 comments

#165 - Add Apache 2.0 License

Pull Request - State: closed - Opened by mrwyattii over 1 year ago

#164 - How to deploy a RESTful API deepspeed MII on one node?

Issue - State: open - Opened by shaoxuefeng over 1 year ago - 2 comments

#163 - Serving in Azure

Issue - State: open - Opened by TahaBinhuraib over 1 year ago

#162 - Can't run from inside Docker

Issue - State: open - Opened by TahaBinhuraib over 1 year ago - 1 comment

#160 - Fix checkpoint str type expected (type=type_error.str) (#150)

Pull Request - State: closed - Opened by alvin-c-shih over 1 year ago - 3 comments

#159 - stable diffusion fails looking for `SAFE_WEIGHTS_NAME`

Issue - State: open - Opened by lizelive over 1 year ago - 1 comment

#158 - Non-blocking client API

Pull Request - State: open - Opened by tohtana over 1 year ago - 4 comments

#157 - Load 2 different models in 1 gpu

Issue - State: closed - Opened by TahaBinhuraib over 1 year ago - 2 comments

#155 - Int8 deployment does not work for GPTJ

Issue - State: open - Opened by mallorbc over 1 year ago - 9 comments

#154 - RESTful API support

Pull Request - State: closed - Opened by tohtana over 1 year ago

#153 - About serving DeepSpeed-MII on Azure ML endpoint

Issue - State: open - Opened by bingjie3216 over 1 year ago

#152 - non blocking query

Pull Request - State: closed - Opened by lcw99 over 1 year ago - 3 comments

#151 - About Serving OPT66B using mii

Issue - State: closed - Opened by itsogkyc over 1 year ago - 2 comments

#150 - checkpoint str type expected (type=type_error.str)

Issue - State: closed - Opened by vamsikrishnav over 1 year ago - 2 comments

#149 - serving OPT 175B

Issue - State: open - Opened by Emerald01 over 1 year ago - 3 comments
Labels: enhancement

#148 - Fix for CPU device error

Pull Request - State: closed - Opened by mrwyattii over 1 year ago

#147 - Load balancing and multiple replicas

Pull Request - State: closed - Opened by tohtana over 1 year ago

#146 - Image Save - Error

Issue - State: closed - Opened by Ahmer-444 over 1 year ago - 1 comment

#145 - num_return_sequences is getting ignored

Issue - State: open - Opened by Mahyar-Ali over 1 year ago - 1 comment

#144 - MII does not use DeepSpeed config when running DeepSpeed-Inference

Issue - State: open - Opened by rex-asabor over 1 year ago - 1 comment

#143 - Add AML local deployment type

Pull Request - State: closed - Opened by mrwyattii over 1 year ago - 1 comment

#142 - Separate server and client

Pull Request - State: closed - Opened by tohtana over 1 year ago

#141 - Unable to execute mii-sd.py in benchmark

Issue - State: closed - Opened by Yanxing-Shi over 1 year ago - 2 comments

#140 - don't work with stable diffusion 2.1

Issue - State: open - Opened by 0xDing over 1 year ago - 1 comment

#138 - Decouple conversions for gRPC from server/client code

Pull Request - State: closed - Opened by tohtana over 1 year ago - 1 comment

#137 - How to deal with imbalanced GPU memories?

Issue - State: open - Opened by rookielxy over 1 year ago

#136 - Allow `model_path` only to deploy "local" models

Issue - State: open - Opened by philschmid over 1 year ago - 3 comments

#135 - `AssertionError` when running examples from readme

Issue - State: closed - Opened by HeyangQin over 1 year ago - 3 comments

#133 - How to do the batch inference

Issue - State: open - Opened by Emerald01 over 1 year ago - 7 comments
Labels: enhancement

#132 - MII Text to Image Task Issue

Issue - State: open - Opened by gvijqb over 1 year ago - 3 comments

#131 - Question about a custom MII task

Issue - State: open - Opened by pablogranolabar almost 2 years ago - 3 comments

#130 - Query DeepSpeed MII with FastAPI and GRPC crashing

Issue - State: closed - Opened by mallorbc almost 2 years ago - 7 comments

#129 - Add max_tokens option to mii_config

Pull Request - State: closed - Opened by mallorbc almost 2 years ago - 11 comments

#128 - Add release tag 0.05

Issue - State: closed - Opened by mallorbc almost 2 years ago - 1 comment

#127 - Some generate parameters do not work for query

Issue - State: open - Opened by mallorbc almost 2 years ago - 3 comments

#126 - Add distilbert support

Pull Request - State: closed - Opened by jeffra almost 2 years ago

#125 - Change number of max_tokens from 1024

Issue - State: open - Opened by mallorbc almost 2 years ago - 1 comment

#124 - Support text2text-generation pipelines and T5 models in particular

Pull Request - State: open - Opened by philhchen almost 2 years ago - 3 comments

#123 - RuntimeError: server crashed for some reason, unable to proceed

Issue - State: closed - Opened by underlines almost 2 years ago - 4 comments

#122 - Tests use transformers cache for model storage

Pull Request - State: closed - Opened by mrwyattii almost 2 years ago

#121 - Free torch cache after loading model

Pull Request - State: closed - Opened by mrwyattii almost 2 years ago