Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / microsoft/DeepSpeed-MII issues and pull requests

#120 - Is model split in OPT TP mode?

Issue - State: open - Opened by larry-fuy almost 2 years ago - 2 comments

#119 - Support for Albert and Swin/ViT

Issue - State: open - Opened by larry-fuy almost 2 years ago - 1 comment

#118 - Stable Diffusion | Multi-Pipeline Support (i.e. img2img)

Issue - State: open - Opened by ghunkins almost 2 years ago - 1 comment

#117 - Memory issue when loading OPT

Issue - State: closed - Opened by larry-fuy almost 2 years ago - 3 comments

#116 - Unable to run mii-sd.py for txt2img benchmark

Issue - State: closed - Opened by aponte411 almost 2 years ago - 7 comments

#115 - AML deployment error due to missing az cli arguments

Issue - State: open - Opened by aponte411 almost 2 years ago - 5 comments

#114 - Passing `stopping_criteria` to DeepSpeed MII

Issue - State: closed - Opened by tokestermw almost 2 years ago - 2 comments

#113 - Add xlm-roberta

Pull Request - State: closed - Opened by jeffra almost 2 years ago

#112 - 'DSUNet' object has no attribute 'config'

Issue - State: closed - Opened by entangledloops almost 2 years ago - 3 comments

#111 - Is there a way to communicate with the individual models in an MII deployment?

Issue - State: open - Opened by Dango233 almost 2 years ago - 1 comment

#109 - Stop Sequence

Issue - State: open - Opened by volkerha almost 2 years ago - 4 comments

#108 - Use new DS-Inference config API

Pull Request - State: closed - Opened by mrwyattii almost 2 years ago - 1 comment

#107 - Add Bloom model config checks for HF provider

Pull Request - State: closed - Opened by mrwyattii almost 2 years ago

#106 - Support for FLAN-T5

Issue - State: open - Opened by jihan-yin almost 2 years ago - 3 comments

#105 - Improvements to VRAM usage when loading HF models

Pull Request - State: closed - Opened by mrwyattii almost 2 years ago

#104 - Add community tutorial

Pull Request - State: closed - Opened by jeffra almost 2 years ago

#103 - OOM Error when deploying BLOOM-3B on 16GB GPU via MII

Issue - State: closed - Opened by marshmellow77 almost 2 years ago - 6 comments

#102 - No text is shown when using MII in fp32 and greedy search

Issue - State: closed - Opened by marshmellow77 almost 2 years ago - 2 comments

#101 - Error when trying MII with dtype=fp32 with sampling

Issue - State: closed - Opened by marshmellow77 almost 2 years ago - 2 comments

#100 - RuntimeError: This event loop is already running

Issue - State: open - Opened by marshmellow77 almost 2 years ago - 3 comments
Labels: enhancement

#99 - CUDA OOM when loading large models

Issue - State: closed - Opened by Tianwei-She almost 2 years ago - 6 comments

#98 - feat(config): enable port dynamique assignment

Pull Request - State: closed - Opened by jqueguiner almost 2 years ago - 4 comments

#97 - Multi-gpu inference, the query gets stuck when using my own provider

Issue - State: closed - Opened by Aaron-mindverse almost 2 years ago - 3 comments

#96 - enable cuda graph for diffusers models

Pull Request - State: closed - Opened by jeffra almost 2 years ago

#94 - Question : How to query a remote DeepSpeed server?

Issue - State: open - Opened by Thytu almost 2 years ago - 4 comments

#93 - DS-MII License query

Issue - State: closed - Opened by mayank31398 almost 2 years ago - 3 comments

#92 - Samyam sd bench

Pull Request - State: closed - Opened by samyam almost 2 years ago

#91 - Deactivate quantization?

Issue - State: closed - Opened by remi86 almost 2 years ago - 1 comment

#90 - SD tutorial and benchmarks

Pull Request - State: closed - Opened by jeffra almost 2 years ago - 2 comments

#89 - Can DeepSpeed-MII also support models/libraries like YOLO / Detectron2 / FCOS / VitDet?

Issue - State: open - Opened by kartikeyporwal almost 2 years ago - 1 comment
Labels: enhancement

#88 - Fix aio config dict in ZeRO text-gen example

Pull Request - State: closed - Opened by mrwyattii almost 2 years ago

#87 - Errors running Zero-Inference text generation example

Issue - State: closed - Opened by joaopcm1996 almost 2 years ago - 3 comments

#86 - Support for Salesforce/CodeGen

Issue - State: closed - Opened by andrePankraz almost 2 years ago - 2 comments

#85 - Socket timeouts in MII

Issue - State: closed - Opened by mayank31398 almost 2 years ago - 4 comments

#84 - Error in inf/nan tensors

Issue - State: closed - Opened by mayank31398 almost 2 years ago - 3 comments

#83 - feature request : Docker image for deepspeed-mii

Issue - State: open - Opened by Thytu almost 2 years ago - 3 comments

#79 - refactor(example): conversational-query

Pull Request - State: closed - Opened by Thytu almost 2 years ago - 6 comments

#75 - "error: cuda_runtime_api.h: No such file or directory"

Issue - State: closed - Opened by auwsom almost 2 years ago - 15 comments

#73 - update txt2img example to sd 1.5

Pull Request - State: closed - Opened by lalalune almost 2 years ago

#71 - OPT in TP or PP mode

Issue - State: closed - Opened by volkerha almost 2 years ago - 7 comments
Labels: enhancement

#68 - Fix examples with wrong param names

Pull Request - State: closed - Opened by mrwyattii almost 2 years ago

#55 - Enable generation of scripts and configs for AML deployments

Pull Request - State: closed - Opened by mrwyattii about 2 years ago

#49 - FileNotFoundError: [Errno 2] No such file or directory: 'deepspeed'

Issue - State: closed - Opened by C00reNUT about 2 years ago - 3 comments

#47 - Support multiple nodes deployment?

Issue - State: open - Opened by pohunghuang-nctu about 2 years ago - 3 comments
Labels: enhancement

#35 - Add support for HuggingFace GPT-NeoX implementation

Pull Request - State: closed - Opened by mrwyattii over 2 years ago

#31 - Add unit tests for local deployment

Pull Request - State: closed - Opened by mrwyattii over 2 years ago

#23 - Enable zero inference as a separte code path from ds_optimize

Pull Request - State: closed - Opened by cli99 over 2 years ago

#16 - Add huggingface models and tasks that use gpt2 and robert model type

Pull Request - State: closed - Opened by cli99 over 2 years ago - 7 comments

#15 - Samyamr/aks examples

Pull Request - State: closed - Opened by samyam over 2 years ago

#12 - Samyamr/add features

Pull Request - State: closed - Opened by samyam over 2 years ago

#11 - Samyamr/model registration

Pull Request - State: closed - Opened by samyam over 2 years ago