Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / mistralai/mistral-inference issues and pull requests

#231 - [Relesae 1.5]

Pull Request - State: closed - Opened by patrickvonplaten 26 days ago

#230 - Add per-layer sliding window

Pull Request - State: closed - Opened by patrickvonplaten 26 days ago

#228 - [BUG: pip install mistral_inference: ModuleNotFoundError: No module named 'torch'

Issue - State: open - Opened by chrisstankevitz about 1 month ago - 3 comments
Labels: bug

#226 - Update transformer.py

Pull Request - State: open - Opened by siwer about 1 month ago

#225 - [BUG: RuntimeError: Boolean value of Tensor with more than one value is ambiguous]

Issue - State: open - Opened by siwer about 2 months ago
Labels: bug

#224 - [BUG: Cannot build on Mac M1 Silicion

Issue - State: open - Opened by timspannzilliz about 2 months ago
Labels: bug

#223 - Update README.md

Pull Request - State: closed - Opened by devendrachaplot about 2 months ago

#222 - [BUG: AttributeError: module 'torch.library' has no attribute 'custom_op'

Issue - State: open - Opened by mruhlmannGit about 2 months ago
Labels: bug

#219 - Pixtral 12B

Pull Request - State: closed - Opened by devendrachaplot about 2 months ago - 1 comment

#218 - [fix] Correctly pass mask in TransformerBlock.forward in transformer_layers.py

Pull Request - State: open - Opened by MarcSzafraniec about 2 months ago - 1 comment

#217 - Pixtral

Pull Request - State: closed - Opened by patrickvonplaten about 2 months ago

#216 - Fix device error when using cuda device other than cuda:0

Pull Request - State: open - Opened by cornzz 2 months ago

#215 - [BUG] Device error when running on other cuda device than cuda:0

Issue - State: open - Opened by cornzz 2 months ago - 1 comment
Labels: bug

#214 - Fix generation not concluding when eos was hit for each prompt

Pull Request - State: closed - Opened by cornzz 3 months ago - 1 comment

#212 - [Feat] Add streaming support to Codestral Mamba

Issue - State: open - Opened by xNul 3 months ago
Labels: bug

#211 - Update README.md

Pull Request - State: open - Opened by patrickvonplaten 3 months ago

#210 - [BUG: rate limit exceeded on basic examples

Issue - State: open - Opened by AlbertoMQ 3 months ago
Labels: bug

#209 - add Makefile

Pull Request - State: open - Opened by bionicles 3 months ago

#208 - Fix wrong link

Pull Request - State: closed - Opened by arch-btw 3 months ago - 1 comment

#207 - [BUG: config.json in mamba-codestral-7B-v0.1 is error

Issue - State: closed - Opened by Fly-Pluche 3 months ago - 2 comments
Labels: bug

#204 - README newline

Pull Request - State: closed - Opened by timlacroix 4 months ago

#203 - Mistral Large 2 release

Pull Request - State: closed - Opened by timlacroix 4 months ago

#202 - [BUG: ModuleNotFoundError: No module named 'mistral_inference.transformer' ​

Issue - State: open - Opened by yafangwang9 4 months ago - 6 comments
Labels: bug

#201 - Update README.md

Pull Request - State: open - Opened by RahulMR42 4 months ago

#200 - [BUG: ModuleNotFoundError: No module named 'triton']

Issue - State: closed - Opened by MaxAkbar 4 months ago - 3 comments
Labels: bug

#199 - Improve mistral inference

Pull Request - State: closed - Opened by patrickvonplaten 4 months ago

#198 - Update README.md

Pull Request - State: closed - Opened by bhargavyagnik 4 months ago

#197 - [BUG] Transformer.from_folder() does not load the model on multiple GPU

Issue - State: open - Opened by Cerrix 4 months ago - 4 comments
Labels: bug

#195 - Update README.md

Pull Request - State: closed - Opened by patrickvonplaten 4 months ago

#194 - Update README

Pull Request - State: closed - Opened by patrickvonplaten 4 months ago

#193 - Tekken

Pull Request - State: closed - Opened by patrickvonplaten 4 months ago

#191 - Update hardcoded Mamba filenames

Pull Request - State: closed - Opened by Wauplin 4 months ago - 1 comment

#190 - Update README.md

Pull Request - State: closed - Opened by Simontwice 4 months ago

#189 - Update README.md

Pull Request - State: closed - Opened by patrickvonplaten 4 months ago

#188 - Add Mamba and Mathstral to README

Pull Request - State: closed - Opened by patrickvonplaten 4 months ago

#187 - Add mamba

Pull Request - State: closed - Opened by patrickvonplaten 4 months ago

#185 - bombastictranz/mistral-inference

Pull Request - State: closed - Opened by bombastictranz 5 months ago

#184 - Update README.md

Pull Request - State: closed - Opened by Simontwice 5 months ago

#183 - typo in ModelArgs class docstring.

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#182 - [BUG: Mistral 7B Instruct Models from Huggingface limited to 4096tokens?

Issue - State: open - Opened by MaxS3552284 5 months ago - 1 comment
Labels: bug

#181 - Correct grammatical error in markdown cells

Pull Request - State: open - Opened by CharlesCNorton 5 months ago

#180 - Suggested improvement of eos logic in generate.py

Issue - State: closed - Opened by vvatter 5 months ago - 2 comments

#179 - fix: typo in HF_TOKEN environment variable check message

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#178 - Adding Issue/Bug template.

Pull Request - State: closed - Opened by pandora-s-git 5 months ago - 1 comment

#177 - fix: typo in ModelArgs dataclass definition

Pull Request - State: open - Opened by CharlesCNorton 5 months ago

#176 - fix: typo in .gitignore file

Pull Request - State: open - Opened by CharlesCNorton 5 months ago

#175 - fixing type in README.md

Pull Request - State: closed - Opened by didier-durand 5 months ago - 2 comments

#174 - Fix: typo in ModelArgs: "infered" to "inferred"

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#173 - fix: typo in LoRALoaderMixin: correct "multipe" to "multiple"

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#172 - Fix: typo in error message for state_dict validation

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#171 - fix: Correct misspelling in ModelArgs docstring

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#170 - Fix: grammar in installation instructions

Pull Request - State: open - Opened by CharlesCNorton 5 months ago

#169 - speed up inference?

Issue - State: open - Opened by xxyp 5 months ago

#168 - Update README.md

Pull Request - State: closed - Opened by patrickvonplaten 5 months ago

#167 - fix: Correct typo in classifier.ipynb from "alborithm" to "algorithm"

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#165 - Update README.md

Pull Request - State: closed - Opened by patrickvonplaten 6 months ago

#164 - Add codestral

Pull Request - State: closed - Opened by patrickvonplaten 6 months ago

#163 - Using base model on GPU with no bfloat16

Issue - State: open - Opened by yichen0104 6 months ago - 1 comment

#162 - Tokenizer skips the special tokens while decoding

Issue - State: open - Opened by anandsarth 6 months ago - 2 comments

#161 - bombastictranz/mistral-inference

Pull Request - State: closed - Opened by bombastictranz 6 months ago

#160 - mistral-demo $M7B_DIR issue

Issue - State: open - Opened by chaima-bd 6 months ago - 1 comment

#159 - Add LoRA

Pull Request - State: closed - Opened by patrickvonplaten 6 months ago

#158 - add a note about GPU requirement

Pull Request - State: closed - Opened by sophiamyang 6 months ago

#157 - os X pip install fail

Issue - State: closed - Opened by edmondja 6 months ago - 1 comment

#156 - License

Issue - State: open - Opened by fakerybakery 6 months ago - 2 comments

#155 - fixe for issue https://github.com/mistralai/mistral-inference/issues…

Pull Request - State: closed - Opened by sachinsshetty 6 months ago - 1 comment

#154 - !mistral-demo $7B_DIR issue

Issue - State: open - Opened by shaimaa0000 6 months ago - 3 comments

#153 - example cleanup

Pull Request - State: closed - Opened by sophiamyang 6 months ago

#152 - Change to mistral-inference

Pull Request - State: closed - Opened by patrickvonplaten 6 months ago

#151 - num of training tokens?

Issue - State: open - Opened by wgwang 6 months ago

#150 - PAD token missing ?

Issue - State: closed - Opened by omkar-12bits 6 months ago - 2 comments

#148 - Did Mistral-7B-Instruct-v0.2 use Sliding Window Attention (SWA)?

Issue - State: open - Opened by matrixssy 7 months ago - 2 comments

#147 - Q: Why rotary embedding applied only to queries and keys?

Issue - State: open - Opened by pmgautam 7 months ago - 1 comment

#146 - JSON response format failing to retrieve clean JSON

Issue - State: open - Opened by serferdinand2 7 months ago - 3 comments

#145 - How to use a prompt for text analysis?

Issue - State: open - Opened by rsoika 7 months ago - 6 comments

#143 - Not completing answer

Issue - State: open - Opened by KEYURBODAR 7 months ago

#142 - I am unable to build the vLLM Container

Issue - State: open - Opened by AMGI-Pipeline 8 months ago - 4 comments

#141 - Fine Tuning Mistral 7b

Issue - State: open - Opened by nourolive 8 months ago - 3 comments

#140 - Missing the params.json

Issue - State: open - Opened by littlewwwhite 8 months ago - 3 comments

#139 - Question about Mixtral MLP section

Issue - State: closed - Opened by lhallee 8 months ago - 4 comments

#138 - Training code

Issue - State: open - Opened by sartimo 8 months ago - 1 comment

#137 - Fix sliding window mask size in one_file_ref.py

Pull Request - State: open - Opened by MrYxJ 8 months ago - 1 comment

#136 - CUDA EXTENSION NOT INSTALLED nvcr.io/nvidia/pytorch:22.12-py3

Issue - State: closed - Opened by skr3178 8 months ago - 1 comment

#134 - Mistral's tokenizer is not optimized

Issue - State: open - Opened by Yarflam 8 months ago

#133 - Evaluation Pipeline

Issue - State: open - Opened by nikhil0360 8 months ago

#132 - Friendly Reminder while Generating the output

Issue - State: open - Opened by BadrinathMJ 8 months ago