mistralai/mistral-finetune issues and pull requests

#101 - mistral small support

Issue - State: open - Opened by win4r about 2 months ago
Labels: bug

#100 - Update tokenize.py for common >= 1.4.0

Pull Request - State: closed - Opened by patrickvonplaten 2 months ago

#99 - [BUG: ValueError: setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (32768,) + inhomogeneous part.

Issue - State: closed - Opened by nvnk3 2 months ago - 1 comment
Labels: bug

#98 - [BUG: validate_data.py ModuleNotFoundError (finetune & tensorflow)

Issue - State: open - Opened by CorentinWicht 2 months ago - 10 comments
Labels: bug

#97 - Update README.md for mistral_models path

Pull Request - State: open - Opened by bsahane 2 months ago

#96 - Crash fix due to inconsistent use of tabs and spaces

Pull Request - State: open - Opened by Hackerbone 3 months ago - 2 comments

#95 - [BUG: utils.validate_data has inconsistent use of tabs and spaces in indentation which leads to crashing]

Issue - State: open - Opened by Hackerbone 3 months ago
Labels: bug

#94 - qlora finetuning script added

Pull Request - State: open - Opened by shirinyamani 3 months ago - 1 comment

#93 - [BUG] Error with vllm

Issue - State: open - Opened by C3po-D2rd2 3 months ago
Labels: bug

#92 - [BUG: Instruction FT (train.py) crashes on AWS g4dn.12xlarge (4 T4s) without precise indication of reasons]

Issue - State: open - Opened by leloss 3 months ago - 1 comment
Labels: bug

#91 - Fix a mis-aligned else that causes a crash

Pull Request - State: closed - Opened by mkserge 3 months ago - 2 comments

#90 - Updated WPS and params_config for large and nemo

Pull Request - State: closed - Opened by AviSoori1x 3 months ago

#89 - [BUG: after training the model, i am not able to merge the model and run inference on it

Issue - State: open - Opened by kiranshivaraju 3 months ago
Labels: bug

#88 - [NOT A BUG] : Is it possible to run the current validation/training scripts on a ray cluster?

Issue - State: open - Opened by SaiKrishnaBala 3 months ago
Labels: bug

#87 - [Not a bug] Support for fine-tuning codestral-mamba?

Issue - State: open - Opened by ciscodoojung 3 months ago - 2 comments
Labels: bug

#86 - Update config.yml and Fixing Discord Url

Pull Request - State: closed - Opened by Autumnlight02 4 months ago

#85 - [BUG: Error during training

Issue - State: open - Opened by Chasapas 4 months ago - 1 comment
Labels: bug

#84 - [BUG]: utils.validate_data is not compatible with Mistral-Nemo-12B

Issue - State: open - Opened by ShadyPi 4 months ago
Labels: bug

#83 - updated changes of mistral_inference in transformer class

Pull Request - State: closed - Opened by bhargavyagnik 4 months ago

#82 - I have finetuned mistral-instruct-v0.3 but fine tuned model got worse. It doesn not even answer what original v0.3 can answer.

Issue - State: open - Opened by ZTAP0011 4 months ago - 4 comments
Labels: bug

#81 - Mistral-Nemo

Pull Request - State: closed - Opened by patrickvonplaten 4 months ago

#80 - Validation script fix: conversation error

Pull Request - State: open - Opened by stefkarmakov 4 months ago - 2 comments

#79 - `[email protected]` is not supported due to requires device with capability > (8, 0) but your GPU has capability (6, 1) (too old)

Issue - State: open - Opened by kamlesh0606 4 months ago - 1 comment
Labels: bug

#78 - feature/improve-type-annotations-and-error-handling

Pull Request - State: open - Opened by sanowl 4 months ago

#77 - [BUG]: The _parse_available_tools method does not return all the defined tools.

Issue - State: closed - Opened by matheus-prandini 4 months ago - 1 comment
Labels: bug

#76 - Fix/parse-available-tools

Pull Request - State: closed - Opened by matheus-prandini 4 months ago - 1 comment

#75 - Mistral-Finetune creates consolidated.safetensors for mixtral 8x7b instruct v0.1 but mistral-chat fails inference for it complains about LoRA weights file being loaded missing an expected key for one of the model layers.

Issue - State: open - Opened by tensimixt 4 months ago - 5 comments
Labels: bug

#74 - How can I merge the LoRA weights into the base model?

Issue - State: open - Opened by pantDevesh 5 months ago - 7 comments

#73 - typo in comment: "mult-turn" to "multi-turn"

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#72 - typo: correct "MoEs models" to "MoE models"

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#71 - Fail to finetune with several GPU

Issue - State: open - Opened by banalg 5 months ago - 3 comments

#70 - fix a typo in the tutorials

Pull Request - State: open - Opened by JasonGitHub 5 months ago

#69 - CUDA out of memory during training

Issue - State: open - Opened by CodeWithOz 5 months ago - 6 comments

#68 - Finetune 22B codestra model

Issue - State: open - Opened by salaki 5 months ago

#67 - fix: correct spelling in comments

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#66 - data validation issue

Issue - State: closed - Opened by noviljohnson 5 months ago - 1 comment

#65 - download model from HF

Pull Request - State: closed - Opened by sophiamyang 5 months ago

#64 - How to convert model to GGUF after fine-tuned?

Issue - State: open - Opened by bensonbs 5 months ago - 3 comments

#63 - fix: typos in docstring and logging message

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#62 - fix: Correct grammar in README.md

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#61 - fix: typo in reformat_jsonl function output message

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#60 - fix: typo in get_fsdp_policy docstring

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#60 - fix: typo in get_fsdp_policy docstring

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#59 - fix: typo in TrainArgs warning message

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#58 - fix: typo in function parameters error message

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#57 - Fix: typo in exception messages: "formated" to "formatted"

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#56 - fix: typo in comment: "shorder" to "shorter"

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#55 - fix: typos in InstructArgs comments

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#54 - Adds Issue/Bug template.

Pull Request - State: closed - Opened by pandora-s-git 5 months ago

#53 - fix: typos in multiple functions

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#52 - fix: grammar and typo in logging message

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#51 - fix: typo "erros" to "errors" in logging message

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#50 - fix: grammar "You are have" to "You have" in logging message

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#49 - fix: correct article usage for GPU recommendation

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#48 - fix: typo in mixed precision test comments

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#47 - fix: correct subject-verb agreement in formatting instructions

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#46 - fix: correct spelling of "length" in comments

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#45 - fix: remove repeated word in notebook metadata

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#44 - fix: typo in error message for JSONL line count verification

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#43 - fix: verb tense in print statement

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#42 - Fixing a typo in README.md

Pull Request - State: closed - Opened by didier-durand 5 months ago - 2 comments

#41 - fix: Typo in Size Limitation Comment

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#40 - fix: Correct typo in comment

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#39 - fix: typo in JSON validation script

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#38 - fix: grammatical errors in LoRALinear class docstring

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago

#37 - Fix typo: "formated" -> "formatted"

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#36 - fix: correct typo + capitalization in title

Pull Request - State: closed - Opened by CharlesCNorton 5 months ago - 1 comment

#35 - Demos

Issue - State: open - Opened by shgidi 5 months ago

#34 - Fix typo: Correct "has" to "have" in validation section

Pull Request - State: closed - Opened by CharlesCNorton 6 months ago

#33 - How to do early stopping

Issue - State: open - Opened by sujoyrc 6 months ago

#32 - Tensorboard integration

Issue - State: open - Opened by SaiKrishnaBala 6 months ago

#31 - Fix typo in comment: "seting" to "setting"

Pull Request - State: closed - Opened by CharlesCNorton 6 months ago

#30 - fix: Correct typos and formatting

Pull Request - State: closed - Opened by CharlesCNorton 6 months ago - 4 comments

#29 - Fixed typo in TrainArgs class comment

Pull Request - State: closed - Opened by CharlesCNorton 6 months ago

#28 - Add model format flexibility of AutoModel.from_pretrained()

Issue - State: open - Opened by DavidFarago 6 months ago - 1 comment

#27 - Use huggingface model ID instead of local path to model

Issue - State: open - Opened by DavidFarago 6 months ago

#26 - Rename system_prompt to system in docu

Pull Request - State: closed - Opened by DavidFarago 6 months ago

#25 - google colab error

Issue - State: open - Opened by silvacarl2 6 months ago - 1 comment

#24 - Cannot use wandb logging

Issue - State: open - Opened by jagilley 6 months ago - 3 comments

#23 - Getting an error when attempting to finetune Mixtral

Issue - State: open - Opened by jagilley 6 months ago - 2 comments

#22 - Update extend_model_vocab.py

Pull Request - State: closed - Opened by eltociear 6 months ago

#21 - Although it's not very useful now, thank you for opening up

Issue - State: closed - Opened by Trangle 6 months ago

#20 - Add explicit Weights and Biases support

Pull Request - State: closed - Opened by Clemspace 6 months ago - 1 comment

#19 - Remove symlinks

Pull Request - State: closed - Opened by patrickvonplaten 6 months ago

#18 - Avoid symlink `tests/fixtures`

Issue - State: closed - Opened by DavidFarago 6 months ago - 1 comment

#17 - `ValueError: min() arg is an empty sequence` in `utils.validate_data` script

Issue - State: closed - Opened by aymenkrifa 6 months ago - 1 comment

#16 - Fix py39

Pull Request - State: closed - Opened by patrickvonplaten 6 months ago

#15 - Update README.md

Pull Request - State: closed - Opened by CharlesCNorton 6 months ago

#14 - mistal-chat cuda out of memory error

Issue - State: open - Opened by yuvalshachaf 6 months ago - 7 comments

#13 - Update README.md

Pull Request - State: closed - Opened by CharlesCNorton 6 months ago

#12 - How to use utils.extend_model_vocab?

Issue - State: open - Opened by CrispStrobe 6 months ago - 3 comments

#11 - mixtral 8x7b and 8x22b please

Issue - State: closed - Opened by ehartford 6 months ago - 5 comments

#10 - Sort model table better and small reminder of upcoming 8x7B update

Pull Request - State: open - Opened by CyberTimon 6 months ago

#9 - Error python version 3.9

Issue - State: closed - Opened by thomaspernet 6 months ago

#8 - Fix broken link

Pull Request - State: closed - Opened by slava-vishnyakov 6 months ago

#7 - README.md: fix typo

Pull Request - State: closed - Opened by tariq9mehmood9 6 months ago

#6 - Video tutorial?

Issue - State: open - Opened by gileneusz 6 months ago - 1 comment

#5 - Update README.md

Pull Request - State: closed - Opened by SebastianBodza 6 months ago

#4 - Fix typos and grammatical errors in the documentation

Pull Request - State: closed - Opened by aakashapoorv 6 months ago - 1 comment

#3 - Update README.md

Pull Request - State: closed - Opened by CharlesCNorton 6 months ago

GitHub / mistralai/mistral-finetune issues and pull requests