InternLM/InternLM-XComposer issues and pull requests

#470 - The training data of InternLM-XComposer2.5-Reward

Issue - State: open - Opened by darkpromise98 about 22 hours ago

#469 - InternLM-XComposer2.5-Reward中的训练loss是不是写错了

Issue - State: open - Opened by shipengai 1 day ago - 1 comment

#468 - Error while loading internlm-xcomposer2d5-ol-7b

Issue - State: closed - Opened by Yuuraa 8 days ago

#467 - Release InternLM-XComposer2.5-Chat on Hugging Face

Issue - State: closed - Opened by NielsRogge 15 days ago - 1 comment

#466 - 微调问题

Issue - State: open - Opened by FortuneBush 23 days ago

#465 - 多图图像size不一致

Issue - State: open - Opened by wuxi-dixi 29 days ago

#464 - 微调后如何加载模型？

Issue - State: open - Opened by believe81 about 1 month ago

#463 - omnilive 跑起来报错，没有config.json文件

Issue - State: open - Opened by shnulailai about 1 month ago

#462 - Can't run the example with the function get_default_template_type

Issue - State: open - Opened by candaccc-tang about 1 month ago

#461 - ValueError: Input image size (490490) doesn't match model (336336).

Issue - State: open - Opened by ZTWHHH about 1 month ago - 4 comments

#460 - ModuleNotFoundError: No module named 'examples.utils'出现这个为标题如何解决

Issue - State: open - Opened by july-love about 1 month ago

#459 - Inquiry Regarding Instruction Prediction

Issue - State: closed - Opened by patrick-tssn about 1 month ago - 1 comment

#458 - According to the tutorial and official docker image, sh start.sh has the following error:

Issue - State: closed - Opened by lwlovelmm about 2 months ago - 3 comments

#457 - InternLM-XComposer-2.5-OmniLive Setup Guide run in docker , hope to get an answer, thank you！

Issue - State: closed - Opened by lwlovelmm about 2 months ago

#456 - InternLM-XComposer-2.5-OmniLive Setup Guide

Issue - State: closed - Opened by lwlovelmm about 2 months ago

#455 - ModuleNotFoundError: No module named 'grounding_qwen'

Issue - State: open - Opened by lwlovelmm about 2 months ago - 1 comment

#454 - Help us continue to use the MMDET

Issue - State: open - Opened by MiXaiLL76 about 2 months ago

#453 - 模型精度问题

Issue - State: open - Opened by jyC23333 about 2 months ago

#452 - InternLM-XComposer-2.5-OmniLive online-demo not work

Issue - State: closed - Opened by exceedzhang about 2 months ago

#451 - About InternLM-XComposer-2.5-OmniLive

Issue - State: open - Opened by jun0wanan about 2 months ago

#450 - Inference fine-tuning support for internlm-xcomposer2d5-ol-7b

Issue - State: open - Opened by Jintao-Huang about 2 months ago - 3 comments

#449 - When fine-tune with fix_vit=False, will the CLIP-VIT be tuned, or the PORA adapter be tuned?

Issue - State: open - Opened by lrybbbccc 2 months ago

#448 - Has InternLM-XComposer2-VL undergone interleaved text-image pretraining?

Issue - State: open - Opened by JT-Ushio 3 months ago

#447 - about train question

Issue - State: open - Opened by GuGuGuGun 3 months ago - 2 comments

#446 - 最新的2d5模型使用huggingface上的示例下载（model = AutoModel.from_pretrained('internlm/internlm-xcomposer2d5-7b', torch_dtype=torch.bfloat16, trust_remote_code=True).cuda().eval()），不会下载build_mlp.py文件，有没有遇到这个情况的

Issue - State: open - Opened by eternal8080 3 months ago - 2 comments

#445 - 关于训练Ixc2.5的数据读取问题

Issue - State: open - Opened by qyx1121 4 months ago

#444 - update sampler and use LoRA finetune LLM

Issue - State: open - Opened by chengxin0913 4 months ago

#443 - Update README.md

Pull Request - State: open - Opened by MiaSanLei 5 months ago - 1 comment

#442 - Could anyone provide ZERO3 + Offload config for deepspeed

Issue - State: open - Opened by YerongLi 5 months ago - 1 comment

#441 - XComposer-1.0 分片加载预训练模型问题

Issue - State: closed - Opened by MynameisXU 5 months ago

#440 - internlm/internlm-xcomposer2d5-7b的参数量为什么是10B?

Issue - State: open - Opened by fuqianya 5 months ago

#439 - Sometime image is in RGBA format which has 4 channel and generate will break for 2.5

Issue - State: open - Opened by YerongLi 5 months ago - 1 comment

#438 - 我怎么才能在图灵架构的GPU上部署书生-灵笔2.5大模型？TITAN RTX

Issue - State: open - Opened by Eileen2003 5 months ago

#437 - draw radar 请问一下这个图怎么画

Issue - State: open - Opened by elmsamcht2189 5 months ago - 1 comment

#436 - 4张A800跑不动internlm-xcomposer2d5-7b

Issue - State: open - Opened by LLMLearner000 5 months ago - 4 comments

#435 - Is the image token always necessary or not for InternLM-XComposer2.5?

Issue - State: open - Opened by chancharikmitra 5 months ago

#434 - OOM on genertion with 48 GB GPU with internlm-xcomposer2-vl-7b

Issue - State: closed - Opened by YerongLi 5 months ago - 1 comment

#433 - 关于多张GPU微调大模型的问题

Issue - State: open - Opened by yanhan111 5 months ago - 3 comments

#432 - Tesla P40不支持 flash_attn pipline 推理报错

Issue - State: open - Opened by love94me 5 months ago - 3 comments

#431 - Clarification Needed on Utillization of Tokenization in the Fine-Tuning Module || InternLM-XComposer2d5

Issue - State: open - Opened by khyati2396 5 months ago - 3 comments

#430 - hugging face demo 报错，请问如何解决呢？

Issue - State: open - Opened by zijianchen98 6 months ago

#429 - 显存占用过大疑问

Issue - State: open - Opened by Upcreat 6 months ago - 1 comment

#428 - how to increase the resolution of ViT from 490 × 490 to 560 × 560

Issue - State: closed - Opened by hiker-lw 6 months ago

#427 - `internlm/internlm-xcomposer2-vl-7b` only processed the first element in the batch

Issue - State: closed - Opened by YerongLi 6 months ago - 3 comments

#426 - 2d5-7b : I found the LoRA-checkpoint saved with multiple gpu is incorrect

Issue - State: open - Opened by YerongLi 6 months ago - 16 comments

#425 - web demo图文并茂创作，上传完图像点submit就报error

Issue - State: open - Opened by XiaohuJoshua 6 months ago

#424 - multi_process: RuntimeError: query and key must have the same dtype

Issue - State: open - Opened by daixiangzi 6 months ago - 2 comments

#423 - deepspeed LoRA checkpoint problem, did not resume checkpoint

Issue - State: closed - Opened by YerongLi 6 months ago - 2 comments

#422 - Inference problem with my lora trained checkpoint

Issue - State: open - Opened by RBBB2010 6 months ago - 1 comment

#421 - 请问要是中断训练，想继续的话需要加什么参数呢

Issue - State: open - Opened by yimuu 6 months ago - 3 comments

#419 - loss is aways 0

Issue - State: open - Opened by yimuu 6 months ago - 5 comments

#418 - I find I cannot load from fined LoRA checkpoint

Issue - State: closed - Opened by YerongLi 6 months ago - 5 comments

#417 - Fine tuning saved checkpoint is too large

Issue - State: closed - Opened by YerongLi 6 months ago - 1 comment

#416 - Generation: RuntimeError: FlashAttention only support fp16 and bf16 data type

Issue - State: closed - Opened by YerongLi 6 months ago - 8 comments

#415 - 图合成相关问题请教

Issue - State: open - Opened by zhongmiyu99 6 months ago - 1 comment

#414 - 多模态应用问题请教

Issue - State: open - Opened by zhongmiyu99 6 months ago

#413 - TypeError: 'NoneType' object is not callable

Issue - State: closed - Opened by hj611 6 months ago - 2 comments

#412 - 2d5 finetune type error

Issue - State: open - Opened by nzomi 6 months ago - 12 comments

#411 - 图文写作的实现逻辑

Issue - State: closed - Opened by zhongmiyu99 6 months ago - 1 comment

#410 - Update finetune.py for unify the the communication between the collator and InternLMXComposer2ForCausalLM.forward

Pull Request - State: closed - Opened by YerongLi 6 months ago - 3 comments

#409 - [Bug] for internlm/internlm-xcomposer2d5-7b-4bit fine tune (ValueError: The model you want to train is loaded in 8-bit precision. if you want to fine-tune an 8-bit model, please make sure that you have installed `bitsandbytes>=0.37.0`)

Issue - State: open - Opened by zhuraromdev 6 months ago - 3 comments

#408 - Batches for text only branches is wrong too

Issue - State: closed - Opened by YerongLi 6 months ago - 2 comments

#407 - demo网页都打不开了

Issue - State: closed - Opened by lonngxiang 6 months ago - 1 comment

#406 - Update README.md

Pull Request - State: open - Opened by MiaSanLei 6 months ago

#405 - inference multi-image input using the 4-bit model

Issue - State: closed - Opened by vietpho 6 months ago - 3 comments

#404 - nested BATCH_SIZE --per_device_train_batch_size should be always 1

Issue - State: closed - Opened by YerongLi 6 months ago - 2 comments

#403 - The feedforward dimension: BATCH_SIZE x k

Issue - State: closed - Opened by YerongLi 6 months ago - 3 comments

#402 - Fine tuning of quanitized internlm/internlm-xcomposer2-4khd-7b model?

Issue - State: open - Opened by zhuraromdev 7 months ago - 3 comments

#401 - emm 为啥你们的模型不能判断这个13.11和13.8谁大的问题，参数量不够吗

Issue - State: closed - Opened by HongLouyemeng 7 months ago - 2 comments

#400 - 图文写作生成结果相关问题

Issue - State: open - Opened by zhongmiyu99 7 months ago - 4 comments

#399 - out of memory when fine-tune the ICX2.5

Issue - State: open - Opened by cool-xuan 7 months ago - 4 comments

#398 - support video and multi imgs

Pull Request - State: closed - Opened by AllenMao 7 months ago - 1 comment

#397 - Inference time

Issue - State: open - Opened by vietpho 7 months ago - 4 comments

#396 - web 模板咨询

Issue - State: open - Opened by yaaisinile 7 months ago - 2 comments

#395 - size mismatch for vit.vision_tower.vision_model.embeddings.position_embedding.weight

Issue - State: closed - Opened by cool-xuan 7 months ago - 1 comment

#394 - build_mlp.py的后处理是否有问题

Issue - State: closed - Opened by lzcchl 7 months ago - 1 comment

#393 - ImportError: /home/ubuntu/.local/lib/python3.10/site-packages/awq_inference_engine.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN2at4_ops15sum_dim_IntList4callERKNS_6TensorEN3c1016OptionalArrayRefIlEEbNS5_8optionalINS5_10ScalarTypeEEE

Issue - State: closed - Opened by zhuraromdev 7 months ago - 4 comments

#392 - 提示词生成文本问题

Issue - State: closed - Opened by zhongmiyu99 7 months ago - 5 comments

#391 - internlm-xcomposer2d5-7b-4bit 软件环境可以给一个嘛

Issue - State: open - Opened by yaaisinile 7 months ago - 4 comments

#390 - ModuleNotFoundError: No module named 'transforemrs_modules.InternLM-XComposer2'

Issue - State: closed - Opened by YajieW99 7 months ago - 6 comments

#384 - InternLM-XComposer-2.5底座模型用的internLM2-7B，想问下为什么不用internLM2.5-7B呢？

Issue - State: open - Opened by will-wiki 7 months ago - 3 comments

#379 - performance difference between qformer and mlp

Issue - State: closed - Opened by annopackage 7 months ago - 1 comment

#375 - Not able to load the finetuned model

Issue - State: closed - Opened by simplelifetime 7 months ago - 1 comment

#374 - ZERO3 + Offload CPU Error when fine-tuning InternLM-XComposer2

Issue - State: open - Opened by Coobiw 7 months ago - 2 comments

#372 - batch inference support

Issue - State: open - Opened by cswry 7 months ago

#371 - Why is fine-tuning so slow?

Issue - State: closed - Opened by simplelifetime 7 months ago - 3 comments

#363 - Add license file

Issue - State: closed - Opened by edwardzjl 7 months ago - 1 comment

#362 - 如何调用InternLM-XComposer-2.5模型的forward函数？

Issue - State: closed - Opened by qingfengcss 7 months ago - 2 comments

#360 - OSError: [Errno 101] Network is unreachable when doing inference with internlm-xcomposer2.5-7b

Issue - State: closed - Opened by HuangZhen02 7 months ago - 7 comments

#358 - 运行demo报错

Issue - State: open - Opened by yusirhhh 7 months ago - 4 comments

#357 - Hidden States of InternLM-XComposer-vl-7B

Issue - State: closed - Opened by Divyanshsingh1910 7 months ago - 1 comment

#353 - 请问2.5支持int4的量化推理吗？

Issue - State: closed - Opened by seasoncool 7 months ago - 1 comment

#346 - Why submit the codes with obvious bugs

Issue - State: closed - Opened by LinaZhangCoding 7 months ago - 4 comments

#337 - QLora fine tuning?

Issue - State: open - Opened by pbarker 8 months ago - 23 comments

#335 - AttributeError: 'CLIPEncoder' object has no attribute '_gradient_checkpointing_func'

Issue - State: closed - Opened by hekaijie123 8 months ago - 3 comments

#331 - Using in transformers results in errors

Issue - State: closed - Opened by HuFY-dev 8 months ago - 3 comments

#328 - LoRA微调后推理阶段，一直输出到\n后就早停

Issue - State: closed - Opened by WeiminLee 8 months ago - 6 comments

GitHub / InternLM/InternLM-XComposer issues and pull requests