Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / alibaba/Megatron-LLaMA issues and pull requests

#70 - 执行hf转megatron格式报错了

Issue - State: open - Opened by Lilypad97 about 1 month ago

#67 - No module named 'megatron.tokenizer.file_utils'

Issue - State: closed - Opened by yuzhiguo07 4 months ago

#66 - 如何断点续训

Issue - State: open - Opened by MAxx8371 5 months ago

#65 - No update for a long time

Issue - State: open - Opened by dong-liuliu 5 months ago

#64 - Has llama2 GQA been supported yet?

Issue - State: open - Opened by JiwenJ 6 months ago

#62 - Llama 3 Support

Issue - State: open - Opened by john-theo 7 months ago

#61 - About batch_size

Issue - State: open - Opened by tszslovewanpu 9 months ago

#60 - sh LLaMA2_7B_standalone.sh

Issue - State: open - Opened by yangzhipeng1108 9 months ago

#59 - 请问是否支持从0训练一个小规模的LLaMA模型，如：1B

Issue - State: open - Opened by liubo12 9 months ago - 1 comment

#58 - 注意力权重转换问题

Issue - State: open - Opened by noob-ctrl 9 months ago - 2 comments

#56 - 使用distributed optimzer时grad_norm计算准确度的疑问

Issue - State: open - Opened by chivychao 11 months ago - 1 comment

#54 - add alibi position embedding and support baichuan

Pull Request - State: open - Opened by qyccc 12 months ago - 3 comments

#53 - LLaMAModel._causal_lm_process中的labels和logits对齐方法疑问

Issue - State: open - Opened by chivychao 12 months ago - 3 comments

#52 - Megatron-LM权重转hf格式

Issue - State: open - Opened by Yang-QW 12 months ago - 1 comment

#52 - Megatron-LM权重转hf格式

Issue - State: open - Opened by Yang-QW 12 months ago - 4 comments

#51 - Unable to import Megatron

Issue - State: closed - Opened by fyf2016 about 1 year ago - 8 comments

#50 - llama中decoder layer层里面的MLP问题

Issue - State: closed - Opened by yuanzhoulvpi2017 about 1 year ago - 4 comments

#48 - 求一份Serving的教程代码

Issue - State: open - Opened by xealml about 1 year ago - 1 comment

#47 - hf权重转换代码小bug

Issue - State: open - Opened by yuanzhoulvpi2017 about 1 year ago

#47 - hf权重转换代码小bug

Issue - State: open - Opened by yuanzhoulvpi2017 about 1 year ago

#46 - INT4 量化的模型可以被Megatron-LLaMA支持吗？

Issue - State: open - Opened by Jeff123z about 1 year ago - 1 comment

#45 - 请问目前Megatron-LLaMA支持LLaMA2-70B的训练吗？

Issue - State: open - Opened by 13416157913 about 1 year ago - 1 comment

#44 - 是否兼容sequence parallel

Issue - State: closed - Opened by jingjie01ai about 1 year ago - 2 comments

#43 - CUDA_DEVICE_MAX_CONNECTIONS 设置问题

Issue - State: closed - Opened by Richie-yan about 1 year ago

#43 - CUDA_DEVICE_MAX_CONNECTIONS 设置问题

Issue - State: closed - Opened by Richie-yan about 1 year ago

#42 - 每次GA的backward都需要做通信

Issue - State: closed - Opened by jingjie01ai about 1 year ago - 5 comments

#41 - fp16的支持问题

Issue - State: open - Opened by XUWeijiang about 1 year ago - 1 comment

#41 - fp16的支持问题

Issue - State: open - Opened by XUWeijiang about 1 year ago - 1 comment

#39 - Supporting overlapping AG with forward computation

Pull Request - State: closed - Opened by li-yi-dong about 1 year ago

#39 - Supporting overlapping AG with forward computation

Pull Request - State: closed - Opened by li-yi-dong about 1 year ago

#38 - Adopt OverlappedDistributedOptimizer to PP

Pull Request - State: closed - Opened by li-yi-dong about 1 year ago - 1 comment

#33 - solve the RuntimeError: Tensors must be CUDA and dense

Pull Request - State: open - Opened by 13416157913 about 1 year ago - 2 comments

#33 - solve the RuntimeError: Tensors must be CUDA and dense

Pull Request - State: open - Opened by 13416157913 about 1 year ago - 2 comments

#31 - Loss对齐

Issue - State: open - Opened by wuziyou199217 about 1 year ago - 3 comments

#25 - 请问ParameterSchedule实际上有作用吗？

Issue - State: closed - Opened by yinzhijian about 1 year ago - 1 comment

#23 - NGC22.08 环境报错。

Issue - State: closed - Opened by EthanChen1234 about 1 year ago - 2 comments

#21 - llama2-34b shape不匹配

Issue - State: closed - Opened by cdj0311 about 1 year ago - 4 comments

#20 - 训练完后，将保存的Megatron格式转成HF格式报错

Issue - State: closed - Opened by 13416157913 about 1 year ago - 7 comments

#19 - deepspeed+megatron+llama，请问作者有试过吗

Issue - State: open - Opened by Chandler-Bing about 1 year ago - 1 comment

#18 - add Megatron-LLaMA/examples/LLaMA/LLaMA2_7B_standalone.sh file

Pull Request - State: closed - Opened by 13416157913 about 1 year ago - 4 comments

#17 - nccl通信边界问题？

Issue - State: open - Opened by Baibaifan about 1 year ago - 10 comments

#17 - nccl通信边界问题？

Issue - State: open - Opened by Baibaifan about 1 year ago - 10 comments

#16 - 2节点训练13B LLaMA模型效率只能达到840 token/sec/GPU

Issue - State: open - Opened by YaboSun about 1 year ago - 13 comments

#15 - RuntimeError: CUDA error: device-side assert triggered

Issue - State: closed - Opened by Double-bear about 1 year ago - 2 comments

#14 - 单机训练跑不了，CUDA报错

Issue - State: closed - Opened by XUWeijiang about 1 year ago - 11 comments

#14 - 单机训练跑不了，CUDA报错

Issue - State: closed - Opened by XUWeijiang about 1 year ago - 12 comments

#13 - 请问支持Qwen模型的训练吗？

Issue - State: open - Opened by sxthunder about 1 year ago - 2 comments

#12 - DistributedOptimizer 梯度聚合，疑问

Issue - State: closed - Opened by EthanChen1234 about 1 year ago - 3 comments

#12 - DistributedOptimizer 梯度聚合，疑问

Issue - State: closed - Opened by EthanChen1234 about 1 year ago - 3 comments

#10 - hf转megatron shape错误

Issue - State: open - Opened by Double-bear about 1 year ago - 10 comments

#9 - 请问什么时候出一个傻瓜教程？比如跑通7B完整训练流程

Issue - State: open - Opened by iMountTai about 1 year ago - 11 comments

#9 - 请问什么时候出一个傻瓜教程？比如跑通7B完整训练流程

Issue - State: open - Opened by iMountTai about 1 year ago - 11 comments

#8 - llama2分布式训练脚本有没有不用容器部署方式的脚本？

Issue - State: open - Opened by 13416157913 about 1 year ago - 1 comment

#8 - llama2分布式训练脚本有没有不用容器部署方式的脚本？

Issue - State: open - Opened by 13416157913 about 1 year ago - 1 comment

#7 - 实验结果的网络带宽数据能说明一下吗

Issue - State: closed - Opened by donghucey about 1 year ago - 1 comment

#6 - Compability with Huggingface

Issue - State: open - Opened by YuanLiuuuuuu about 1 year ago - 1 comment

#6 - Compability with Huggingface

Issue - State: open - Opened by YuanLiuuuuuu about 1 year ago - 1 comment

#4 - 执行LLaMA_13_standalone.sh脚本，没有训练过程很快就结束

Issue - State: open - Opened by 13416157913 about 1 year ago - 2 comments

#4 - 执行LLaMA_13_standalone.sh脚本，没有训练过程很快就结束

Issue - State: open - Opened by 13416157913 about 1 year ago - 2 comments