huggingface/optimum-habana issues and pull requests

#1316 - Added Qwen2-MoE model, optimizing its performance on Gaudi

Pull Request - State: open - Opened by gyou2021 26 days ago - 1 comment

#1315 - Update CI, tests and examples

Pull Request - State: closed - Opened by regisss 26 days ago - 1 comment

#1314 - CodeGen inference error "synNodeCreateWithId failed for node: batch_gemm with synStatus 26"

Issue - State: open - Opened by caijimin 26 days ago - 4 comments
Labels: bug

#1313 - use native checkpointing under compile mode

Pull Request - State: closed - Opened by xinyu-intel 26 days ago - 3 comments

#1312 - Add the multi-cards support for image_to_text examples

Pull Request - State: open - Opened by yuanwu2017 26 days ago

#1311 - RuntimeError: shape '[-1, 0]' is invalid for input of size 134152192 for Mistral-7B finetune

Issue - State: open - Opened by aitss2017 26 days ago - 5 comments
Labels: bug

#1310 - Fixed missing override _reorder_cache function

Pull Request - State: open - Opened by kplau1128 27 days ago - 3 comments

#1309 - Add the deepspeed injection_policy of mistral

Pull Request - State: closed - Opened by yuanwu2017 27 days ago - 1 comment

#1308 - Fix text-generation example lm_eval evaluation

Pull Request - State: closed - Opened by changwangss 27 days ago - 1 comment

#1307 - Add section to README about Transformers development branch

Pull Request - State: closed - Opened by regisss 28 days ago - 1 comment

#1306 - RuntimeError: shape '[-1, 0]' is invalid for input of size 2510226432

Issue - State: open - Opened by xinsu626 29 days ago - 1 comment
Labels: bug

#1305 - runwayml/stable-diffusion-v1-5 no longer exists

Issue - State: closed - Opened by vidyasiv about 1 month ago - 3 comments
Labels: bug

#1304 - enable `paligemma` model

Pull Request - State: open - Opened by kaixuanliu about 1 month ago - 4 comments

#1303 - Test

Pull Request - State: closed - Opened by regisss about 1 month ago - 1 comment

#1302 - fix OOM when inference with llama-3.1-70b

Pull Request - State: open - Opened by harborn about 1 month ago - 1 comment

#1301 - [SW-198030]: Prevent Graph break in Llama when using flash attention

Pull Request - State: closed - Opened by pramodkumar-habanalabs about 1 month ago - 1 comment

#1300 - use StableDiffusionXLPipeline_HPU

Pull Request - State: open - Opened by Jianhong-Zhang about 1 month ago

#1299 - Potential fix for the failed code quality check comment workflow

Pull Request - State: closed - Opened by regisss about 1 month ago - 1 comment

#1298 - Test

Pull Request - State: closed - Opened by regisss about 1 month ago

#1297 - Switch failed code quality check comment to `workflow_run`

Pull Request - State: closed - Opened by regisss about 1 month ago - 1 comment

#1296 - Ig/sdxl-ci-script-throughput

Pull Request - State: open - Opened by imangohari1 about 1 month ago

#1295 - add boft support in stable-diffusion

Pull Request - State: open - Opened by sywangyi about 1 month ago - 1 comment

#1294 - vera/ln_tuning add and test case add

Pull Request - State: open - Opened by sywangyi about 1 month ago - 1 comment

#1293 - stable-diffusion-2-1-base BF16 on Gaudi2D get RuntimeError: synNodeCreateWithId failed for node: spatial_convolution with synStatus 26 [Generic failure].

Issue - State: closed - Opened by KiwiHana about 1 month ago - 3 comments
Labels: bug

#1292 - add `--use_kv_cache` to image-to-text pipeline

Pull Request - State: open - Opened by KimBioInfoStudio about 1 month ago - 4 comments

#1291 - Sarkar/get seq len fix propagate

Pull Request - State: closed - Opened by ssarkar2 about 1 month ago - 1 comment

#1290 - Remove clone() to improve performance

Pull Request - State: closed - Opened by yeonsily about 1 month ago

#1289 - Add missing condtion check in tensor creation in greedy search

Pull Request - State: closed - Opened by yeonsily about 1 month ago

#1288 - Add missing condtion check in tensor creation in greedy search

Pull Request - State: closed - Opened by yeonsily about 1 month ago - 1 comment
Labels: OH_1.13.1_Candidates

#1287 - Fix eos not stopping issue when batch_size >1 and set ignore_eos to False

Pull Request - State: open - Opened by heyuanliu-intel about 1 month ago - 2 comments
Labels: review wip

#1286 - Remove huggingface_hub install that is no longer needed in the kubernetes example

Pull Request - State: closed - Opened by dmsuehir about 1 month ago - 1 comment

#1285 - Update FusedSDPA calling method as Gaudi documentation

Pull Request - State: closed - Opened by yeonsily about 1 month ago - 5 comments
Labels: run-test

#1284 - Boost SDXL speed with initialized schedule step reset

Pull Request - State: open - Opened by dsocek about 1 month ago - 3 comments

#1283 - Fix profiling step with device finish execution for text-generation

Pull Request - State: closed - Opened by libinta about 1 month ago - 1 comment

#1282 - gpt_big_code: make flash attention impl quantization friendly

Pull Request - State: open - Opened by mgonchar about 1 month ago - 7 comments
Labels: review wip

#1281 - Fix BERT FSDP test

Pull Request - State: closed - Opened by regisss about 1 month ago - 5 comments
Labels: OH_1.13.1_Candidates

#1280 - [Gemma v2] Enable gemma v2 on gaudi

Pull Request - State: open - Opened by billishyahao about 1 month ago
Labels: review wip

#1279 - fix bug when running `google/paligemma-3b-mix-224`

Pull Request - State: closed - Opened by kaixuanliu about 1 month ago - 7 comments
Labels: review wip

#1278 - Llava: Added flash_attention_recompute arg to provide an option to enable/disable recompute

Pull Request - State: closed - Opened by tthakkal about 1 month ago - 1 comment

#1277 - Ig/Diffusers timing

Pull Request - State: closed - Opened by imangohari1 about 1 month ago - 3 comments
Labels: run-test

#1276 - Transformer models generation supports user-provided input embeddings

Pull Request - State: open - Opened by zongwave about 1 month ago - 4 comments

#1275 - Add Whisper static generation

Pull Request - State: open - Opened by Spycsh about 1 month ago - 9 comments
Labels: review wip

#1274 - Fix BERT FSDP test

Pull Request - State: closed - Opened by vidyasiv about 1 month ago - 2 comments

#1273 - Revert mark_step in mixtral model from PR #1260

Pull Request - State: closed - Opened by yeonsily about 1 month ago - 2 comments
Labels: OH_1.13.1_Candidates

#1272 - Fix cache position issue in mixtral

Pull Request - State: closed - Opened by tthakkal about 1 month ago - 1 comment
Labels: OH_1.13.1_Candidates

#1271 - Fix memory regression for modeling llama

Pull Request - State: closed - Opened by libinta about 1 month ago - 1 comment
Labels: OH_1.13.1_Candidates

#1270 - Idefics2

Pull Request - State: open - Opened by sywangyi about 1 month ago - 3 comments
Labels: review wip

#1269 - [SW-196653] Ig/Mixtral fp8

Pull Request - State: closed - Opened by imangohari1 about 2 months ago - 2 comments

#1268 - fix(ac): Added trust_remote in README inference

Pull Request - State: closed - Opened by imangohari1 about 2 months ago - 1 comment

#1267 - Add profiler to SD3

Pull Request - State: closed - Opened by atakaha about 2 months ago - 1 comment

#1266 - remove _expand_inputs_for_generation for greedy_Search

Pull Request - State: closed - Opened by libinta about 2 months ago - 1 comment
Labels: OH_1.13.1_Candidates

#1265 - Accelerate Diffusers CI

Pull Request - State: closed - Opened by regisss about 2 months ago - 1 comment

#1264 - Fix failed code quality check comment workflow

Pull Request - State: closed - Opened by regisss about 2 months ago - 2 comments

#1263 - Add callable workflow to post comments when code quality check failed

Pull Request - State: closed - Opened by regisss about 2 months ago - 1 comment

#1262 - Add trust_remote_code to audio classification CI tests and README.

Pull Request - State: closed - Opened by emascarenhas about 2 months ago - 4 comments

#1261 - Set input_embeds before it gets used

Pull Request - State: closed - Opened by tthakkal about 2 months ago - 1 comment

#1260 - Gpt bigcode fused sdpa

Pull Request - State: closed - Opened by yeonsily about 2 months ago - 1 comment
Labels: synapse1.17

#1259 - Update README and more changes, rebase to main

Pull Request - State: closed - Opened by shepark about 2 months ago - 4 comments
Labels: synapse1.17

#1258 - [SW_196667] fix(nltk): Revert 1247. Updated the version. added the punkt_tab download

Pull Request - State: closed - Opened by imangohari1 about 2 months ago - 1 comment

#1257 - Remove HQT from OHF

Pull Request - State: open - Opened by Yantom1 about 2 months ago
Labels: review wip, synapse 1.18 dependency

#1256 - Improve MPT fp8

Pull Request - State: open - Opened by atakaha about 2 months ago - 6 comments

#1255 - Bump nltk from 3.8.1 to 3.8.2 in /examples/summarization

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 2 comments
Labels: synapse 1.16_dependency

#1254 - [SW-196669] Set HLS_MODULE_ID only if it wasn't set previously

Pull Request - State: closed - Opened by astachowiczhabana about 2 months ago - 1 comment

#1253 - fix eos issue in finetune/generation

Pull Request - State: closed - Opened by sywangyi about 2 months ago - 7 comments
Labels: run-test

#1252 - Fix spelling errors

Pull Request - State: closed - Opened by changwangss about 2 months ago - 1 comment

#1251 - Fix FSDP graph error due to Tranformer 4.43 update

Pull Request - State: closed - Opened by jiminha about 2 months ago - 2 comments
Labels: synapse1.17

#1250 - Ig/sw_196666 sd

Pull Request - State: closed - Opened by imangohari1 about 2 months ago - 2 comments
Labels: synapse1.17

#1249 - Update README.md for trust_remote_code and fix model name

Pull Request - State: closed - Opened by shepark about 2 months ago - 2 comments

#1248 - [SW-196588] mpt model missing - pip install einops

Pull Request - State: closed - Opened by hsubramony about 2 months ago - 1 comment

#1247 - fix(nltk): fixed the version to working one

Pull Request - State: closed - Opened by imangohari1 about 2 months ago - 7 comments
Labels: synapse1.17

#1246 - Fix PyTorch version in the Kubernetes docker-compose to match image

Pull Request - State: closed - Opened by dmsuehir about 2 months ago - 1 comment

#1245 - Trl upgrade

Pull Request - State: open - Opened by sywangyi about 2 months ago - 3 comments

#1244 - Add the diffusers examples of inference Tech

Pull Request - State: open - Opened by yuanwu2017 about 2 months ago

#1243 - update quantization configuration files (#319)

Pull Request - State: open - Opened by dudilester about 2 months ago

#1242 - Data parallelism or tensor parallelism? How can i know that and is there a chance i can shift in between these too?

Issue - State: open - Opened by venkycreator about 2 months ago - 1 comment
Labels: bug

GitHub / huggingface/optimum-habana issues and pull requests