huggingface/candle issues and pull requests

#2914 - fixed quantized-gemma example

Pull Request - State: closed - Opened by greenrazer 3 months ago - 1 comment

#2913 - Poor performance in back propagation

Issue - State: open - Opened by alex 3 months ago - 5 comments

#2911 - Can we accelerate the onnx model with a GPU from candle?

Issue - State: open - Opened by Baiyuetribe 3 months ago

#2910 - Add the const-set op.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2909 - Add an enum for scalar values.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2908 - Check the bounds in the cuda indexing kernels.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2906 - Add metal precompilation

Pull Request - State: open - Opened by ivarflakstad 3 months ago - 6 comments

#2905 - Allow from_vec/from_slice to use a ShapeWithOneHole as shape.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2904 - Add PRelu operation

Pull Request - State: closed - Opened by A2va 3 months ago

#2903 - Add qwen3 on candle-transformers

Pull Request - State: closed - Opened by maximizemaxwell 3 months ago - 1 comment

#2902 - implemented quantized-gemma3

Pull Request - State: closed - Opened by greenrazer 3 months ago - 1 comment

#2901 - Rotating kv cache positions

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2900 - Use cudarc 0.16.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2899 - called `Result::unwrap()` on an `Err` value: no cuda implementation for sigmoid

Issue - State: closed - Opened by liguheng 3 months ago - 3 comments

#2898 - Upstream ericlbuehler/candle

Pull Request - State: closed - Opened by Jeadie 3 months ago

#2897 - Updated candle-book: Introduction, Installation, MNIST guide, and added CONTRIBUTING.md

Pull Request - State: closed - Opened by greenrazer 3 months ago - 1 comment

#2896 - Use cudarc 0.15.2.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2895 - Bump the crate version.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2894 - Gumbel-Softmax sampling.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2893 - How to build a multi-node inference/training in candle?

Issue - State: open - Opened by k82cn 3 months ago

#2892 - Expose the cudnn algo in the conv ops.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2891 - Example for google/gemma-3-4b-it-qat-q4_0-gguf

Issue - State: closed - Opened by anidotnet 3 months ago - 15 comments

#2890 - Add a cudnn feature to candle-nn/candle-transformers.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2889 - Exclude candle-book to avoid some CI failures.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2888 - Support for cudnn conv1d.

Pull Request - State: closed - Opened by LaurentMazare 3 months ago

#2887 - Add ZeroShotClassification examples (WASM and Native)

Pull Request - State: open - Opened by sondalex 3 months ago

#2886 - Add the Orpheus TTS.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2885 - Im2col cuda optimization.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2884 - Optimize the batched matmul for the cpu backend.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2883 - Avoid using batched-matmul in nn::Linear.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago - 3 comments

#2882 - Upgrade ug.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2881 - Bump the cudarc version.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2880 - Cuda cleanup.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2879 - fix: missing shared tensor in bert::BertLMPredictionHead

Pull Request - State: open - Opened by silver-ymz 4 months ago

#2878 - fix: wrong mask for distilbert::MultiHeadSelfAttention

Pull Request - State: open - Opened by silver-ymz 4 months ago

#2877 - Candle Inference ~8.5x Slower Than PyTorch on CPU

Issue - State: open - Opened by msminhas93 4 months ago - 17 comments

#2876 - Unsupported op_type Resize with ONNX

Issue - State: open - Opened by super-fun-surf 4 months ago

#2875 - Quantization Error unsupported safetensor dtype F8_E4M3

Issue - State: open - Opened by super-fun-surf 4 months ago

#2874 - Slower results on GGUF model

Issue - State: open - Opened by BerserkerMother 4 months ago

#2873 - Adding Docs

Issue - State: open - Opened by BerserkerMother 4 months ago - 1 comment

#2872 - Fix dtype mismatch in BERT attention mask handling

Pull Request - State: closed - Opened by msminhas93 4 months ago - 1 comment

#2871 - Support more snac variants.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2870 - Model Request: Adding Canary Flash

Issue - State: open - Opened by ArEnSc 4 months ago

#2869 - Add the SNAC audio tokenizer.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2868 - Clippy 1.86 fixes for cuda.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2867 - Add the missing voices for CSM.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2866 - Implementing DistilBertForMaskedLM.

Pull Request - State: closed - Opened by greenrazer 4 months ago - 3 comments

#2865 - Tensor shape mismatch error when using candle-onnx with audio input

Issue - State: open - Opened by MNIKIEMA 4 months ago - 4 comments

#2864 - Fix for clippy 1.86.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2863 - F.interpolate not surpport yet

Issue - State: open - Opened by Baiyuetribe 4 months ago

#2862 - Add the CSM model.

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2861 - Add `ReduceLROnPlateau` learning rate scheduler

Pull Request - State: open - Opened by brylee10 4 months ago - 3 comments

#2860 - Added new language pairs to marian-mt example.

Pull Request - State: closed - Opened by greenrazer 4 months ago - 1 comment

#2859 - Add as_cuda_slice_mut to CudaDType and CudaStorage

Pull Request - State: closed - Opened by zackangelo 4 months ago - 3 comments

#2858 - Update to cudarc 0.14 (breaking change).

Pull Request - State: closed - Opened by LaurentMazare 4 months ago

#2857 - Add BertForSequenceClassification with Native and WASM Examples

Pull Request - State: open - Opened by sondalex 4 months ago

#2855 - Add `flip` to `tensor`

Pull Request - State: closed - Opened by brylee10 4 months ago - 1 comment

#2854 - More examples about marian

Issue - State: open - Opened by Aalivexy 4 months ago - 2 comments

#2853 - torch.flip not surpport yet!

Issue - State: closed - Opened by Baiyuetribe 4 months ago

#2852 - Unsupported ONNX operator: LRN

Issue - State: open - Opened by BrunoSienkiewicz 4 months ago

#2851 - Unsupported ONNX operator: Selu

Issue - State: open - Opened by BrunoSienkiewicz 4 months ago - 1 comment

#2850 - Unsupported ONNX operator: RNN

Issue - State: open - Opened by BrunoSienkiewicz 4 months ago

#2849 - Unsupported ONNX operator: LayerNormalization

Issue - State: open - Opened by BrunoSienkiewicz 4 months ago

#2848 - Unsupported ONNX operator: Attention

Issue - State: open - Opened by BrunoSienkiewicz 4 months ago

#2847 - Unsupported ONNX operator: SoftmaxCrossEntropyLoss

Issue - State: open - Opened by BrunoSienkiewicz 4 months ago

#2846 - torch.stft and torch.istft not surpport yet!

Issue - State: open - Opened by Baiyuetribe 4 months ago

#2845 - Fix CIFAR10 dataset types and dimension ordering

Pull Request - State: closed - Opened by brylee10 4 months ago - 1 comment

#2844 - UV is incompatible with pyo3 for the reinforcement-learning example

Issue - State: open - Opened by greenrazer 4 months ago

#2843 - Added DeepseekR1 Qwen7B variant to quantized-qwen2-instruct example

Pull Request - State: closed - Opened by greenrazer 4 months ago - 1 comment

#2842 - Added Deepseekr1 Llama8b variant to quantized example

Pull Request - State: closed - Opened by greenrazer 4 months ago - 1 comment

#2841 - Enabling different linking options for MKL downstream.

Pull Request - State: open - Opened by Narsil 4 months ago

#2840 - KV Caching for GGUF Models

Issue - State: closed - Opened by smallbraingames 4 months ago - 2 comments

#2839 - Fixed errors in the reinforcement-learning example.

Pull Request - State: closed - Opened by greenrazer 4 months ago - 1 comment

#2838 - Refresh cargo dependencies

Pull Request - State: open - Opened by Brooooooklyn 4 months ago

#2837 - Fix reinforcement learning example

Pull Request - State: closed - Opened by Brooooooklyn 4 months ago - 1 comment

#2836 - Tracking: Issues with examples

Issue - State: open - Opened by greenrazer 4 months ago - 1 comment

#2835 - Added readmes to examples

Pull Request - State: closed - Opened by greenrazer 4 months ago - 2 comments

#2834 - Fixed rand imports for whisper-microphone example.

Pull Request - State: closed - Opened by greenrazer 4 months ago - 1 comment

#2833 - Fixed rand import for mnist-training

Pull Request - State: closed - Opened by greenrazer 4 months ago

#2832 - Tracking: Metal issues with examples

Issue - State: open - Opened by greenrazer 4 months ago

#2831 - Unsupported cuda toolkit version: `12.8`

Issue - State: closed - Opened by kylekyle 4 months ago - 1 comment

#2830 - Tile op for onnx support

Issue - State: open - Opened by MonolithFoundation 4 months ago

#2829 - fix: `candle-flash-attn` linux and `msvc` build

Pull Request - State: closed - Opened by xkeyC 4 months ago - 1 comment

#2828 - Proposal to Add `SmolVLM` Model Support to `candle-examples`

Issue - State: closed - Opened by Force1ess 4 months ago - 7 comments

#2827 - Error During Tokenizer Initialization When Deploying SD 3.5 Large Turbo

Issue - State: open - Opened by yuhsintsao 4 months ago

#2826 - Mimi Encoder

Issue - State: open - Opened by ArEnSc 4 months ago - 3 comments

#2825 - yolo wasm example update

Pull Request - State: closed - Opened by youngday 4 months ago

#2824 - Pickle decoder fix and Long1 opcode addition.

Pull Request - State: closed - Opened by computer-whisperer 4 months ago - 1 comment

#2823 - Candle does not work on Android

Issue - State: closed - Opened by mariuszmalek 4 months ago

#2822 - candle_nn::Activation::Mish not surpport yet

Issue - State: closed - Opened by Baiyuetribe 4 months ago

#2821 - feat: `use_flash_attn` for whisper and fix `candle-flash-attn` MSVC build

Pull Request - State: closed - Opened by xkeyC 4 months ago - 4 comments

#2820 - Integrate MLX SDPA kernels with mask

Pull Request - State: open - Opened by EricLBuehler 4 months ago

#2819 - pipeline in Qwen if run twice will get error

Issue - State: open - Opened by MonolithFoundation 4 months ago

#2817 - does candle_onnx support running on cuda?

Issue - State: closed - Opened by egorsmkv 4 months ago

#2816 - Flash Attn Problem in linux

Issue - State: closed - Opened by super-fun-surf 4 months ago - 25 comments

#2815 - Windows CUDNN required for Distributable

Issue - State: closed - Opened by super-fun-surf 4 months ago - 3 comments

#2814 - Qwen2.5-VL support

Issue - State: open - Opened by silicology1 4 months ago - 3 comments

#2813 - Implement the Gemma 3 vision models!

Pull Request - State: open - Opened by EricLBuehler 4 months ago - 2 comments

#2812 - model request: DistilBertForMaskedLM

Issue - State: closed - Opened by VoVAllen 4 months ago - 2 comments

#2811 - Fix for whisper example. rand::distribution is now rand::distr

Pull Request - State: closed - Opened by beurdouche 4 months ago

GitHub / huggingface/candle issues and pull requests