Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / facebookresearch/multimodal issues and pull requests

#429 - Attention with caching

Pull Request - State: open - Opened by pikapecan over 1 year ago - 2 comments
Labels: CLA Signed, fb-exported

#428 - Add __init__.py to diffusion folder to make a package

Pull Request - State: closed - Opened by pbontrager over 1 year ago - 3 comments
Labels: CLA Signed, Merged

#427 - Move Dalle2 + Diffusion Components to OSS

Pull Request - State: closed - Opened by pbontrager over 1 year ago - 9 comments
Labels: CLA Signed, fb-exported, Merged

#426 - add loggings for internal adoption tracking

Pull Request - State: closed - Opened by pikapecan over 1 year ago - 3 comments
Labels: CLA Signed, fb-exported, Merged

#425 - Update some facebookresearch callsites to explicitly specify use_reentrant

Pull Request - State: closed - Opened by soulitzer over 1 year ago - 3 comments
Labels: CLA Signed, fb-exported, Merged

#424 - Move mask creation to init + set is_causal flag for CLIP

Pull Request - State: closed - Opened by ankitade over 1 year ago - 2 comments
Labels: CLA Signed, Merged

#423 - update build workflow

Pull Request - State: closed - Opened by pikapecan over 1 year ago - 7 comments
Labels: CLA Signed, fb-exported, Merged

#422 - fix nightly by adding workflow deps

Pull Request - State: closed - Opened by pikapecan over 1 year ago - 1 comment
Labels: CLA Signed

#421 - Training log file for flava full

Issue - State: closed - Opened by rishabhm12 over 1 year ago - 3 comments

#420 - OOM while finetuning flava

Issue - State: closed - Opened by rishabhm12 over 1 year ago - 1 comment

#419 - Remove collation when doing clip transform on single input

Pull Request - State: closed - Opened by ankitade over 1 year ago - 3 comments
Labels: CLA Signed, Merged

#418 - Adding params to specify final activation in av_concat_fusion and use valid mask in contrastive_loss_with_temperature

Pull Request - State: closed - Opened by ankitade over 1 year ago - 5 comments
Labels: CLA Signed, fb-exported, Merged

#417 - Update type hint in ImageMaskingGenerator

Pull Request - State: closed - Opened by felixdivo over 1 year ago - 3 comments
Labels: CLA Signed, Merged

#416 - Fix typing in FLAVA training

Pull Request - State: closed - Opened by felixdivo over 1 year ago - 4 comments
Labels: CLA Signed, Merged

#415 - Add helper functions for vit

Pull Request - State: closed - Opened by ankitade over 1 year ago - 7 comments
Labels: CLA Signed, fb-exported, Merged

#414 - Support for CoCa Model

Issue - State: closed - Opened by mert-kurttutan over 1 year ago - 4 comments

#413 - Pin mypy version

Pull Request - State: closed - Opened by ankitade over 1 year ago - 2 comments
Labels: CLA Signed, Merged

#412 - Migrate test_clip_transform to pytest

Pull Request - State: closed - Opened by ebsmothers over 1 year ago - 4 comments
Labels: CLA Signed, Merged

#411 - Add multihead self attn to use sdpa from core

Pull Request - State: closed - Opened by ankitade over 1 year ago - 7 comments
Labels: CLA Signed, fb-exported, Merged

#410 - Replace nn.GroupNorm with Fp32GroupNorm for mixed precision training

Pull Request - State: closed - Opened by RdoubleA over 1 year ago - 3 comments
Labels: CLA Signed, fb-exported, Merged

#409 - Change tuples to list in transformer output to support torchscriptabi…

Pull Request - State: closed - Opened by ankitade over 1 year ago - 3 comments
Labels: CLA Signed, Merged

#408 - Update MHA to support features for ADM attention

Pull Request - State: closed - Opened by RdoubleA over 1 year ago - 5 comments
Labels: CLA Signed, fb-exported, Merged

#406 - [FLAVA] Fix for DDP with active checkpointing

Pull Request - State: closed - Opened by enmalik over 1 year ago - 4 comments
Labels: CLA Signed, Merged

#405 - [FLAVA] Upgrading datasets version to fix feature TypeError issue

Pull Request - State: closed - Opened by enmalik over 1 year ago - 2 comments
Labels: CLA Signed, Merged

#404 - training flava with ddp and activation checkpointing gives runtime error

Issue - State: closed - Opened by rxqy over 1 year ago - 1 comment

#403 - [MUGEN] Update GenerateUtil test to remove multinomial dependency

Pull Request - State: closed - Opened by RdoubleA over 1 year ago - 3 comments
Labels: CLA Signed, Merged

#402 - Remove multinomial dependency in MDETR loss tests

Pull Request - State: closed - Opened by ebsmothers over 1 year ago - 3 comments
Labels: CLA Signed, Merged

#401 - Bump pillow from 9.2.0 to 9.3.0 in /examples/flava

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 4 comments
Labels: CLA Signed, Merged, dependencies

#400 - Bump pillow from 9.2.0 to 9.3.0 in /examples/albef

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 3 comments
Labels: CLA Signed, Merged, dependencies

#399 - Remove python 3.7 support

Pull Request - State: closed - Opened by ankitade over 1 year ago - 3 comments
Labels: CLA Signed, Merged

#398 - Make clip text transform scriptable

Pull Request - State: closed - Opened by ankitade over 1 year ago - 5 comments
Labels: CLA Signed, fb-exported, Merged

#397 - Added OpenAI Pre-trained weights to CLIP Models

Pull Request - State: closed - Opened by pbontrager over 1 year ago - 10 comments
Labels: CLA Signed, Merged

#396 - [FLAVA]Upgrade lightning and pillow dependencies

Pull Request - State: closed - Opened by ankitade over 1 year ago - 3 comments
Labels: CLA Signed, Merged

#395 - Fix flava

Pull Request - State: closed - Opened by ankitade over 1 year ago
Labels: CLA Signed

#394 - [FLAVA]Can't Access ImageNet

Issue - State: closed - Opened by anyduoshuo over 1 year ago - 2 comments

#393 - Re-enable torchmultimodal's exponential distribution related test cases

Pull Request - State: closed - Opened by CaoE almost 2 years ago - 5 comments
Labels: CLA Signed, Merged

#392 - Tutorial/reference to finetune FLAVA on custom dataset

Issue - State: closed - Opened by rishabhm12 almost 2 years ago - 1 comment

#391 - Adding final layer norm to transformer fusion

Pull Request - State: closed - Opened by enmalik almost 2 years ago - 3 comments
Labels: CLA Signed, fb-exported, Merged

#390 - Incremental addition of the new modality

Issue - State: open - Opened by averkij almost 2 years ago - 2 comments

#389 - [ALBEF]upgrade pillow dependency

Pull Request - State: closed - Opened by ankitade almost 2 years ago - 2 comments
Labels: CLA Signed

#388 - [ALBEF]upgrade pillow dependency

Pull Request - State: closed - Opened by ankitade almost 2 years ago
Labels: CLA Signed

#387 - [FLAVA]change np.int to np.int64 in transforms to account for np upgrade

Pull Request - State: closed - Opened by ankitade almost 2 years ago - 2 comments
Labels: CLA Signed

#386 - ALBEF: Train from scratch

Issue - State: closed - Opened by XinhaoMei almost 2 years ago - 2 comments

#385 - Upstream text components from TorchMultimodal to TorchText

Pull Request - State: closed - Opened by andreasfloros almost 2 years ago - 3 comments
Labels: CLA Signed, fb-exported

#384 - Use CLIP models with pretrained weights

Issue - State: closed - Opened by konradkalita almost 2 years ago - 1 comment

#383 - Clip model sample training code

Issue - State: open - Opened by ShahabMokari almost 2 years ago - 3 comments

#382 - [omnivore] Using Upstreamed SwinTransformer3d in TorchVision

Pull Request - State: closed - Opened by YosuaMichael almost 2 years ago - 5 comments
Labels: enhancement, CLA Signed, Merged

#378 - Linear probing on vision tasks

Issue - State: closed - Opened by KMnP almost 2 years ago - 6 comments

#371 - Remove pretrainedMixin

Pull Request - State: closed - Opened by ankitade almost 2 years ago
Labels: CLA Signed

#370 - [FLAVA]Use the ckpt loading helper function instead of PretrainedMixin

Pull Request - State: closed - Opened by ankitade almost 2 years ago
Labels: CLA Signed

#369 - [FLAVA]Use boolean pretrained flag to load ckpts

Pull Request - State: closed - Opened by ankitade almost 2 years ago
Labels: CLA Signed

#368 - Remove pretrainedMixin

Pull Request - State: closed - Opened by ankitade almost 2 years ago - 1 comment
Labels: CLA Signed

#366 - [FLAVA]Use the ckpt loading helper function instead of PretrainedMixin

Pull Request - State: closed - Opened by ankitade almost 2 years ago - 4 comments
Labels: CLA Signed

#362 - Upgrade HF Datasets Library for Flava Example

Pull Request - State: closed - Opened by pbontrager almost 2 years ago - 4 comments
Labels: CLA Signed

#358 - [CLIP]Fix bug in resize for clip transform

Pull Request - State: closed - Opened by ankitade almost 2 years ago - 2 comments
Labels: CLA Signed

#294 - [MDETR] Add MDETR task specific tests

Pull Request - State: closed - Opened by joecummings about 2 years ago - 2 comments
Labels: CLA Signed

#279 - [BE] Migrate some tests to pytest

Pull Request - State: closed - Opened by ebsmothers about 2 years ago - 7 comments
Labels: CLA Signed

#277 - Add data_folder info to MUGEN dataset readme

Pull Request - State: closed - Opened by sophiazhi about 2 years ago - 2 comments
Labels: CLA Signed

#274 - Refactor shuffle argument in MUGENDataModule

Pull Request - State: closed - Opened by sophiazhi about 2 years ago
Labels: CLA Signed

#268 - [Unification][FLAVA] Refactor FLAVA with unified vision transformer

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 1 comment
Labels: CLA Signed

#267 - [Unification] Generalized vision transformer

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 6 comments
Labels: CLA Signed

#261 - [FLAVA] Change order of fixtures in checkpoint test

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 2 comments
Labels: CLA Signed

#250 - Migrate clip resnet encoder test to pytest

Pull Request - State: closed - Opened by sophiazhi about 2 years ago - 2 comments
Labels: CLA Signed

#242 - Revise VideoCLIP tutorial for pytorch docs

Pull Request - State: closed - Opened by sophiazhi about 2 years ago - 3 comments
Labels: CLA Signed

#241 - remove PretrainedMixin from VideoCLIP

Pull Request - State: closed - Opened by sophiazhi about 2 years ago - 2 comments
Labels: CLA Signed

#238 - [MUGEN] Add remap notebook to load VQVAE checkpoint and compare output

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 3 comments
Labels: CLA Signed

#233 - yaml config for VideoCLIP eval script

Pull Request - State: closed - Opened by sophiazhi about 2 years ago - 3 comments
Labels: CLA Signed

#212 - VideoCLIP evaluation script

Pull Request - State: closed - Opened by sophiazhi about 2 years ago - 1 comment
Labels: CLA Signed

#208 - [FLAVA] Add flava_model checkpoint and use in zero shot script

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 2 comments
Labels: CLA Signed

#174 - [ALBEF] vqa finetune

Pull Request - State: closed - Opened by katrina433 about 2 years ago - 1 comment
Labels: CLA Signed

#146 - [MDETR] Add VQA loss module

Pull Request - State: closed - Opened by ebsmothers about 2 years ago - 1 comment
Labels: CLA Signed

#145 - [Unification] Move all cnn_lstm components to examples

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 2 comments
Labels: CLA Signed

#143 - [Unification] Refactor all architectures

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 5 comments
Labels: CLA Signed

#142 - [Unification] Replace text transforms with torchtext versions

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 3 comments
Labels: CLA Signed

#141 - [MDETR] Matcher class

Pull Request - State: closed - Opened by ebsmothers about 2 years ago - 2 comments
Labels: CLA Signed

#140 - Add HF ImageNet dataset authentication to README

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 2 comments
Labels: CLA Signed

#139 - Remove datasets folder

Pull Request - State: closed - Opened by RdoubleA about 2 years ago - 1 comment
Labels: CLA Signed

#136 - Add support for loading pretrained S3D weights

Pull Request - State: closed - Opened by sophiazhi about 2 years ago - 2 comments
Labels: CLA Signed

#128 - [ALBEF] model refactoring

Pull Request - State: closed - Opened by katrina433 about 2 years ago - 4 comments
Labels: CLA Signed

#127 - Change python requirement from 3.8 to 3.7

Pull Request - State: closed - Opened by ankitade over 2 years ago - 4 comments
Labels: CLA Signed

#126 - [ALBEF] Losses

Pull Request - State: closed - Opened by katrina433 over 2 years ago - 2 comments
Labels: CLA Signed

#121 - Add MDETR losses

Pull Request - State: closed - Opened by ebsmothers over 2 years ago - 7 comments
Labels: CLA Signed

#117 - Add ckpt loading and accuracy metric to finetuning

Pull Request - State: closed - Opened by ankitade over 2 years ago
Labels: CLA Signed

#116 - [ALBEF] multimodal encoder

Pull Request - State: closed - Opened by katrina433 over 2 years ago - 2 comments
Labels: CLA Signed

#113 - [Lint] Fix mypy missing annotations

Pull Request - State: closed - Opened by RdoubleA over 2 years ago - 7 comments
Labels: CLA Signed

#108 - [Doc] Add notification for pytest migration

Pull Request - State: closed - Opened by langong347 over 2 years ago - 3 comments
Labels: CLA Signed

#100 - Add sanity tests to wheel building workflow

Pull Request - State: closed - Opened by ankitade over 2 years ago - 5 comments
Labels: CLA Signed

#99 - [ALBEF] Text Encoder

Pull Request - State: closed - Opened by katrina433 over 2 years ago - 2 comments
Labels: CLA Signed

#95 - [FLAVA] Fix flava training and finetuning

Pull Request - State: closed - Opened by ankitade over 2 years ago - 1 comment
Labels: CLA Signed

#91 - [ALBEF] vision encoder

Pull Request - State: closed - Opened by katrina433 over 2 years ago - 2 comments
Labels: CLA Signed

#83 - [FLAVA] Add 0 shot coco eval script

Pull Request - State: closed - Opened by ankitade over 2 years ago - 5 comments
Labels: CLA Signed

#63 - Cnn encoder unittest

Pull Request - State: closed - Opened by katrina433 over 2 years ago - 2 comments
Labels: CLA Signed

#58 - Add wheel building gha

Pull Request - State: closed - Opened by ankitade over 2 years ago - 1 comment
Labels: CLA Signed

#57 - Adding a MUGEN utility for permuting and implemented in codebook

Pull Request - State: closed - Opened by RdoubleA over 2 years ago - 1 comment
Labels: CLA Signed

#55 - Renamed quantization to codebook

Pull Request - State: closed - Opened by RdoubleA over 2 years ago - 1 comment
Labels: CLA Signed

#48 - Flava refactor

Pull Request - State: closed - Opened by ankitade over 2 years ago
Labels: CLA Signed

#47 - Introducing exponential moving average updates to embedding in Quantization layer

Pull Request - State: closed - Opened by RdoubleA over 2 years ago - 2 comments
Labels: CLA Signed

#44 - Fsdp trial

Pull Request - State: closed - Opened by ankitade over 2 years ago - 1 comment
Labels: CLA Signed

#42 - Move transformer classes out of flava.py into modules/layers/transformer.py

Pull Request - State: closed - Opened by RdoubleA over 2 years ago - 4 comments
Labels: CLA Signed