TransformerLensOrg/TransformerLens issues and pull requests

#536 - HookedSAETransformer

Pull Request - State: closed - Opened by ckkissane 6 months ago - 5 comments

#535 - [Proposal] Please ddd support for fine-tuned models

Issue - State: closed - Opened by jasonlim131 6 months ago - 3 comments

#534 - Bugfix: remove redundant assert checks

Pull Request - State: closed - Opened by tkukurin 6 months ago - 1 comment

#533 - updated docs to account for additional test suites

Pull Request - State: closed - Opened by bryce13950 6 months ago

#530 - [Bug Report] Demos utilizing PySvelte are not able to install

Issue - State: closed - Opened by vashchuko 6 months ago - 3 comments
Labels: demo

#524 - Remove FactoredMatrix.py<->utils.py circular dependency

Pull Request - State: open - Opened by ArthurConmy 6 months ago

#523 - [Bug Report] Residual Stack Not Adding Up

Issue - State: open - Opened by EitanGronich 6 months ago - 1 comment
Labels: documentation, demo

#522 - [Proposal] Include num_kv_heads in the Model Properties Table in the docs

Issue - State: open - Opened by neelnanda-io 7 months ago - 2 comments

#521 - Add Mixtral

Pull Request - State: closed - Opened by collingray 7 months ago - 12 comments

#520 - Fix split_qkv_input for grouped query attention

Pull Request - State: closed - Opened by wesg52 7 months ago - 1 comment

#519 - [Bug Report] split_qkv_input issues with consistency and GQA

Issue - State: closed - Opened by wesg52 7 months ago - 1 comment

#517 - [Bug Report] Issues loading Llama-2

Issue - State: open - Opened by davidquarel 7 months ago - 1 comment

#516 - chore: fixing type errors and enabling mypy

Pull Request - State: closed - Opened by chanind 7 months ago - 4 comments

#510 - Speed up !pip install transformer-lens in colab

Pull Request - State: closed - Opened by pavanyellow 8 months ago - 3 comments

#506 - [Proposal] Add support for Qwen1.5 models

Issue - State: closed - Opened by andyrdt 8 months ago - 1 comment

#505 - Refactor hook_points

Pull Request - State: closed - Opened by VasilGeorgiev39 8 months ago - 4 comments

#501 - [Draft] Support Flash Attention

Pull Request - State: open - Opened by cmathw 8 months ago - 4 comments

#497 - [Proposal] Speed up `!pip install transformer-lens` in colab

Issue - State: closed - Opened by ArthurConmy 8 months ago - 4 comments

#496 - [Proposal] Add benchmarks for error introduced by HookedTransformer

Issue - State: closed - Opened by collingray 8 months ago

#494 - Add Support for Yi-6B and Yi-34B

Pull Request - State: closed - Opened by collingray 8 months ago

#493 - Construct causal mask on-the-fly

Pull Request - State: closed - Opened by andyrdt 8 months ago - 8 comments

#488 - add optional arguments to make sure generate() works without tokenizer being defined

Pull Request - State: closed - Opened by JackCai1206 8 months ago - 1 comment

#486 - Loading of huggingface 4-bit quantized Llama

Pull Request - State: closed - Opened by coolvision 9 months ago - 9 comments

#481 - [Bug Report] Demo for Tracr to TransformerLens is kind of broken

Issue - State: open - Opened by FlyingPumba 9 months ago
Labels: bug, demo

#480 - [Question] load_state_dict: copy vs assign

Issue - State: open - Opened by coolvision 9 months ago - 3 comments

#474 - [Bug Report] Slack link is expired

Issue - State: open - Opened by Aryan-Deshpande 9 months ago - 1 comment

#473 - Make `tokenize_and_concatenate` work with more datasets

Pull Request - State: open - Opened by ArthurConmy 9 months ago
Labels: enhancement

#472 - [Bug Report] `ActivationCache.apply_ln_to_stack` silently returns the resid stack for unsupported normalization types

Issue - State: closed - Opened by jmsdao 9 months ago - 1 comment

#471 - [Proposal] Support Mixtral

Issue - State: closed - Opened by neelnanda-io 10 months ago - 9 comments
Labels: enhancement, help wanted

#466 - (Draft) Add DLA function to utils

Pull Request - State: open - Opened by VasilGeorgiev39 10 months ago - 5 comments

#465 - Add pos_slice to run_with_cache

Pull Request - State: closed - Opened by VasilGeorgiev39 10 months ago - 3 comments

#464 - Draft PR: add Pyright static typing to hook_points.py

Pull Request - State: closed - Opened by starship006 10 months ago - 6 comments

#452 - Refactor components

Pull Request - State: closed - Opened by bryce13950 11 months ago - 3 comments

#446 - [Bug fix] GatedMLP not in docs. issue #264 [bug report]

Pull Request - State: closed - Opened by danlaudk 11 months ago - 1 comment

#375 - Fix to include ln_final.w in RMSNorm hook

Pull Request - State: closed - Opened by clarenceluo78 about 1 year ago - 5 comments
Labels: no-rebase

#258 - [Proposal] Support BERT Model Series (and/or T5).

Issue - State: closed - Opened by jbloomAus over 1 year ago - 16 comments

#207 - [Bug Report] Can't add hook to pretrained model: AssertionError: Cannot add hook blocks.0.hook_q_input if use_split_qkv_input is False

Issue - State: open - Opened by jbloomAus over 1 year ago - 4 comments
Labels: bug, help wanted

#111 - Add a demo of direct path patching

Issue - State: open - Opened by neelnanda-io almost 2 years ago - 3 comments
Labels: help wanted, demo

#97 - Better docs for model properties

Issue - State: open - Opened by neelnanda-io almost 2 years ago - 5 comments
Labels: documentation, help wanted, good first issue

#94 - Add support for T5

Issue - State: closed - Opened by neelnanda-io almost 2 years ago
Labels: enhancement, help wanted, new-architecture

#84 - Add automatic notebook generation

Issue - State: closed - Opened by ArthurConmy almost 2 years ago - 6 comments
Labels: enhancement, good first issue

GitHub / TransformerLensOrg/TransformerLens issues and pull requests