microsoft/LLMLingua issues and pull requests

#193 - [Question]: Reproduce end2end latency results of LLMLingua-2

Issue - State: open - Opened by cornzz 19 days ago
Labels: question

#192 - [Bug]: Certificate of llmlingua.com expired

Issue - State: closed - Opened by cornzz 20 days ago - 1 comment
Labels: bug

#191 - [Question]: Reproduction of Big Bench Hard with LLMLingua-2

Issue - State: open - Opened by cornzz 26 days ago - 4 comments
Labels: question

#190 - [Question]: 在生成摘要的任务，是如何进行压缩的？

Issue - State: open - Opened by dongziyu1016 about 1 month ago - 2 comments
Labels: question

#189 - [BUG] Code That Seems Pointless

Issue - State: closed - Opened by ryan-minato about 1 month ago - 1 comment
Labels: question

#188 - [Question]: QA evaluation on chat (instruct) models

Issue - State: closed - Opened by cornzz about 1 month ago - 1 comment
Labels: question

#186 - [Question]: ZeroScrolls reproduction

Issue - State: closed - Opened by cornzz about 1 month ago - 2 comments
Labels: question

#185 - what is 1-shot / half-shot /quarter-shot constraint in experiments？

Issue - State: open - Opened by 21-10-4 about 2 months ago - 6 comments
Labels: question

#184 - [Feature Request]: Instructions how to use metal backend (Apple silicon)

Issue - State: closed - Opened by do-me about 2 months ago - 2 comments
Labels: feature request

#183 - [Bug]: ZeroDivisionError: float division by zero upon using compress_json with `use_llmlingua2`

Issue - State: open - Opened by r4881t about 2 months ago - 1 comment
Labels: bug

#182 - Fix wrong special tokens being used for llmlingua-2

Pull Request - State: open - Opened by cornzz about 2 months ago - 1 comment

#181 - [Bug]: LLMLingua-2 uses wrong special tokens by default

Issue - State: open - Opened by cornzz about 2 months ago - 1 comment
Labels: bug

#180 - [Question]: Is npu supported？

Issue - State: closed - Opened by qiling1345 2 months ago
Labels: question

#179 - [Bug]: 'NoneType' object cannot be interpreted as an integer

Issue - State: closed - Opened by qiling1345 2 months ago
Labels: bug

#178 - [Bug]: Promptflow tool fails with Run failed: KeyError: 0

Issue - State: open - Opened by chris-chatsi 2 months ago - 1 comment
Labels: bug

#177 - [Bug]: Had to make a number of changes to example (examples/RAGLlamaIndex.ipynb)

Issue - State: open - Opened by botchagalupeai 3 months ago
Labels: bug

#176 - Feature(LLMLingua): update ACL links

Pull Request - State: closed - Opened by iofu728 3 months ago
Labels: documentation

#175 - How can I speed up using llmlingua2 ?

Issue - State: open - Opened by yyjabiding 3 months ago - 1 comment
Labels: question

#174 - [Question]: LLMLingua-2 Sample-Wise Dynamic Compression Ratio

Issue - State: open - Opened by cornzz 3 months ago - 2 comments
Labels: question

#173 - [Question]: cannot import name 'PromptCompressor' from partially initialized module 'llmlingua'

Issue - State: closed - Opened by jiapingW 3 months ago - 1 comment
Labels: question

#172 - [Question]: How to utilize compression to a finetuned LLM?

Issue - State: open - Opened by LiuZhihhxx 3 months ago - 1 comment
Labels: question

#171 - [Question]: Fail to reproduce llmlingua on meetingbank

Issue - State: open - Opened by jzhang538 4 months ago - 1 comment
Labels: question

#170 - [Question]: How to get `meetingbank_test_3qa_pairs_summary_formated.json`?

Issue - State: open - Opened by mzf666 4 months ago - 2 comments
Labels: question

#169 - [Question]: Is It Possible to Share the Code how to Do the evaluation

Issue - State: open - Opened by ZhichaoWang970201 4 months ago - 3 comments
Labels: question

#168 - [Bug]: NotImplementedError

Issue - State: open - Opened by isAXuan 4 months ago - 3 comments
Labels: bug

#166 - Feature(LLMLingua): add MInference News

Pull Request - State: closed - Opened by iofu728 4 months ago
Labels: documentation

#165 - [Question]: Token indices sequence length is longer than the specified maximum sequence length for this model (614 > 512). Running this sequence through the model will result in indexing errors

Issue - State: open - Opened by lifengyu2005 5 months ago - 2 comments
Labels: question

#164 - Experiments[Question]:

Issue - State: closed - Opened by 520zw 5 months ago - 3 comments
Labels: question

#163 - [Question]: longbench数据集测试对context和question的压缩

Issue - State: open - Opened by Diana303068 5 months ago - 2 comments
Labels: question

#162 - [Question]: How to combine longllmlingua and llmlingua2 ?

Issue - State: open - Opened by qminh369 5 months ago - 1 comment
Labels: question

#161 - [Question]: LongBench BM25 reproduce

Issue - State: open - Opened by JUNE515 5 months ago - 3 comments
Labels: question

#160 - Feature(LLMLingua-2): update the meetingbank datasets

Pull Request - State: closed - Opened by iofu728 5 months ago
Labels: documentation, feature

#159 - [Feature Request]: How to improve the accuracy of compressor for large SFT models through training

Issue - State: open - Opened by dingjingzhen 6 months ago - 1 comment
Labels: feature request

#158 - update news of Prompt flow integration

Pull Request - State: closed - Opened by SiyunZhao 6 months ago
Labels: documentation

#157 - Correct misspelled word in README.md.

Pull Request - State: closed - Opened by Ray0907 6 months ago - 1 comment

#156 - [Question]: Reproducing the score of official microsoft/llmlingua-2-xlm-roberta-large-meetingbank

Issue - State: open - Opened by xvyaward 6 months ago - 6 comments
Labels: question

#155 - [Question]: Reproduce LLMLingua-2 results with Mistral-7B

Issue - State: open - Opened by xvyaward 6 months ago - 4 comments
Labels: question

#154 - Feature(LLMLingua): update the paper information

Pull Request - State: closed - Opened by iofu728 6 months ago
Labels: documentation

#153 - Troubleshooting Issues in LlamaIndex RAG Demo after Updating to Version 0.10

Issue - State: closed - Opened by 190679163 6 months ago
Labels: bug

#152 - [Bug]: 返回中文会出现乱码

Issue - State: open - Opened by CEfanmin 6 months ago - 2 comments
Labels: bug

#151 - raito -> rate in README example

Pull Request - State: closed - Opened by GRcharles 6 months ago - 1 comment
Labels: documentation

#150 - [Feature Request]: Lingua2 can discards tokens based on a probability threshold

Issue - State: open - Opened by Meguminnnnnnnn 6 months ago - 1 comment
Labels: feature request

#149 - Meaningless tokens generation

Issue - State: open - Opened by aravindpai 6 months ago - 3 comments
Labels: question

#148 - [bug]: Can not use local model as input

Issue - State: closed - Opened by zjcDM 6 months ago - 2 comments
Labels: bug

#147 - [Question]: LLMLingua requires too much GPU memory, and it takes a lot of time to compress long text, such as 16k, etc. How to make it and LLM work at the same time

Issue - State: open - Opened by dingjingzhen 6 months ago - 2 comments
Labels: question

#146 - [Question]: Reproduce LLMLingua-2 on the LongBench SingleDoc dataset

Issue - State: open - Opened by 56wangyun 6 months ago - 2 comments
Labels: question

#145 - [Bug]: Calculate `n_original_tokens` Correctly in `compress_prompt_llmlingua2`

Pull Request - State: closed - Opened by WaelKarkoub 6 months ago

#144 - [Bug]: `n_original_token` might not be set correctly for `compress_prompt_llmlingua2`

Issue - State: closed - Opened by WaelKarkoub 6 months ago - 1 comment
Labels: bug

#142 - Docs: correct default value of 'use_llmlingua2'

Pull Request - State: closed - Opened by kexplo 6 months ago - 1 comment
Labels: documentation

#141 - [Question]: How does the token-level question-aware compression work?

Issue - State: closed - Opened by acnagle 6 months ago - 1 comment
Labels: question

#140 - fix wrong keyword argument in LLMLingua2.ipynb

Pull Request - State: closed - Opened by gmaliar 6 months ago - 1 comment
Labels: documentation

#139 - Fix(LLMLingua): fix the assert issue due to tokenization

Pull Request - State: closed - Opened by SiyunZhao 7 months ago

#138 - [Question]: How to compress a simple prompt on mac

Issue - State: closed - Opened by vanillacandy 7 months ago - 1 comment
Labels: question

#137 - [Bug]: AssertionError when executing Code.ipynb

Issue - State: closed - Opened by maxcccc 7 months ago - 3 comments
Labels: bug

#136 - [Question]: Reproduce LongLLMLingua on the LongBench MultiDoc dataset

Issue - State: open - Opened by Liangyx2 7 months ago - 3 comments
Labels: question

#135 - [Question]: When I changed the target token, the code reported an error

Issue - State: open - Opened by macheng6 7 months ago - 1 comment
Labels: bug, question

#132 - [Feature Request]: Docker service support

Issue - State: closed - Opened by eav-solution 7 months ago - 1 comment
Labels: feature request

#132 - [Feature Request]: Docker service support

Issue - State: closed - Opened by eav-solution 7 months ago - 1 comment
Labels: feature request

#131 - [Bug]: When I use Chinese prompt, the compressed prompt has extra spaces.

Issue - State: open - Opened by saucebing 7 months ago - 1 comment
Labels: bug

#130 - Prereleased(LLMLinguia): fix the chuck issue and prepare for v0.2.2

Pull Request - State: closed - Opened by iofu728 7 months ago
Labels: bug

#130 - Prereleased(LLMLinguia): fix the chuck issue and prepare for v0.2.2

Pull Request - State: closed - Opened by iofu728 7 months ago
Labels: bug

#128 - [Question]: LLMLingua2 query condition and dynamic ratio

Issue - State: open - Opened by DomStan 7 months ago - 1 comment
Labels: feature request, question

#127 - [Question]: reproducing LongLLMLingua on the LongBench dataset.

Issue - State: open - Opened by junepark1 7 months ago - 1 comment
Labels: question

#126 - [Question]: Markdown table compression

Issue - State: closed - Opened by ZhexuanZhou 7 months ago - 1 comment
Labels: question

#125 - [Question]: How to use a manually downloaded model

Issue - State: open - Opened by Dorish 7 months ago - 5 comments
Labels: question

#123 - [Question]: Difficulty Reproducing Results in CoT.ipynb

Issue - State: open - Opened by ushakov 8 months ago - 4 comments
Labels: question

#122 - Fix(LLMLingua-2): fix the chunk max seq

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: bug

#122 - Fix(LLMLingua-2): fix the chunk max seq

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: bug

#121 - [Question]: is it possible to use PromptCompressor without GPU?

Issue - State: closed - Opened by josephykwang 8 months ago - 1 comment
Labels: question

#121 - [Question]: is it possible to use PromptCompressor without GPU?

Issue - State: closed - Opened by josephykwang 8 months ago - 1 comment
Labels: question

#120 - add feature: compress_json

Pull Request - State: closed - Opened by SiyunZhao 8 months ago
Labels: documentation, feature

#120 - add feature: compress_json

Pull Request - State: closed - Opened by SiyunZhao 8 months ago
Labels: documentation, feature

#119 - [Question]: LLMLingua1 code

Issue - State: open - Opened by lqcStar 8 months ago - 1 comment
Labels: question

#118 - [Question]: Support for Aleph Alpha Luminous Models via API

Issue - State: open - Opened by ulan-yisaev 8 months ago - 3 comments
Labels: question

#117 - Feature(LLMLingua-2): fix the title

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: documentation

#116 - [Question] Compressor fine-tune

Issue - State: open - Opened by alexandreteles 8 months ago - 1 comment
Labels: question

#115 - Prevent duplicate `torch_dtype` kwargs

Pull Request - State: closed - Opened by yasyf 8 months ago - 1 comment
Labels: bug

#114 - [Bug]: structured_compress_prompt not working correctly with LLMLingua2

Issue - State: open - Opened by soumyaamazon 8 months ago - 4 comments
Labels: feature request

#113 - [Question]: LongLLMLingua vs. LLMLingua2 for chatbot history compression

Issue - State: closed - Opened by DomStan 8 months ago - 1 comment
Labels: question

#113 - [Question]: LongLLMLingua vs. LLMLingua2 for chatbot history compression

Issue - State: closed - Opened by DomStan 8 months ago - 1 comment
Labels: question

#112 - Feature(LLMLingua-2): update paper link

Pull Request - State: closed - Opened by iofu728 8 months ago - 1 comment
Labels: documentation

#111 - Feature(LLMLingua-2): add LLMLingua-2

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: documentation, feature

#111 - Feature(LLMLingua-2): add LLMLingua-2

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: documentation, feature

#110 - version 0.2.1 iteration plan

Issue - State: closed - Opened by iofu728 8 months ago - 1 comment
Labels: documentation, feature, iteration plan

#110 - version 0.2.1 iteration plan

Issue - State: closed - Opened by iofu728 8 months ago - 1 comment
Labels: documentation, feature, iteration plan

#109 - Release(LLMLingua): release v0.2.0

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: documentation, style

#109 - Release(LLMLingua): release v0.2.0

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: documentation, style

#108 - Fix(LLMLingua): fix the release workflow

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: bug

#107 - Fix(LLMLingua): fix the release workflows

Pull Request - State: closed - Opened by iofu728 8 months ago
Labels: bug

#106 - [Question]: access to public storage https://openaipublic.blob.core.windows.net/ is prohibited in secure environments ,

Issue - State: open - Opened by amrosalehms 8 months ago - 3 comments
Labels: question

#106 - [Question]: access to public storage https://openaipublic.blob.core.windows.net/ is prohibited in secure environments ,

Issue - State: open - Opened by amrosalehms 8 months ago - 3 comments
Labels: question

#105 - [Question]: How to only compress documents in the RAG setting?

Issue - State: closed - Opened by Hannibal046 8 months ago - 1 comment
Labels: question

#105 - [Question]: How to only compress documents in the RAG setting?

Issue - State: closed - Opened by Hannibal046 8 months ago - 1 comment
Labels: question

#104 - [Bug]: Compression truncates words and sentences

Issue - State: open - Opened by younes-io 8 months ago - 3 comments
Labels: bug

#104 - [Bug]: Compression truncates words and sentences

Issue - State: closed - Opened by younes-io 8 months ago - 3 comments
Labels: bug

#103 - [Question]: Incorrect `condition_mode` parameter value in `get_condition_ppl` function

Issue - State: closed - Opened by charloco 8 months ago - 2 comments
Labels: question

#103 - [Question]: Incorrect `condition_mode` parameter value in `get_condition_ppl` function

Issue - State: closed - Opened by charloco 8 months ago - 2 comments
Labels: question

#102 - fix sentence-filter adding separator bug and add document

Pull Request - State: closed - Opened by SiyunZhao 8 months ago
Labels: documentation, feature

#102 - fix sentence-filter adding separator bug and add document

Pull Request - State: closed - Opened by SiyunZhao 8 months ago
Labels: documentation, feature

#101 - [Feature Request]: Token compression using GPT-3.5-turbo

Issue - State: open - Opened by ohdearquant 8 months ago - 3 comments
Labels: feature request

GitHub / microsoft/LLMLingua issues and pull requests