Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / neuralmagic/deepsparse issues and pull requests

#1379 - Update sentence_transformer.py with batched padding

Pull Request - State: closed - Opened by mgoin 11 months ago

#1378 - Add hf: stub support to model_to_path

Pull Request - State: closed - Opened by mgoin 11 months ago

#1377 - [Fix] The benchmark logic when internal kv cache is involved

Pull Request - State: closed - Opened by dbogunowicz 11 months ago

#1375 - [ContinuousBatching] ContinuousBatchingScheduler Implementation

Pull Request - State: closed - Opened by bfineran 11 months ago - 2 comments

#1372 - Assertion `!cache_sizes.empty()' failed

Issue - State: closed - Opened by akarym-sl 11 months ago - 2 comments
Labels: bug

#1371 - [v2] EngineOperator updates to make continuous batching easier

Pull Request - State: closed - Opened by bfineran 11 months ago

#1370 - [Pipeline Refactor][Text-Generation] Simplify `DecoderKVCache`

Pull Request - State: closed - Opened by dbogunowicz 11 months ago - 1 comment

#1369 - Research: 4-bit quantization

Issue - State: closed - Opened by truenorth8 11 months ago - 5 comments
Labels: enhancement

#1368 - update datasets version

Pull Request - State: closed - Opened by Satrat 11 months ago

#1367 - Add straggler log to debug from onnx.py

Pull Request - State: closed - Opened by mgoin 11 months ago

#1366 - Update openai.md config

Pull Request - State: closed - Opened by mgoin 11 months ago

#1363 - [WiP] Working on few improvements for v2 LLM pipeline

Pull Request - State: closed - Opened by dbogunowicz 11 months ago

#1362 - Updated Contributors Section in readme.md

Pull Request - State: closed - Opened by mohitd404 11 months ago

#1361 - Adding Contributors Section to readme.md

Issue - State: closed - Opened by mohitd404 11 months ago - 1 comment
Labels: documentation

#1360 - https://www.therapyinsightspractice.com

Issue - State: closed - Opened by Mjsmiles23 11 months ago - 1 comment
Labels: enhancement

#1359 - timer

Pull Request - State: closed - Opened by horheynm 11 months ago - 2 comments

#1358 - [Pipeline Refactor] Feature branch for v2 text-generation

Pull Request - State: closed - Opened by dsikka 11 months ago

#1357 - Enable preparing nested OutputSchemas for serialization

Pull Request - State: closed - Opened by dbogunowicz 11 months ago

#1355 - added comments like u said in the test_twitter_nlp.py

Pull Request - State: closed - Opened by bhargavshirin 11 months ago - 1 comment

#1354 - [text generation] fix issues with top_p

Pull Request - State: closed - Opened by bfineran 11 months ago

#1353 - Move inplace shape override log to debug

Pull Request - State: closed - Opened by mgoin 11 months ago

#1352 - README.md

Pull Request - State: closed - Opened by RS-labhub 11 months ago

#1351 - [Fix] Bring back `model.deployment_directory_path`

Pull Request - State: closed - Opened by dbogunowicz 11 months ago

#1350 - Update torch to 2.1

Pull Request - State: closed - Opened by mgoin 11 months ago

#1349 - Grrrrrrr

Issue - State: closed - Opened by WeurnomboTroc 11 months ago - 3 comments

#1347 - Add colab to sentence transformers

Pull Request - State: closed - Opened by mgoin 11 months ago

#1344 - Fix csv export not exporting kernel shapes

Pull Request - State: closed - Opened by LucasWilkinson 11 months ago

#1343 - optimized test_twitter_nlp.py

Pull Request - State: closed - Opened by bhargavshirin 11 months ago - 2 comments

#1342 - Update GenerationDefaults and comments

Pull Request - State: closed - Opened by mgoin 11 months ago

#1341 - Segmentation fault (core dumped)

Issue - State: closed - Opened by Mahran-xo 11 months ago - 6 comments
Labels: bug

#1340 - Fix typo in deepsparse-readme.md

Pull Request - State: closed - Opened by eltociear 11 months ago

#1339 - Does he support stable diffusion or fooocus, or other image generation acceleration?

Issue - State: closed - Opened by libai-lab 11 months ago - 1 comment
Labels: enhancement

#1338 - Update workflow image on README.md

Pull Request - State: closed - Opened by mgoin 12 months ago

#1336 - Add internal kv cache by default to analysis

Pull Request - State: closed - Opened by mgoin 12 months ago

#1335 - [deepsparse.benchmark] enable internal kv cache by default

Pull Request - State: closed - Opened by bfineran 12 months ago

#1334 - Add bucketing to DeepSparseSentenceTransformer

Pull Request - State: closed - Opened by mgoin 12 months ago

#1333 - [local-install-check.yaml] install sparsezoo from src

Pull Request - State: closed - Opened by bfineran 12 months ago

#1332 - [Text Generation] Fail if `prompt_sequence_length % 4 != 0`

Pull Request - State: closed - Opened by dbogunowicz 12 months ago

#1331 - Fix typo in sentiment analysis HTTP client example

Pull Request - State: closed - Opened by dbarbuzzi 12 months ago

#1330 - [LLM Tests] Additional tests for non-kv cache support

Pull Request - State: closed - Opened by dbogunowicz 12 months ago

#1329 - Paper: New algorithm for pruning

Issue - State: closed - Opened by gottlike 12 months ago - 3 comments
Labels: enhancement

#1327 - [update] Description of `multi_class` attribute

Pull Request - State: closed - Opened by rahul-tuli 12 months ago
Labels: mle-team

#1324 - [LLM Tests] Config support for LLM test suite / enable test suite in GHA

Pull Request - State: closed - Opened by dbogunowicz 12 months ago - 1 comment

#1323 - Update setup.py to include python 3.11

Pull Request - State: closed - Opened by mgoin 12 months ago

#1322 - Support for Llama2?

Issue - State: closed - Opened by BDHU 12 months ago - 2 comments

#1321 - [feature] Support `Python3.11`

Pull Request - State: closed - Opened by rahul-tuli 12 months ago

#1320 - Update integration-langchain.md

Pull Request - State: closed - Opened by mwitiderrick 12 months ago

#1319 - Add LLM gif to README.md

Pull Request - State: closed - Opened by mgoin 12 months ago

#1318 - download compressed deployment directory

Pull Request - State: closed - Opened by bfineran 12 months ago

#1317 - Fix server endpoints in README

Pull Request - State: closed - Opened by mgoin 12 months ago

#1316 - Update README.md

Pull Request - State: closed - Opened by rsnm2 12 months ago

#1315 - Readme update

Pull Request - State: closed - Opened by rsnm2 12 months ago

#1314 - Update text-generation-pipeline.md

Pull Request - State: closed - Opened by rsnm2 12 months ago

#1313 - Llm docs 2

Pull Request - State: closed - Opened by rsnm2 12 months ago

#1312 - Update README.md for LLMs

Pull Request - State: closed - Opened by mgoin 12 months ago

#1311 - [server] Fix tests + allow server to parse generation kwargs

Pull Request - State: closed - Opened by dsikka 12 months ago

#1310 - Documentation for LangChain integration

Pull Request - State: closed - Opened by mgoin 12 months ago

#1309 - [server] Update docs + add openai docs

Pull Request - State: closed - Opened by dsikka 12 months ago

#1308 - [deepsparse.benchmark] enable benchmarking internal kv cache

Pull Request - State: open - Opened by bfineran 12 months ago

#1308 - [deepsparse.benchmark] enable benchmarking internal kv cache

Pull Request - State: closed - Opened by bfineran 12 months ago

#1308 - [deepsparse.benchmark] enable benchmarking internal kv cache

Pull Request - State: open - Opened by bfineran 12 months ago

#1307 - Add support for pulling down ARM and MacOS artifacts

Pull Request - State: closed - Opened by mgoin 12 months ago

#1307 - Add support for pulling down ARM and MacOS artifacts

Pull Request - State: open - Opened by mgoin 12 months ago

#1306 - Fixes for GHA quality

Pull Request - State: closed - Opened by mgoin 12 months ago

#1306 - Fixes for GHA quality

Pull Request - State: closed - Opened by mgoin 12 months ago

#1306 - Fixes for GHA quality

Pull Request - State: closed - Opened by mgoin 12 months ago

#1305 - Add basic LLM docs

Pull Request - State: closed - Opened by mgoin 12 months ago

#1305 - Add basic LLM docs

Pull Request - State: closed - Opened by mgoin 12 months ago

#1305 - Add basic LLM docs

Pull Request - State: closed - Opened by mgoin 12 months ago

#1304 - Add `deepsparse[llm]` extras alias

Pull Request - State: closed - Opened by mgoin 12 months ago

#1304 - Add `deepsparse[llm]` extras alias

Pull Request - State: closed - Opened by mgoin 12 months ago

#1302 - Change to requiring the vanilla transformers package

Pull Request - State: closed - Opened by mgoin 12 months ago - 2 comments

#1300 - [server] Update OpenAI Model Support

Pull Request - State: closed - Opened by dsikka 12 months ago

#1299 - Decrease prompt_sequence_length default to 16

Pull Request - State: closed - Opened by mgoin 12 months ago

#1298 - Make `Pipeline` printable

Pull Request - State: closed - Opened by mgoin 12 months ago

#1297 - Llm docs

Pull Request - State: closed - Opened by rsnm2 12 months ago

#1296 - [bugfix] model_to_path should also download .data files from zoo

Pull Request - State: closed - Opened by bfineran 12 months ago

#1295 - Make `generate_random_inputs` use zeros for integers

Pull Request - State: closed - Opened by mgoin 12 months ago

#1294 - [TextGeneration][Bug] Fix timer

Pull Request - State: closed - Opened by dsikka 12 months ago

#1293 - Revert #1263

Pull Request - State: closed - Opened by SageMoore 12 months ago

#1291 - fix top_p bug

Pull Request - State: closed - Opened by horheynm 12 months ago

#1290 - remove NM_ALLOW_DARWIN

Pull Request - State: closed - Opened by andy-neuma 12 months ago

#1289 - Set text-generation default values to match performance and UX needs

Pull Request - State: closed - Opened by mgoin about 1 year ago

#1288 - [server] Refactor + OpenAI Chat Completion Support

Pull Request - State: closed - Opened by dsikka about 1 year ago - 1 comment