Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / neuralmagic/deepsparse issues and pull requests
#1379 - Update sentence_transformer.py with batched padding
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1378 - Add hf: stub support to model_to_path
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1377 - [Fix] The benchmark logic when internal kv cache is involved
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
#1376 - [Cherry Pick] Enable preparing nested OutputSchemas for serialization (#1357)
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
#1375 - [ContinuousBatching] ContinuousBatchingScheduler Implementation
Pull Request -
State: closed - Opened by bfineran 11 months ago
- 2 comments
#1374 - [Continuous Batching] Executor thread for running continuous batching
Pull Request -
State: closed - Opened by bfineran 11 months ago
#1373 - [Continuous Batching] Queue Implementation to support batching grouping and prioritization
Pull Request -
State: closed - Opened by bfineran 11 months ago
#1372 - Assertion `!cache_sizes.empty()' failed
Issue -
State: closed - Opened by akarym-sl 11 months ago
- 2 comments
Labels: bug
#1371 - [v2] EngineOperator updates to make continuous batching easier
Pull Request -
State: closed - Opened by bfineran 11 months ago
#1370 - [Pipeline Refactor][Text-Generation] Simplify `DecoderKVCache`
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
- 1 comment
#1369 - Research: 4-bit quantization
Issue -
State: closed - Opened by truenorth8 11 months ago
- 5 comments
Labels: enhancement
#1368 - update datasets version
Pull Request -
State: closed - Opened by Satrat 11 months ago
#1367 - Add straggler log to debug from onnx.py
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1366 - Update openai.md config
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1365 - [Pipeline Refactor][Text-Generation][No KV Cache Pipeline] Prepare scaffolding for no-kv cache pipeline
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
#1364 - [Pipeline Refactor][Text-Generation] Create a helper function for creating engine_inputs
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
- 1 comment
#1363 - [WiP] Working on few improvements for v2 LLM pipeline
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
#1362 - Updated Contributors Section in readme.md
Pull Request -
State: closed - Opened by mohitd404 11 months ago
#1361 - Adding Contributors Section to readme.md
Issue -
State: closed - Opened by mohitd404 11 months ago
- 1 comment
Labels: documentation
#1360 - https://www.therapyinsightspractice.com
Issue -
State: closed - Opened by Mjsmiles23 11 months ago
- 1 comment
Labels: enhancement
#1359 - timer
Pull Request -
State: closed - Opened by horheynm 11 months ago
- 2 comments
#1358 - [Pipeline Refactor] Feature branch for v2 text-generation
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1357 - Enable preparing nested OutputSchemas for serialization
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
#1356 - [Pipeline Refactor] Additional Operators, Route update and completed generation functionality
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1355 - added comments like u said in the test_twitter_nlp.py
Pull Request -
State: closed - Opened by bhargavshirin 11 months ago
- 1 comment
#1354 - [text generation] fix issues with top_p
Pull Request -
State: closed - Opened by bfineran 11 months ago
#1353 - Move inplace shape override log to debug
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1352 - README.md
Pull Request -
State: closed - Opened by RS-labhub 11 months ago
#1351 - [Fix] Bring back `model.deployment_directory_path`
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
#1350 - Update torch to 2.1
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1349 - Grrrrrrr
Issue -
State: closed - Opened by WeurnomboTroc 11 months ago
- 3 comments
#1348 - [Pipeline Refactor] Update routes, text generation initial functionality
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1347 - Add colab to sentence transformers
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1344 - Fix csv export not exporting kernel shapes
Pull Request -
State: closed - Opened by LucasWilkinson 11 months ago
#1343 - optimized test_twitter_nlp.py
Pull Request -
State: closed - Opened by bhargavshirin 11 months ago
- 2 comments
#1342 - Update GenerationDefaults and comments
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1341 - Segmentation fault (core dumped)
Issue -
State: closed - Opened by Mahran-xo 11 months ago
- 6 comments
Labels: bug
#1340 - Fix typo in deepsparse-readme.md
Pull Request -
State: closed - Opened by eltociear 11 months ago
#1339 - Does he support stable diffusion or fooocus, or other image generation acceleration?
Issue -
State: closed - Opened by libai-lab 11 months ago
- 1 comment
Labels: enhancement
#1338 - Update workflow image on README.md
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1337 - [Fix] Remove erronous LIB.kv_cache input when using external kv cache management
Pull Request -
State: closed - Opened by dbogunowicz 12 months ago
#1336 - Add internal kv cache by default to analysis
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1335 - [deepsparse.benchmark] enable internal kv cache by default
Pull Request -
State: closed - Opened by bfineran 12 months ago
#1334 - Add bucketing to DeepSparseSentenceTransformer
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1333 - [local-install-check.yaml] install sparsezoo from src
Pull Request -
State: closed - Opened by bfineran 12 months ago
#1332 - [Text Generation] Fail if `prompt_sequence_length % 4 != 0`
Pull Request -
State: closed - Opened by dbogunowicz 12 months ago
#1331 - Fix typo in sentiment analysis HTTP client example
Pull Request -
State: closed - Opened by dbarbuzzi 12 months ago
#1330 - [LLM Tests] Additional tests for non-kv cache support
Pull Request -
State: closed - Opened by dbogunowicz 12 months ago
#1329 - Paper: New algorithm for pruning
Issue -
State: closed - Opened by gottlike 12 months ago
- 3 comments
Labels: enhancement
#1328 - [Fix][Text Generation] Fix the. outdated non-kv cache inference pathway
Pull Request -
State: closed - Opened by dbogunowicz 12 months ago
#1327 - [update] Description of `multi_class` attribute
Pull Request -
State: closed - Opened by rahul-tuli 12 months ago
Labels: mle-team
#1326 - [TextGeneration] Update logic for determining the max tokens generated
Pull Request -
State: closed - Opened by dsikka 12 months ago
#1325 - [Pipeline Refactor] Additional functionality, engine operator, linear router and image classification pipeline/operators/example
Pull Request -
State: closed - Opened by dsikka 12 months ago
#1324 - [LLM Tests] Config support for LLM test suite / enable test suite in GHA
Pull Request -
State: closed - Opened by dbogunowicz 12 months ago
- 1 comment
#1323 - Update setup.py to include python 3.11
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1322 - Support for Llama2?
Issue -
State: closed - Opened by BDHU 12 months ago
- 2 comments
#1321 - [feature] Support `Python3.11`
Pull Request -
State: closed - Opened by rahul-tuli 12 months ago
#1320 - Update integration-langchain.md
Pull Request -
State: closed - Opened by mwitiderrick 12 months ago
#1319 - Add LLM gif to README.md
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1318 - download compressed deployment directory
Pull Request -
State: closed - Opened by bfineran 12 months ago
#1317 - Fix server endpoints in README
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1316 - Update README.md
Pull Request -
State: closed - Opened by rsnm2 12 months ago
#1315 - Readme update
Pull Request -
State: closed - Opened by rsnm2 12 months ago
#1314 - Update text-generation-pipeline.md
Pull Request -
State: closed - Opened by rsnm2 12 months ago
#1313 - Llm docs 2
Pull Request -
State: closed - Opened by rsnm2 12 months ago
#1312 - Update README.md for LLMs
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1311 - [server] Fix tests + allow server to parse generation kwargs
Pull Request -
State: closed - Opened by dsikka 12 months ago
#1310 - Documentation for LangChain integration
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1309 - [server] Update docs + add openai docs
Pull Request -
State: closed - Opened by dsikka 12 months ago
#1308 - [deepsparse.benchmark] enable benchmarking internal kv cache
Pull Request -
State: open - Opened by bfineran 12 months ago
#1308 - [deepsparse.benchmark] enable benchmarking internal kv cache
Pull Request -
State: closed - Opened by bfineran 12 months ago
#1308 - [deepsparse.benchmark] enable benchmarking internal kv cache
Pull Request -
State: open - Opened by bfineran 12 months ago
#1307 - Add support for pulling down ARM and MacOS artifacts
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1307 - Add support for pulling down ARM and MacOS artifacts
Pull Request -
State: open - Opened by mgoin 12 months ago
#1306 - Fixes for GHA quality
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1306 - Fixes for GHA quality
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1306 - Fixes for GHA quality
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1305 - Add basic LLM docs
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1305 - Add basic LLM docs
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1305 - Add basic LLM docs
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1304 - Add `deepsparse[llm]` extras alias
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1304 - Add `deepsparse[llm]` extras alias
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1303 - [bugfix] enforce that all transformer deployement files are downloaded by pipeline
Pull Request -
State: closed - Opened by bfineran 12 months ago
#1303 - [bugfix] enforce that all transformer deployement files are downloaded by pipeline
Pull Request -
State: closed - Opened by bfineran 12 months ago
#1303 - [bugfix] enforce that all transformer deployement files are downloaded by pipeline
Pull Request -
State: closed - Opened by bfineran 12 months ago
#1302 - Change to requiring the vanilla transformers package
Pull Request -
State: closed - Opened by mgoin 12 months ago
- 2 comments
#1301 - Support for SentenceTransformers with `deepsparse.sentence_transformers.SentenceTransformer`
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1300 - [server] Update OpenAI Model Support
Pull Request -
State: closed - Opened by dsikka 12 months ago
#1299 - Decrease prompt_sequence_length default to 16
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1298 - Make `Pipeline` printable
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1297 - Llm docs
Pull Request -
State: closed - Opened by rsnm2 12 months ago
#1296 - [bugfix] model_to_path should also download .data files from zoo
Pull Request -
State: closed - Opened by bfineran 12 months ago
#1295 - Make `generate_random_inputs` use zeros for integers
Pull Request -
State: closed - Opened by mgoin 12 months ago
#1294 - [TextGeneration][Bug] Fix timer
Pull Request -
State: closed - Opened by dsikka 12 months ago
#1293 - Revert #1263
Pull Request -
State: closed - Opened by SageMoore 12 months ago
#1292 - [TexgGeneration][Bug] streaming skips generated token added from last prompt token
Pull Request -
State: closed - Opened by dsikka 12 months ago
#1291 - fix top_p bug
Pull Request -
State: closed - Opened by horheynm 12 months ago
#1290 - remove NM_ALLOW_DARWIN
Pull Request -
State: closed - Opened by andy-neuma 12 months ago
#1289 - Set text-generation default values to match performance and UX needs
Pull Request -
State: closed - Opened by mgoin about 1 year ago
#1288 - [server] Refactor + OpenAI Chat Completion Support
Pull Request -
State: closed - Opened by dsikka about 1 year ago
- 1 comment