Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / neuralmagic/deepsparse issues and pull requests
#1564 - [TextGeneration] add a test to evaluate text generation with continuous batching
Pull Request -
State: open - Opened by dsikka 10 months ago
#1563 - [Bug] Fix import bug with numpy_log_softmax
Pull Request -
State: closed - Opened by rahul-tuli 10 months ago
Labels: bug
#1562 - [TextGeneration] Split up `prep_for_generation` operator, handle edge cases, handle kv_cache full during prefill
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1561 - Remove scipy by implementing log_softmax
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1560 - [V2 Loggers] logger manager patch
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1559 - [Cherry-Picks] for 1.7 as of Wed Jan 24th, 2024 2:48AM
Pull Request -
State: closed - Opened by dbogunowicz 10 months ago
#1558 - [Fix] Small fixes to account for changes to `RegistryMixin`
Pull Request -
State: closed - Opened by dbogunowicz 10 months ago
- 1 comment
#1557 - Remove scikit-learn by implementing precision_recall_fscore_support
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1556 - sklearn patch
Pull Request -
State: closed - Opened by andy-neuma 10 months ago
- 1 comment
#1555 - [DeepSparse Evaluation API] Perplexity
Pull Request -
State: closed - Opened by dbogunowicz 10 months ago
#1554 - Fix documentation about TextGeneration
Pull Request -
State: closed - Opened by luis5tb 10 months ago
- 4 comments
#1553 - [V2 Logger] Logger with pipeline tests + prometheus
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1552 - [Text Generation Pipeline] Fix Non KV Cache Pipeline not calling parse_inputs
Pull Request -
State: closed - Opened by dbogunowicz 10 months ago
#1551 - [Cherry-Pick][Text Generation] Consolidate `TextGenerationPipeline` and `TextGener…
Pull Request -
State: open - Opened by dbogunowicz 10 months ago
#1551 - [Cherry-Pick][Text Generation] Consolidate `TextGenerationPipeline` and `TextGener…
Pull Request -
State: closed - Opened by dbogunowicz 10 months ago
#1549 - [Cherry-Picks] for 1.7 as of Fri, Jan 19th, 2024 2:17PM
Pull Request -
State: closed - Opened by rahul-tuli 10 months ago
- 1 comment
#1548 - [testing]
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1548 - [testing]
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1547 - [text-gen] lock tokenizer call in process inputs
Pull Request -
State: closed - Opened by bfineran 10 months ago
#1546 - [Pipeline] Fix async generator loop
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1545 - [Temporary Fix] Pin binary version to pass prefill tests
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1545 - [Temporary Fix] Pin binary version to pass prefill tests
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1544 - Remove artifact version restriction
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1544 - [Test] Remove artifact version restriction
Pull Request -
State: open - Opened by mgoin 10 months ago
#1543 - [V2 Logger] logger middleware
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1542 - [V2 Logger] root logger
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1541 - [V2 Logger] logger manager
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1540 - [V2 Logger] Filters
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1539 - [V2 Logger] registry for default func/class
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1538 - [V2 Logger] async submitter
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1537 - [V2 Logger] factory
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1536 - [V2 Logger] utils for import
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1535 - [server][Pipeline] fix async future being used by continuous_batching
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1534 - [Pipeline][Server] Fix loop in async generator
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1533 - [V2 Loggers] config file
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1532 - yolo-v8 in onnx-runtime outperforms deepsparse on iMX8
Issue -
State: closed - Opened by Fritskee 10 months ago
- 6 comments
Labels: bug
#1531 - Add support for ultrachat200k
Pull Request -
State: open - Opened by anmarques 10 months ago
#1530 - [Cherrypick] Add title to server docs page (#1525)
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1530 - [Cherrypick] Add title to server docs page (#1525)
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1529 - Test test
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1528 - [TextGeneration] Update defaults to always start with deepsparse defaults when using the `generation_config` arg
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1528 - [TextGeneration] Update defaults to always start with deepsparse defaults when using the `generation_config` arg
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1527 - Assertion at src/lib/core/topology.cpp:627
Issue -
State: closed - Opened by Zorgosto 10 months ago
- 1 comment
Labels: bug
#1527 - Assertion at src/lib/core/topology.cpp:627
Issue -
State: closed - Opened by Zorgosto 10 months ago
- 1 comment
Labels: bug
#1526 - Add support for tokenized prompt input for CompletionRequest
Pull Request -
State: closed - Opened by mgoin 10 months ago
- 1 comment
#1525 - Add title to server docs page
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1524 - [Debugging] gha failures
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1523 - [TextGeneration] Fix first token for streaming
Pull Request -
State: closed - Opened by dsikka 10 months ago
- 1 comment
#1522 - [OpenAI] Add logprob support
Pull Request -
State: closed - Opened by dsikka 10 months ago
- 3 comments
#1521 - Add warning when failing to build v2 pipeline
Pull Request -
State: closed - Opened by mgoin 10 months ago
#1520 - [Move] Common Evaluation Modules to `Sparsezoo``
Pull Request -
State: open - Opened by rahul-tuli 10 months ago
- 1 comment
Labels: mle-team
#1519 - [timer][benchmark_pipeline] Update the `benchmark_pipeline` to work with v1 and v2; clean-up middleware/timer_middleware
Pull Request -
State: closed - Opened by dsikka 10 months ago
#1518 - [Add] sequence length to text gen pipelines
Pull Request -
State: closed - Opened by rahul-tuli 10 months ago
Labels: mle-team
#1517 - [BugFixes] `deepsparse.eval`
Pull Request -
State: closed - Opened by rahul-tuli 10 months ago
#1516 - [V2 Logger] Feature branch
Pull Request -
State: closed - Opened by horheynm 10 months ago
#1515 - V2/loggers config
Pull Request -
State: closed - Opened by horheynm 11 months ago
#1514 - [TextGeneration] Fix internal kv_cache update for batch_size > 1
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1513 - Add `--num-kv-cache-tokens` to benchmarking scripts
Pull Request -
State: closed - Opened by mgoin 11 months ago
- 1 comment
#1512 - Use Int KV Cache as default for deepsparse.benchmark
Pull Request -
State: closed - Opened by horheynm 11 months ago
#1511 - [BugFixes] Fix Broken `deepsparse.eval`
Pull Request -
State: closed - Opened by rahul-tuli 11 months ago
Labels: bug, mle-team
#1510 - [Text Generation] Consolidate `TextGenerationPipeline` and `TextGenerationPipelineNoKVCache`
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
- 1 comment
#1509 - [Benchmark] Fix number of iterations reported
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1508 - [Server] Use the integration field when starting a server
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1507 - [BugFix] Remove `src.` from imports
Pull Request -
State: closed - Opened by rahul-tuli 11 months ago
Labels: bug, mle-team
#1506 - [TextGeneration] Use appropriate future within `continuous_batching_scheduler`
Pull Request -
State: closed - Opened by dsikka 11 months ago
- 1 comment
#1505 - [TextGeneration] Add `model_path` alias
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1504 - [TextGeneration] Set scary logs to `debug`
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1503 - log warning for batch_size 1
Pull Request -
State: open - Opened by horheynm 11 months ago
- 7 comments
#1502 - Add LLMPerf example for DeepSparse LLM Server
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1501 - Unsupported ONNX type 10 for FP16
Issue -
State: closed - Opened by farizalmustaqim 11 months ago
- 5 comments
Labels: bug
#1500 - Add CLIP model to enable test_clip.py
Pull Request -
State: open - Opened by mgoin 11 months ago
- 1 comment
#1499 - Replace Fastchat Chat Templates with HF `apply_chat_template`
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1498 - Bump gradio from 3.19.1 to 4.11.0 in /examples/benchmark-ui
Pull Request -
State: closed - Opened by dependabot[bot] 11 months ago
- 1 comment
Labels: dependencies
#1497 - Let OpenAI ChatCompletionRequest accept List[Dict] messages
Pull Request -
State: closed - Opened by mgoin 11 months ago
#1496 - Correct token usage reporting for OpenAI server
Pull Request -
State: closed - Opened by mgoin 11 months ago
- 1 comment
#1495 - [Fix][Text Generation] Fixing failing OPT tests
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
#1493 - [Text Generation] Enable continuous batching when internal kv_cache is enabled
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1492 - darft
Pull Request -
State: closed - Opened by horheynm 11 months ago
#1491 - Draft asyncio test
Pull Request -
State: closed - Opened by horheynm 11 months ago
#1490 - lint on readme
Pull Request -
State: closed - Opened by horheynm 11 months ago
- 1 comment
#1489 - Read me lint
Pull Request -
State: closed - Opened by horheynm 11 months ago
#1488 - Readme lint
Pull Request -
State: closed - Opened by horheynm 11 months ago
#1487 - Add Text Gen Alias
Pull Request -
State: closed - Opened by dsikka 11 months ago
- 3 comments
#1487 - Add Text Gen Alias
Pull Request -
State: open - Opened by dsikka 11 months ago
#1486 - [OpenAI][Server] Enable OpenAI text generation streaming
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1486 - [OpenAI][Server] Enable OpenAI text generation streaming
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1485 - [Cherry-pick] Hotfix 1.6.1 for license changes
Pull Request -
State: closed - Opened by dhuangnm 11 months ago
#1484 - [Pipeline Refactor][Text Generation] Updating Pipeline Execution and Enable Streaming
Pull Request -
State: open - Opened by dsikka 11 months ago
- 1 comment
#1484 - [Pipeline Refactor][Text Generation] Updating Pipeline Execution and Enable Streaming
Pull Request -
State: closed - Opened by dsikka 11 months ago
- 1 comment
#1483 - [Text Generation][V2] NonKVCachePipeline
Pull Request -
State: closed - Opened by dbogunowicz 11 months ago
#1483 - [Text Generation][V2] NonKVCachePipeline
Pull Request -
State: open - Opened by dbogunowicz 11 months ago
#1482 - Update router
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1481 - [Pipeline Refactor] Update markdowns for QA
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1480 - [Pipeline Refactor][Server] Enable from files for v2
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1479 - V2/george scratch
Pull Request -
State: closed - Opened by horheynm 11 months ago
#1478 - [V2 Pipeline] SImple Asyncio pipeline test
Pull Request -
State: open - Opened by horheynm 11 months ago
#1478 - [V2 Pipeline] SImple Asyncio pipeline test
Pull Request -
State: open - Opened by horheynm 11 months ago
#1478 - [V2 Pipeline] SImple Asyncio pipeline test
Pull Request -
State: open - Opened by horheynm 11 months ago
#1477 - [Pipeline Refactor][server][OpenAI] Enable OpenAI to use new text gen pipeline
Pull Request -
State: closed - Opened by dsikka 11 months ago
#1477 - [Pipeline Refactor][server][OpenAI] Enable OpenAI to use new text gen pipeline
Pull Request -
State: closed - Opened by dsikka 11 months ago