Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / neuralmagic/guidellm issues and pull requests

#72 - `--workers` CLI parameter is added

Pull Request - State: open - Opened by parfeniukink 2 days ago

#71 - Concurrent load generation option is implemented

Pull Request - State: open - Opened by parfeniukink 8 days ago - 1 comment

#70 - GUIDELLM__MAX_CONCURRENCY is off by 1

Issue - State: open - Opened by sjmonson 8 days ago - 2 comments

#68 - problems with sglang

Issue - State: open - Opened by eliecerecology 3 months ago

#67 - Testing Gemma 2

Issue - State: closed - Opened by Swipe4057 3 months ago

#66 - Multimodal

Pull Request - State: open - Opened by anmarques 4 months ago - 1 comment

#65 - Does guidellm support benchmarking for SGlang

Issue - State: closed - Opened by jbymy2000 4 months ago - 1 comment

#64 - Introduce the `--subset-size` CLI parameter

Pull Request - State: open - Opened by parfeniukink 4 months ago

#63 - Get Accuracy Metrics reported

Issue - State: open - Opened by parfeniukink 4 months ago

#62 - how to call the remote api

Issue - State: open - Opened by jackqdldd 5 months ago

#61 - Docs Updates

Pull Request - State: open - Opened by rgreenberg1 5 months ago

#60 - 38 guidance reportjson from default flow is very large

Pull Request - State: open - Opened by parfeniukink 5 months ago - 1 comment

#59 - Docs Updates

Pull Request - State: closed - Opened by rgreenberg1 5 months ago

#56 - [Feature] GitHub Actions CI/CD Enablement and Expansion

Issue - State: open - Opened by markurtz 5 months ago
Labels: feature

#55 - End-to-End Testing Enablement / Expansion

Issue - State: open - Opened by rgreenberg1 5 months ago

#54 - Integration Testing Enablement / Expansion

Issue - State: open - Opened by rgreenberg1 5 months ago

#53 - Change default "role" from "system" to "user"

Pull Request - State: closed - Opened by philschmid 5 months ago

#52 - [bug] Model without system prompt fail

Issue - State: closed - Opened by philschmid 5 months ago - 3 comments
Labels: bug

#51 - FIX TGI example

Pull Request - State: closed - Opened by philschmid 5 months ago - 1 comment

#50 - Add missing vllm docs link

Pull Request - State: closed - Opened by eldarkurtic 5 months ago

#49 - Support on TGI (Text Generation Inference)

Issue - State: closed - Opened by muhammad-asn 5 months ago - 2 comments

#48 - [Dataset]: Iterate through benchmark dataset once

Pull Request - State: closed - Opened by parfeniukink 6 months ago - 2 comments

#47 - [Rate Type] Concurrencies

Issue - State: open - Opened by philschmid 6 months ago - 2 comments
Labels: enhancement

#46 - Add summary metrics to saved json file

Pull Request - State: closed - Opened by anmarques 6 months ago - 4 comments

#46 - Add summary metrics to saved json file

Pull Request - State: closed - Opened by anmarques 6 months ago - 4 comments

#45 - Update README.md

Pull Request - State: closed - Opened by rgreenberg1 6 months ago

#44 - [Dataset]: Iterate through benchmark dataset once

Issue - State: closed - Opened by philschmid 6 months ago - 6 comments
Labels: enhancement

#43 - ADD TGI docs

Pull Request - State: closed - Opened by philschmid 6 months ago

#43 - ADD TGI docs

Pull Request - State: closed - Opened by philschmid 6 months ago

#42 - ✨ vLLM Backend integration

Pull Request - State: open - Opened by parfeniukink 6 months ago

#41 - images for cli.md

Pull Request - State: closed - Opened by rgreenberg1 6 months ago

#40 - Quick fixes for failing tests for distribution regression

Pull Request - State: closed - Opened by markurtz 6 months ago

#39 - Enhance Readme and CLI Configuration Options

Pull Request - State: closed - Opened by markurtz 6 months ago

#38 - guidance_report.json from default flow is very large

Issue - State: open - Opened by mgoin 6 months ago - 3 comments

#37 - Wrong tokenizer used by default

Issue - State: closed - Opened by mgoin 6 months ago - 7 comments

#36 - How to specify input/output token lengths for requests?

Issue - State: closed - Opened by mgoin 6 months ago

#35 - Updated image in README

Pull Request - State: closed - Opened by jennyyangyi-magic 6 months ago

#34 - Default guidellm command only sends empty messages?

Issue - State: open - Opened by mgoin 6 months ago - 1 comment

#32 - Rgreenberg1 patch 2

Pull Request - State: closed - Opened by rgreenberg1 6 months ago

#31 - Create cli-user-guide

Pull Request - State: closed - Opened by rgreenberg1 6 months ago

#30 - OpenaAI API Key secret is added to Github Actions

Pull Request - State: open - Opened by parfeniukink 6 months ago - 2 comments

#29 - ✨Deepsparse Backend implementation

Pull Request - State: open - Opened by parfeniukink 6 months ago

#25 - Add pre-commit checks to quality workflows

Pull Request - State: closed - Opened by markurtz 7 months ago

#24 - Add Report Generation and Configuration Improvements for GuideLLM

Pull Request - State: closed - Opened by markurtz 7 months ago

#21 - Enhance GuideLLM Documentation and Setup

Pull Request - State: closed - Opened by rgreenberg1 7 months ago - 1 comment

#20 - 👷‍♂️CI/CD includes build publishing

Pull Request - State: open - Opened by parfeniukink 7 months ago - 1 comment

#19 - Adapt build system for dynamic versioning and package naming based on build settings

Pull Request - State: closed - Opened by markurtz 7 months ago - 2 comments

#18 - 💄CLI interface improvements

Pull Request - State: closed - Opened by parfeniukink 7 months ago

#15 - 🔨 `guidellm` build script is added

Pull Request - State: closed - Opened by parfeniukink 7 months ago

#14 - ➕ pytest-cov is installed. 75% threshold is set

Pull Request - State: closed - Opened by parfeniukink 7 months ago

#13 - ➕ pytest-cov is installed. 75% threshhold is set

Pull Request - State: closed - Opened by parfeniukink 7 months ago - 1 comment

#12 - Add Pre-Commit Hooks and Fix Dev Dependency Issues

Pull Request - State: closed - Opened by markurtz 7 months ago - 1 comment

#11 - ✨ Executor & Scheduler packages preparation

Pull Request - State: closed - Opened by parfeniukink 7 months ago - 5 comments

#10 - Code Quality configuration

Pull Request - State: closed - Opened by parfeniukink 7 months ago

#9 - Add Serialization and Deserialization Support Using Pydantic

Pull Request - State: closed - Opened by markurtz 7 months ago

#8 - Backend tests are added

Pull Request - State: closed - Opened by parfeniukink 7 months ago - 1 comment

#7 - Parfeniuk/tests backfill

Pull Request - State: closed - Opened by parfeniukink 8 months ago - 1 comment

#6 - Dev tools configurations

Pull Request - State: closed - Opened by parfeniukink 8 months ago - 1 comment

#5 - Standardize Logger Implementation with Loguru and Add Comprehensive Unit Tests

Pull Request - State: closed - Opened by markurtz 8 months ago - 2 comments

#4 - add small fixes

Pull Request - State: closed - Opened by DaltheCow 8 months ago

#3 - Refactor RequestGenerator to use threading and update test suite

Pull Request - State: closed - Opened by markurtz 8 months ago - 1 comment

#2 - Multiple request rates

Pull Request - State: closed - Opened by DaltheCow 8 months ago

#1 - Onboarding

Pull Request - State: closed - Opened by parfeniuklits 8 months ago