kserve/modelmesh-serving issues and pull requests

#472 - Install fails if latest commit short hash can be parsed as an int

Issue - State: closed - Opened by ckadner about 1 year ago - 1 comment
Labels: bug

#469 - Model Loading Requests Contention

Issue - State: open - Opened by GolanLevy about 1 year ago
Labels: bug

#468 - chore: Update indirect dependency to knative.dev/serving v0.37.5

Pull Request - State: closed - Opened by ckadner about 1 year ago - 3 comments
Labels: approved

#468 - chore: Update indirect dependency to knative.dev/serving v0.37.5

Pull Request - State: closed - Opened by ckadner about 1 year ago - 3 comments
Labels: approved

#465 - Replace "foo" string with a less generic one

Pull Request - State: closed - Opened by israel-hdez about 1 year ago - 8 comments
Labels: lgtm, approved

#461 - Upgrade UBI base images to version 9

Issue - State: open - Opened by ckadner about 1 year ago - 1 comment

#460 - The behavior of `certificate` in StorageSpec is different from Kserve

Issue - State: open - Opened by Jooho about 1 year ago - 1 comment

#460 - The behavior of `certificate` in StorageSpec is different from Kserve

Issue - State: open - Opened by Jooho about 1 year ago - 1 comment

#456 - storage-secret-config should have the same parameters as Kserve

Issue - State: closed - Opened by VedantMahabaleshwarkar over 1 year ago - 11 comments
Labels: documentation, good first issue, help wanted

#456 - storage-secret-config should have the same parameters as Kserve

Issue - State: closed - Opened by VedantMahabaleshwarkar over 1 year ago - 11 comments
Labels: documentation, good first issue, help wanted

#455 - Excessive unloading of models when loading an additional model

Issue - State: open - Opened by Gaddy-BL over 1 year ago - 3 comments
Labels: bug

#449 - Triton Inference Server doesn't return any values when using gRPC protocol but RESTful does

Issue - State: closed - Opened by anhquan075 over 1 year ago - 2 comments
Labels: bug

#449 - Triton Inference Server doesn't return any values when using gRPC protocol but RESTful does

Issue - State: closed - Opened by anhquan075 over 1 year ago - 2 comments
Labels: bug

#447 - Change release process to update KServe Helm charts based on kustomize build dry-run

Issue - State: open - Opened by ckadner over 1 year ago - 2 comments
Labels: bug, help wanted

#447 - Change release process to update KServe Helm charts based on kustomize build dry-run

Issue - State: open - Opened by ckadner over 1 year ago - 2 comments
Labels: bug, help wanted

#434 - No information about how Predictor autoscaling works?

Issue - State: open - Opened by rehevkor5 over 1 year ago - 3 comments
Labels: documentation, question

#434 - No information about how Predictor autoscaling works?

Issue - State: open - Opened by rehevkor5 over 1 year ago - 3 comments
Labels: documentation, question

#423 - Batch Size Error in Modelmesh with Triton Serving Runtime

Issue - State: closed - Opened by anhquan075 over 1 year ago - 3 comments
Labels: bug

#423 - Batch Size Error in Modelmesh with Triton Serving Runtime

Issue - State: closed - Opened by anhquan075 over 1 year ago - 3 comments
Labels: bug

#407 - Documentation about GPU memory

Issue - State: open - Opened by WaterKnight1998 over 1 year ago - 3 comments
Labels: question

#407 - Documentation about GPU memory

Issue - State: open - Opened by WaterKnight1998 over 1 year ago - 3 comments
Labels: question

#401 - rest-proxy container failing when enabling gRPC inferencing

Issue - State: closed - Opened by heyselbi over 1 year ago - 3 comments
Labels: bug

#401 - rest-proxy container failing when enabling gRPC inferencing

Issue - State: closed - Opened by heyselbi over 1 year ago - 3 comments
Labels: bug

#392 - Specify model size in the InferenceService CRD

Issue - State: open - Opened by andreapairon over 1 year ago - 1 comment
Labels: enhancement

#376 - InferenceService Deployment with ModelMesh Example: fail to send requests from Istio Ingress

Issue - State: closed - Opened by IntelliJJ824 over 2 years ago - 6 comments
Labels: documentation

#376 - InferenceService Deployment with ModelMesh Example: fail to send requests from Istio Ingress

Issue - State: closed - Opened by IntelliJJ824 over 2 years ago - 6 comments
Labels: documentation

#374 - How to use ServingRuntime autoscaling?

Issue - State: open - Opened by andreapairon almost 2 years ago

#373 - Add Makefile documentation

Pull Request - State: open - Opened by ddelange almost 2 years ago - 2 comments

#372 - ServingRuntime autoscaling monitoring GPU utilization

Issue - State: open - Opened by andreapairon almost 2 years ago

#371 - Support ARM 64 bit architecture

Pull Request - State: closed - Opened by ckadner almost 2 years ago - 2 comments
Labels: approved

#370 - Quickstart installation fails on runtimes installation step [main branch]

Issue - State: closed - Opened by mzegla almost 2 years ago - 2 comments
Labels: bug

#369 - Failed to pull model from storage due to error: unable to download objects in bucket ... context canceled

Issue - State: open - Opened by yc2984 almost 2 years ago - 4 comments

#368 - Reduce FVT disk usage

Pull Request - State: closed - Opened by ckadner almost 2 years ago - 1 comment
Labels: approved, test

#367 - FVTs don't run due to "No space left on device" error

Issue - State: closed - Opened by ckadner almost 2 years ago
Labels: test

#366 - Add note to install docs to use doc for latest released version

Issue - State: open - Opened by ckadner almost 2 years ago
Labels: documentation, good first issue, development

#365 - Release checklist v0.11.0

Issue - State: open - Opened by ckadner almost 2 years ago

#364 - doc: Remove cert flag from quickstart

Pull Request - State: closed - Opened by rafvasq almost 2 years ago - 3 comments
Labels: bug, documentation

#363 - fix: Generalizes sed and fixes dry-run cmd

Pull Request - State: closed - Opened by rafvasq almost 2 years ago - 8 comments
Labels: bug, lgtm, approved

#362 - Create a multi-arch protoc base image

Issue - State: open - Opened by ckadner almost 2 years ago

#361 - chore: Update TorchServe to 0.7.1

Pull Request - State: open - Opened by rafvasq almost 2 years ago - 2 comments

#360 - Update TorchServe serving runtime image

Issue - State: open - Opened by rafvasq almost 2 years ago
Labels: enhancement

#359 - chore: Update TritonServer to 23.04

Pull Request - State: open - Opened by rafvasq almost 2 years ago - 1 comment

#358 - Update Triton serving runtime image

Issue - State: open - Opened by rafvasq almost 2 years ago
Labels: enhancement

#357 - Update MLServer serving runtime image

Issue - State: open - Opened by rafvasq almost 2 years ago
Labels: enhancement

#356 - Add Support for Swagger UI

Issue - State: open - Opened by taneem-ibrahim almost 2 years ago
Labels: enhancement

#355 - chore: Update MLServer to v1.2.4

Pull Request - State: open - Opened by rafvasq almost 2 years ago - 1 comment

#354 - Cleanup OWNERS

Pull Request - State: closed - Opened by ckadner almost 2 years ago - 2 comments
Labels: lgtm, approved

#353 - Scale-to-Zero Functionality Similar to KServe

Issue - State: open - Opened by MLHafizur almost 2 years ago - 7 comments
Labels: enhancement, question

#352 - "Specified runtime name not recognised" error in Inference Service

Issue - State: open - Opened by xvnyv almost 2 years ago - 3 comments
Labels: bug

#351 - Memory leak - OOMKilled

Issue - State: closed - Opened by Kokkini almost 2 years ago - 6 comments
Labels: bug

#350 - release: Prepare v0.11.0-alpha release

Pull Request - State: closed - Opened by ckadner almost 2 years ago - 1 comment

#349 - How to run ModelMesh without `storage-config` secret when `allowAnyPVC`

Issue - State: open - Opened by ckadner almost 2 years ago - 2 comments

#348 - Document model storage supports for HTTP

Issue - State: open - Opened by ckadner almost 2 years ago

#347 - Update license header for `gofmt` with Go 1.19

Issue - State: open - Opened by ckadner almost 2 years ago

#346 - feat: Add Template Grafana Dashboard for ModelMesh Metrics

Pull Request - State: open - Opened by rafvasq almost 2 years ago - 5 comments
Labels: enhancement

#345 - Unable to load model on the Triton serving runtime

Issue - State: closed - Opened by andreapairon almost 2 years ago - 3 comments

#344 - doc: Add a note to Quickstart about known M1 issue

Pull Request - State: closed - Opened by lamoghaighoroje almost 2 years ago - 1 comment
Labels: documentation

#343 - ExecutionBatchError: Failed "execute_batch":

Issue - State: open - Opened by MLHafizur almost 2 years ago - 2 comments

#342 - add HPA feature/unit/fvt/docs/script

Pull Request - State: closed - Opened by Jooho almost 2 years ago - 5 comments
Labels: enhancement, lgtm, approved

#341 - 8 retry iterations exhausted

Issue - State: open - Opened by yc2984 almost 2 years ago - 10 comments

#340 - Bug fixes and E2E tests for PVC storage

Pull Request - State: closed - Opened by ckadner almost 2 years ago - 10 comments
Labels: bug, documentation, lgtm, approved, test

#339 - Add support for configurable MM_Payload_Processor environment variable

Pull Request - State: closed - Opened by RobGeada almost 2 years ago - 3 comments
Labels: enhancement, lgtm, approved

#338 - Failed calling webhook "inferenceservice.kserve-webhook-server.defaulter"

Issue - State: closed - Opened by Kokkini almost 2 years ago - 1 comment
Labels: bug

#337 - PVC support follow up items

Issue - State: closed - Opened by ckadner almost 2 years ago
Labels: documentation, enhancement, test

#335 - Pre-built grafana dashboard for modelmesh metrics

Issue - State: open - Opened by njhill almost 2 years ago - 2 comments
Labels: enhancement

#334 - Support out of distribution detection metrics

Issue - State: open - Opened by taneem-ibrahim almost 2 years ago - 8 comments

#333 - ONNX model serving And python GRPC client

Issue - State: open - Opened by MLHafizur almost 2 years ago - 14 comments
Labels: bug

#332 - ONNX model inferencing :: "vmodel not found

Issue - State: closed - Opened by MLHafizur almost 2 years ago - 1 comment

#331 - Auto Scaling Model Mesh Custom Runtime Service

Issue - State: closed - Opened by sidharthkumarpradhan about 2 years ago - 2 comments
Labels: question

#330 - Load Balancing not happening in Multiple Replicas !!!

Issue - State: closed - Opened by MLHafizur about 2 years ago - 2 comments
Labels: bug

#329 - Add config option to allow use with HPAs

Issue - State: closed - Opened by njhill about 2 years ago - 4 comments
Labels: enhancement

#328 - chore: Update go dependency to fix CVE-2022-1996

Pull Request - State: closed - Opened by ckadner about 2 years ago - 2 comments
Labels: lgtm, approved

#327 - ONNX model not loading

Issue - State: closed - Opened by MLHafizur about 2 years ago - 2 comments
Labels: question

#326 - fix: update links to env var lines

Pull Request - State: closed - Opened by rafvasq about 2 years ago - 4 comments
Labels: bug, lgtm, approved

#325 - Keras model inferencing error BUG.

Issue - State: closed - Opened by MLHafizur about 2 years ago - 2 comments
Labels: bug

#324 - Oauth proxy limit

Pull Request - State: closed - Opened by fcami about 2 years ago - 2 comments

#323 - Getting error for concurrent inference requests.

Issue - State: closed - Opened by MLHafizur about 2 years ago
Labels: bug

#322 - docs: clarify gRPC quickstart example

Pull Request - State: closed - Opened by rafvasq about 2 years ago - 1 comment
Labels: documentation, lgtm, approved

#321 - fix: etcd pod fails to start on OpenShift

Pull Request - State: closed - Opened by ckadner about 2 years ago - 1 comment
Labels: lgtm, approved

#320 - FVT support for more runtimes/tests

Issue - State: open - Opened by rafvasq about 2 years ago - 1 comment
Labels: test

#319 - Updating new version of the model without any service interruption

Issue - State: open - Opened by MLHafizur about 2 years ago - 1 comment
Labels: question

#318 - build a model runtime simulator to help measure elastic scaling efficiency with little system resource.

Issue - State: open - Opened by meijies about 2 years ago - 1 comment

#317 - Base/dependent model support

Issue - State: open - Opened by njhill about 2 years ago
Labels: enhancement

#316 - Add some python client examples to the docs

Issue - State: open - Opened by njhill about 2 years ago - 4 comments
Labels: documentation, good first issue

#315 - Inference URL/Status is not stable in Multi-model Serving

Issue - State: open - Opened by MLHafizur about 2 years ago - 1 comment
Labels: question

#314 - Push multi-arch images

Pull Request - State: closed - Opened by ddelange about 2 years ago - 13 comments
Labels: approved

#313 - Need support on manipulating model to pod in order to deploy ensemble model

Issue - State: open - Opened by vulong3896 about 2 years ago - 3 comments

#312 - Help: Models not unloading dynamically as per LRU

Issue - State: closed - Opened by dumbPy about 2 years ago - 3 comments
Labels: question

#311 - Provide documentations of ModelMesh mechanism and behaviour

Issue - State: open - Opened by lizzzcai about 2 years ago
Labels: documentation

#310 - chore: Run GitHub actions on `release-*` branches

Pull Request - State: closed - Opened by ckadner about 2 years ago - 2 comments
Labels: lgtm, approved, test

#309 - release: Update `main` docs for version `v0.10.0`

Pull Request - State: closed - Opened by ckadner about 2 years ago - 2 comments
Labels: documentation, lgtm, approved

#308 - release: Update `release-0.10` image tags for version `v0.10.0`

Pull Request - State: closed - Opened by ckadner about 2 years ago - 2 comments
Labels: approved

#307 - docs: Update release process

Pull Request - State: closed - Opened by ckadner about 2 years ago - 5 comments
Labels: documentation, lgtm, approved

#306 - doc: include namespace-scope info

Pull Request - State: closed - Opened by rafvasq about 2 years ago - 2 comments
Labels: documentation, lgtm, approved

#305 - Merge latest changes from `main`

Pull Request - State: closed - Opened by ckadner about 2 years ago - 3 comments

#304 - Use `--namespace-scope-mode` for Quickstart

Pull Request - State: closed - Opened by ckadner about 2 years ago - 2 comments
Labels: lgtm, approved

#303 - Update release version in quickstart.md

Pull Request - State: closed - Opened by ckadner about 2 years ago - 2 comments
Labels: lgtm, approved

#302 - Add Dockerfile for `modelmesh-minio-dev-examples` image

Issue - State: closed - Opened by rafvasq about 2 years ago - 1 comment
Labels: documentation, development

#300 - [WIP] Add Dockerfile for `modelmesh-minio-examples` image

Pull Request - State: closed - Opened by tedhtchang about 2 years ago - 11 comments
Labels: do-not-merge/work-in-progress

#299 - test: Run GitHub actions on `release-*` branches

Pull Request - State: closed - Opened by ckadner about 2 years ago - 5 comments
Labels: test

GitHub / kserve/modelmesh-serving issues and pull requests