Data

Tools

Indexes

Applications

Experiments

Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / aws/sagemaker-pytorch-inference-toolkit issues and pull requests

#167 - Disabling token auth and enabling model API by default

Pull Request - State: closed - Opened by udaij12 12 months ago - 1 comment

#167 - Disabling token auth and enabling model API by default

Pull Request - State: closed - Opened by udaij12 12 months ago - 1 comment

#166 - Ignore zombie processes when detecting TorchServe status

Pull Request - State: closed - Opened by namannandan over 1 year ago - 7 comments

#166 - Ignore zombie processes when detecting TorchServe status

Pull Request - State: closed - Opened by namannandan over 1 year ago - 2 comments

#165 - Zombie process exception

Issue - State: open - Opened by 5agado over 1 year ago

#164 - Improve error logging when invoking custom handler methods

Pull Request - State: open - Opened by namannandan over 1 year ago

#164 - Improve error logging when invoking custom handler methods

Pull Request - State: closed - Opened by namannandan over 1 year ago

#162 - Fix dependency versions

Pull Request - State: closed - Opened by sachanub almost 2 years ago

#161 - Unpin dependency versions

Pull Request - State: closed - Opened by sachanub almost 2 years ago

#160 - Include 2.1.0 container for integration tests

Pull Request - State: closed - Opened by sachanub almost 2 years ago

#159 - Upgrade psutil version

Pull Request - State: open - Opened by sachanub almost 2 years ago

#158 - Cleanup to remove EIA integration tests and other unused files/code

Pull Request - State: closed - Opened by sachanub almost 2 years ago

#154 - Fix integration tests and update Python versions

Pull Request - State: closed - Opened by sachanub almost 2 years ago

#153 - Dummy PR 2 - Include base inference toolkit

Pull Request - State: closed - Opened by sachanub about 2 years ago

#152 - Dummy PR to understand PyTorch inference toolkit build process

Pull Request - State: closed - Opened by sachanub about 2 years ago - 1 comment

#151 - remove unused file

Pull Request - State: closed - Opened by lxning about 2 years ago

#150 - reuse sagemaker-inference's requirements.txt installation logic

Pull Request - State: closed - Opened by humanzz about 2 years ago

#148 - Enable vmargs argument for torchserve

Pull Request - State: open - Opened by carljeske about 2 years ago

#147 - deprecation: deleting outdated docker file for pytorch-eia-1.3.1

Pull Request - State: open - Opened by pravali96 over 2 years ago

#146 - Enable telemetry.

Pull Request - State: closed - Opened by chen3933 over 2 years ago

#145 - fix: Remove stale docker files

Pull Request - State: open - Opened by ivan-khvostishkov over 2 years ago

#143 - Add support for SAGEMAKER_MAX_PAYLOAD_IN_MB

Pull Request - State: closed - Opened by namannandan over 2 years ago - 2 comments

#142 - Documentation for inference.py `transform_fn`

Issue - State: open - Opened by david-waterworth over 2 years ago

#141 - Incorrect reporting of memory utilisation

Issue - State: open - Opened by david-waterworth over 2 years ago

#140 - Modify log4j2.xml to remove dependency on javascript.

Pull Request - State: closed - Opened by chen3933 over 2 years ago

#139 - fix_build

Pull Request - State: closed - Opened by chen3933 over 2 years ago - 1 comment

#138 - fix_build

Pull Request - State: closed - Opened by chen3933 over 2 years ago

#136 - add vmargs=-XX:-UseContainerSupport in config

Pull Request - State: closed - Opened by lxning over 2 years ago - 3 comments

#135 - Document TorchServe version compatibility

Pull Request - State: open - Opened by davidthomas426 over 2 years ago - 2 comments

#134 - Specify batch size for MME

Issue - State: open - Opened by austinmw almost 3 years ago

#133 - [Question] Using model.mar with built-in handler script

Issue - State: open - Opened by austinmw almost 3 years ago

#132 - configure min torchserve version dependency

Pull Request - State: closed - Opened by rohithkrn almost 3 years ago

#131 - Update PyTorch Inference toolkit to log telemetry metrics

Pull Request - State: closed - Opened by sachanub almost 3 years ago

#130 - Fix: Don't load default model in MME mode

Pull Request - State: closed - Opened by nskool almost 3 years ago - 10 comments

#129 - MMS mode in inference does not support in GPU instance

Issue - State: closed - Opened by holopekochan about 3 years ago

#127 - Multi gpu support

Pull Request - State: open - Opened by waytrue17 about 3 years ago - 16 comments

#126 - how to use gpu in sagemaker instance

Issue - State: open - Opened by haiderasad over 3 years ago - 1 comment

#125 - using cuda enabled pytorch image

Issue - State: open - Opened by haiderasad over 3 years ago

#124 - Document how to locally run the container

Issue - State: open - Opened by ManuelVs over 3 years ago - 2 comments

#123 - add environment variable "OMP_NUM_THREADS"

Issue - State: open - Opened by lxning over 3 years ago

#122 - Use an overriden transform function to support batch inference in pytorch

Pull Request - State: closed - Opened by nskool over 3 years ago - 5 comments

#121 - Batch Inference does not work when using the default handler

Issue - State: open - Opened by nskool over 3 years ago

#120 - Test config change

Pull Request - State: open - Opened by mseth10 over 3 years ago - 2 comments

#119 - Update CI to use PyTorch 1.10

Pull Request - State: closed - Opened by mseth10 over 3 years ago - 16 comments

#118 - pass model directory as input to torchserve

Pull Request - State: closed - Opened by mseth10 over 3 years ago - 80 comments

#117 - Launch TorchServe without repackaging model contents

Issue - State: open - Opened by fm1ch4 over 3 years ago - 5 comments

#116 - No model logs from PyTorch 1.10 SageMaker endpoint

Issue - State: closed - Opened by setu4993 over 3 years ago - 2 comments

#115 - Reference PyTorch instead of MXNet

Pull Request - State: open - Opened by mikesterlingw over 3 years ago - 2 comments

#114 - fix: log4j migration from 1 to 2. Replace properties file with xml.

Pull Request - State: closed - Opened by nskool over 3 years ago - 5 comments

#113 - Need for a minimum reproducible example in readme.md

Issue - State: open - Opened by mohamed-ali almost 4 years ago

#112 - Serving a model using custom container, instance run of disk

Issue - State: open - Opened by HamidShojanazeri almost 4 years ago - 4 comments

#111 - How do I access Custom Attributes from the model during inference?

Issue - State: open - Opened by bml1g12 almost 4 years ago - 1 comment

#110 - Update test requirements

Pull Request - State: closed - Opened by saimidu almost 4 years ago

#109 - prepare release v1.6.0

Pull Request - State: closed - Opened by saimidu almost 4 years ago

#108 - change: Add default model_fn for cpu and gpu on v1.x

Pull Request - State: closed - Opened by saimidu almost 4 years ago

#107 - change: Enable default model fn for cpu and gpu

Pull Request - State: closed - Opened by saimidu almost 4 years ago - 12 comments

#106 - Env variable support for batch inference

Pull Request - State: closed - Opened by nskool about 4 years ago - 8 comments

#105 - MultiDataModel fails at installing requirements.txt

Issue - State: open - Opened by EliasWiegandt about 4 years ago

#104 - Documentation link broken

Issue - State: closed - Opened by johann-petrak over 4 years ago - 1 comment

#103 - Support custom log4j.properties for torchserve

Pull Request - State: open - Opened by stevenmanton over 4 years ago - 7 comments

#102 - make changes for pytorch 1.5.1 eia

Pull Request - State: open - Opened by jbarz1 over 4 years ago - 2 comments

#101 - Support Elastic Inference for PyTorch 1.5.1

Issue - State: open - Opened by TheissHe over 4 years ago

#100 - Expose all CPUs to TorchServe

Pull Request - State: open - Opened by vdantu over 4 years ago - 3 comments

#98 - Add UseContainerSupport flag for model-server to see all available CPUs

Pull Request - State: open - Opened by vdantu over 4 years ago - 1 comment

#97 - dummy test CICD

Pull Request - State: closed - Opened by schenqian over 4 years ago - 3 comments

#96 - Dummy test CICD

Pull Request - State: closed - Opened by schenqian over 4 years ago - 2 comments

#95 - Update TS Archiver to v0.3.1 / Integ tests

Pull Request - State: closed - Opened by dhanainme over 4 years ago - 15 comments

#94 - Fixing issue #85 torch-model-archiver skips other other model artefacts

Pull Request - State: open - Opened by amaharek over 4 years ago - 2 comments

#93 - support elastic inference pytorch 1.5.1

Pull Request - State: closed - Opened by jbarz1 over 4 years ago - 14 comments

#91 - Endpoint dependencies error

Issue - State: open - Opened by rodrigoheck over 4 years ago - 1 comment

#90 - Add print in src/ and test/

Pull Request - State: closed - Opened by tracycxw almost 5 years ago - 8 comments

#89 - Update default handler, update mnist test file, create PT1.5 test image

Pull Request - State: closed - Opened by tracycxw almost 5 years ago - 9 comments

#87 - BERT model loading not working with pytorch 1.3.1-eia container

Issue - State: open - Opened by rucha3 almost 5 years ago - 6 comments
Labels: type: question

#86 - model_fn ignored on PyTorch v1.6 serving container?

Issue - State: closed - Opened by athewsey almost 5 years ago - 15 comments
Labels: type: question

#85 - Switching to TorchServe for 1.6.0 inference has caused undocumented breaking changes and regression

Issue - State: closed - Opened by setu4993 about 5 years ago - 10 comments
Labels: type: bug

#84 - fix: construct correct code path and correctly tar up contents

Pull Request - State: closed - Opened by dhanainme about 5 years ago - 21 comments

#83 - Cannot change the CloudWatch log level

Issue - State: open - Opened by oonisim about 5 years ago - 6 comments
Labels: type: enhancement, contributions welcome

#82 - Add MMS Config for TS

Pull Request - State: closed - Opened by dhanainme about 5 years ago - 2 comments

#81 - fix: Pin sagemaker dependancy version to before version 2

Pull Request - State: closed - Opened by bveeramani about 5 years ago - 2 comments

#80 - change: Add support for Accept headers with multiple MIME types

Pull Request - State: closed - Opened by bveeramani about 5 years ago - 8 comments

#79 - breaking: Change Model server to Torchserve for PyTorch Inference

Pull Request - State: closed - Opened by dhanainme about 5 years ago - 73 comments

#78 - infra: add issue templates

Pull Request - State: closed - Opened by ajaykarpur over 5 years ago - 4 comments

#76 - feature: Python 3.7 support

Pull Request - State: closed - Opened by ajaykarpur over 5 years ago - 1 comment

#75 - curl to follow 301 redirects; repo changed

Pull Request - State: closed - Opened by wwwehr over 5 years ago - 2 comments

#74 - fix: upgrade dependency versions

Pull Request - State: closed - Opened by chuyang-deng over 5 years ago - 7 comments

#73 - Fixed handler service to allow running custom user modules in multi-m…

Pull Request - State: closed - Opened by giuseppeporcelli over 5 years ago - 4 comments

#72 - infra: use tox in buildspec

Pull Request - State: closed - Opened by chuyang-deng over 5 years ago - 15 comments

#71 - Adding Dockerfile for PT1.5

Pull Request - State: closed - Opened by TusharKanekiDey over 5 years ago - 1 comment

#70 - unable to build

Issue - State: closed - Opened by AtsunoriFujita over 5 years ago - 3 comments
Labels: type: documentation