awslabs/llm-hosting-container issues and pull requests

#69 - chore: add tgi 2.0.1

Pull Request - State: closed - Opened by haixiw 3 months ago - 1 comment

#68 - TGI 2.0.1

Pull Request - State: closed - Opened by philschmid 3 months ago - 1 comment

#67 - Add TEI Images

Pull Request - State: open - Opened by philschmid 3 months ago - 12 comments

#66 - chore: add tgi 2.0.0

Pull Request - State: closed - Opened by haixiw 3 months ago - 5 comments

#65 - 2 0 0

Pull Request - State: closed - Opened by philschmid 3 months ago - 4 comments

#64 - Add optimum NeuronX TGI 0.0.21 image

Pull Request - State: closed - Opened by dacorvo 3 months ago - 2 comments

#63 - chore: add TGI 1.4.5 image

Pull Request - State: closed - Opened by whittech1 3 months ago - 9 comments

#62 - Add optimum NeuronX TGI 0.0.20 image

Pull Request - State: closed - Opened by dacorvo 4 months ago - 2 comments

#61 - release 1.4.2

Pull Request - State: closed - Opened by haixiw 5 months ago - 1 comment

#60 - Add optimum-neuron TGI 0.0.19

Pull Request - State: closed - Opened by dacorvo 5 months ago - 4 comments

#59 - fix: optimum 0.0.18

Pull Request - State: closed - Opened by jinyoung-lim 5 months ago

#58 - Release neuronx 0.0.18

Pull Request - State: closed - Opened by jinyoung-lim 5 months ago

#57 - fix: Copy Cargo.lock from tgi to respect pinned versions

Pull Request - State: closed - Opened by jinyoung-lim 5 months ago - 1 comment

#56 - Not able to get the files copied inside Dockerfile

Issue - State: open - Opened by byash11 5 months ago - 4 comments

#55 - chore: add optimum-neuron 0.0.18 image

Pull Request - State: closed - Opened by dacorvo 6 months ago - 2 comments

#54 - TGI 1.4.0

Pull Request - State: closed - Opened by amzn-choeric 6 months ago - 1 comment

#53 - ADD TGI 1.4.0

Pull Request - State: closed - Opened by philschmid 6 months ago - 1 comment

#52 - TGI 1.4.0

Pull Request - State: closed - Opened by timelfrink 6 months ago - 1 comment

#51 - Test

Pull Request - State: closed - Opened by amzn-choeric 6 months ago

#50 - Old Versions Archiving

Pull Request - State: closed - Opened by amzn-choeric 6 months ago

#49 - chore: add optimum version 0.0.17

Pull Request - State: closed - Opened by dacorvo 6 months ago - 1 comment

#48 - chore: device_version to cuda_version

Pull Request - State: closed - Opened by jinyoung-lim 6 months ago

#47 - feature: optimum-neuronx 0.0.16

Pull Request - State: closed - Opened by jinyoung-lim 6 months ago

#46 - overwrite test branch with changes including neuronx dockerfile

Pull Request - State: closed - Opened by jinyoung-lim 6 months ago

#45 - feature: optimum-neuronx 0.0.16

Pull Request - State: closed - Opened by jinyoung-lim 6 months ago

#44 - TGI 1.3.3

Pull Request - State: closed - Opened by amzn-choeric 7 months ago - 1 comment

#43 - TGI 1.3.1

Pull Request - State: closed - Opened by amzn-choeric 7 months ago - 1 comment

#42 - Add 1.3.1 with Mixtral

Pull Request - State: closed - Opened by philschmid 7 months ago - 1 comment

#41 - TGI 1.2.0

Pull Request - State: closed - Opened by amzn-choeric 7 months ago - 1 comment

#40 - TGI 1.2.0

Pull Request - State: closed - Opened by philschmid 8 months ago - 1 comment

#39 - Test

Pull Request - State: closed - Opened by amzn-choeric 8 months ago

#38 - Test Update & 1.03 Files (Testing)

Pull Request - State: closed - Opened by amzn-choeric 8 months ago

#37 - TGI Sanity Tests

Pull Request - State: closed - Opened by amzn-choeric 8 months ago

#36 - Add Neuronx TGI

Pull Request - State: closed - Opened by philschmid 8 months ago - 1 comment

#35 - ValueError: Unsupported model type falcon

Issue - State: open - Opened by shenshaoyong 10 months ago

#34 - V1.1.0 release

Pull Request - State: closed - Opened by haixiw 10 months ago - 1 comment

#33 - ADD TGI 1.1.0

Pull Request - State: closed - Opened by philschmid 10 months ago - 1 comment

#32 - Is there a way to get GenerateResponse full json when calling sagemaker endpoints

Issue - State: open - Opened by nth-attempt 10 months ago - 1 comment

#31 - Add python packages licenses

Pull Request - State: closed - Opened by haixiw 10 months ago

#30 - V1.0.3

Pull Request - State: closed - Opened by philschmid 11 months ago

#29 - TGI 1.0.2 Third Party Licenses File

Pull Request - State: closed - Opened by amzn-choeric 11 months ago

#28 - adds huggingface tgi container tuning documentation

Pull Request - State: closed - Opened by sean-eich 11 months ago

#27 - How can I delpoy a model with AWS S3 and without downloading model from hunggingface via TGI image on Sagemaker?

Issue - State: open - Opened by weiZhenkun 11 months ago - 1 comment

#26 - add TGI docs

Pull Request - State: closed - Opened by lanking520 11 months ago

#25 - [fix] update pytorch for conda install in 0.6.0

Pull Request - State: closed - Opened by tosterberg 11 months ago

#24 - Update build-huggingface.yml

Pull Request - State: closed - Opened by xyang16 11 months ago

#23 - [fix] update mamba version

Pull Request - State: closed - Opened by tosterberg 11 months ago

#22 - ADD TGI v1.0.2

Pull Request - State: closed - Opened by philschmid 11 months ago - 5 comments

#21 - [huggingface] Update build workflow to 0.9.3

Pull Request - State: closed - Opened by xyang16 12 months ago

#20 - Latency and Throughput Inquiry

Issue - State: open - Opened by ctandrewtran 12 months ago - 4 comments

#19 - Llama2

Pull Request - State: closed - Opened by philschmid 12 months ago - 9 comments

#18 - AllTraffic did not pass the ping health check

Issue - State: closed - Opened by existeundelta about 1 year ago - 1 comment

#17 - Updating HF_MODEL_QUANTIZE

Pull Request - State: closed - Opened by rodalarcon about 1 year ago