Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / AI-Hypercomputer/JetStream issues and pull requests

#152 - add seperate prefill detokenization thread

Pull Request - State: closed - Opened by zhihaoshan-google 10 days ago - 5 comments

#150 - باربری یزد 09133545880

Issue - State: open - Opened by barbaryyazd09133545880 16 days ago

#149 - باربری یزد 09133545880

Issue - State: open - Opened by barbaryyazd09133545880 20 days ago

#148 - Rename third_party folder to Avoid Copybara g3 Errors

Pull Request - State: closed - Opened by jyj0w0 21 days ago - 1 comment

#147 - Add option to use hf tokenizer

Pull Request - State: closed - Opened by RissyRan 24 days ago

#146 - Does Dataflow work with JetStream?

Issue - State: open - Opened by salaki about 1 month ago - 1 comment

#144 - Ads.google.com

Issue - State: closed - Opened by barbaryyazd09133545880 about 1 month ago

#143 - Question: `prometheus_port` flag for pytorch server

Issue - State: open - Opened by JeffLuoo about 1 month ago

#142 - باربری یزد ۰۹۱۳۳۵۴۵۸۸۰

Issue - State: closed - Opened by barbaryyazd09133545880 about 1 month ago

#141 - باربری یزد 09133545880

Issue - State: closed - Opened by barbaryyazd09133545880 about 2 months ago

#140 - Support using models from HuggingFace directly

Issue - State: open - Opened by samos123 about 2 months ago - 2 comments

#139 - باربری نیسان یزد 09133545880

Issue - State: closed - Opened by barbaryyazd09133545880 about 2 months ago

#100 - Add inference sampling utils in JetStream

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#99 - Add ssh port forward support for profile readme

Pull Request - State: closed - Opened by FanhaiLu1 6 months ago

#98 - Minor fix

Pull Request - State: closed - Opened by morgandu 6 months ago

#97 - Add tensorboard plugin dep for remote access

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#96 - Update benchmark config for xlml automation

Pull Request - State: closed - Opened by morgandu 6 months ago

#95 - Release v0.2.2

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#94 - Enable JetStream Standalone Server

Pull Request - State: open - Opened by JoeZijunZhou 6 months ago - 1 comment

#93 - chore: update model_ckpt_conversion.sh

Pull Request - State: closed - Opened by eltociear 6 months ago - 2 comments

#92 - Model warmup support with AOT and endpoint for JetStream

Pull Request - State: closed - Opened by vivianrwu 6 months ago - 2 comments

#91 - Ensure server warmup before benchmark

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago - 4 comments

#90 - Add healthcheck support for JetStream

Pull Request - State: closed - Opened by vivianrwu 6 months ago - 1 comment

#89 - Add JetStream E2E test CI

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#88 - Remove jax dependencies in JetStream

Issue - State: open - Opened by FanhaiLu1 6 months ago

#87 - Add ray disaggregated serving support

Pull Request - State: closed - Opened by FanhaiLu1 6 months ago - 2 comments

#86 - Bump requests from 2.31.0 to 2.32.0 in the pip group across 1 directory

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: dependencies

#85 - Add profiling support and update docs

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#84 - Allow tokenizer to customize stop_tokens

Pull Request - State: closed - Opened by qihqi 7 months ago

#83 - Update benchmark script to easily test llama-3

Pull Request - State: closed - Opened by bhavya01 7 months ago

#82 - Decode Batch Percentage Metrics/Improved Scraping

Pull Request - State: closed - Opened by Bslabe123 7 months ago

#81 - Unit test coverage cleanup

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#80 - Fix pad_tokens function description

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#79 - Support I/O with text and token ids

Issue - State: closed - Opened by JoeZijunZhou 7 months ago - 2 comments

#78 - Update JetStream grpc proto to support I/O with text and token ids

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago - 8 comments

#77 - Add metadata metrics

Pull Request - State: closed - Opened by yeandy 7 months ago

#76 - Accuracy eval mlperf

Pull Request - State: closed - Opened by jwyang-google 7 months ago

#74 - Release v0.2.1 with docs update

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago - 1 comment

#73 - Bump tqdm from 4.66.1 to 4.66.3 in the pip group across 1 directory

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago
Labels: dependencies

#72 - Release v0.2.1

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#71 - Prometheus Metrics

Pull Request - State: closed - Opened by Bslabe123 7 months ago - 6 comments

#70 - Add tokenize_and_pad function to backward compatible

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#69 - Create __init__.py in Jetstream/third_party

Pull Request - State: closed - Opened by bhavya01 7 months ago

#68 - Prerequisite work for supporting disaggregation:

Pull Request - State: closed - Opened by zhihaoshan-google 7 months ago

#67 - Support llama3 tokenizer

Pull Request - State: closed - Opened by bhavya01 7 months ago

#66 - Support llama3 tokenizer

Pull Request - State: closed - Opened by bhavya01 7 months ago

#65 - refactor slice_to_num_chips to adapt to Cloud config

Pull Request - State: closed - Opened by zhihaoshan-google 7 months ago

#64 - Detokenize error

Issue - State: closed - Opened by yeandy 7 months ago - 2 comments

#62 - Fix float division by zero in benchmark

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#61 - float division by zero in benchmark

Issue - State: open - Opened by FanhaiLu1 7 months ago - 2 comments

#60 - Fix requester flag default value

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#59 - Fix benchmark script type issue

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago - 2 comments

#58 - Benchmark serving: Failed to connect to remote host

Issue - State: closed - Opened by yeandy 7 months ago - 1 comment

#57 - Error with mutable list value in dataclass

Issue - State: closed - Opened by yeandy 7 months ago - 1 comment

#56 - Update maxtext user guide

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#55 - Add np padding support

Issue - State: closed - Opened by FanhaiLu1 7 months ago - 1 comment

#54 - Add jax_padding support driver and server lib

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#53 - Add an abstract class for Tokenizer

Pull Request - State: closed - Opened by bhavya01 7 months ago - 2 comments

#52 - Do nothing for nd array in copy_to_host_async

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#51 - Format token utils and test

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#50 - Update README.md to fix broken link

Pull Request - State: closed - Opened by charbull 7 months ago

#49 - Add np padded token support

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago - 2 comments

#48 - llama3 hack

Pull Request - State: closed - Opened by qihqi 7 months ago

#47 - Add missing Documentation

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#46 - CogVLM support

Issue - State: closed - Opened by BitPhinix 7 months ago - 1 comment

#45 - Refactor jestream to allow different tokenizers

Issue - State: open - Opened by qihqi 7 months ago - 1 comment

#44 - Support on Huggingface transformers

Issue - State: closed - Opened by ImKeTT 7 months ago - 2 comments

#43 - Update server host default value

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#42 - Reformat benchmark metrics

Pull Request - State: closed - Opened by yeandy 7 months ago - 3 comments

#41 - Refactor readme

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago - 6 comments

#40 - Align Tokenizer in JetStream

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#39 - Bump idna from 3.6 to 3.7

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#38 - Add badges for JetStream

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#37 - Reorganize unit tests and update CICD

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#36 - Update readme

Pull Request - State: closed - Opened by gangji 8 months ago

#35 - Update README.md with PT user guide

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#34 - Update README.md with user guides

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#33 - Add public user guide for serving Gemma on GKE with JetStream

Pull Request - State: closed - Opened by vivianrwu 8 months ago - 2 comments

#32 - add sample_idx in InputRequest for debugging

Pull Request - State: closed - Opened by morgandu 8 months ago

#31 - Release v0.2.0

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago - 1 comment

#30 - Update README

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago - 1 comment

#29 - Enable pylint linter and pyink formatter

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#28 - Support JetStream MaxText user guide

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#27 - move tokenizer model to third party llama2

Pull Request - State: closed - Opened by FanhaiLu1 8 months ago - 1 comment

#26 - Refactor to sample before tokenize

Pull Request - State: closed - Opened by morgandu 8 months ago

#25 - Update ckpt conversion scripts

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#24 - Fix whitespace replacement bug

Pull Request - State: closed - Opened by FanhaiLu1 8 months ago

#22 - Fix llama2 decode bug in tokenizer

Pull Request - State: closed - Opened by FanhaiLu1 8 months ago

#21 - Update benchmark to run openorca dataset

Pull Request - State: closed - Opened by morgandu 8 months ago

#20 - Add Token util unit test

Pull Request - State: closed - Opened by FanhaiLu1 8 months ago

#19 - Allows more requests than available data.

Pull Request - State: closed - Opened by patemotter 8 months ago

#17 - Adds filtering for sharegpt based on conversation starter.

Pull Request - State: closed - Opened by patemotter 8 months ago

#16 - Enable jax profiler server

Pull Request - State: closed - Opened by morgandu 8 months ago - 1 comment