Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / google/JetStream issues and pull requests

#138 - Change previewutilities -> pathwaysutils

Pull Request - State: closed - Opened by vivianrwu about 2 months ago

#135 - Support completions API

Issue - State: open - Opened by nstogner 3 months ago

#133 - Add an optional parameter for sampling in prefill / sample.

Pull Request - State: closed - Opened by qihqi 3 months ago - 1 comment

#132 - Update JetStream instructions

Pull Request - State: closed - Opened by yeandy 3 months ago

#131 - Clean up Model Conversion Script

Issue - State: open - Opened by yeandy 3 months ago - 2 comments

#130 - Update deps file

Pull Request - State: closed - Opened by JoeZijunZhou 3 months ago

#129 - Standalone JetStream removes pinned deps

Pull Request - State: closed - Opened by JoeZijunZhou 4 months ago

#128 - Added `jetstream_total_tokens_in_current_batch` metric

Pull Request - State: open - Opened by Bslabe123 4 months ago

#127 - Refactor Prometheus Metrics Logic and Added to Docs

Pull Request - State: open - Opened by Bslabe123 4 months ago

#126 - Manual model warmup to resolve AOT model warmup performance degradation

Pull Request - State: closed - Opened by vivianrwu 4 months ago - 3 comments

#125 - Makefile

Pull Request - State: closed - Opened by Bslabe123 4 months ago - 1 comment

#124 - Add `jetstream_request_success_count` metric

Pull Request - State: closed - Opened by Bslabe123 4 months ago - 1 comment

#123 - Request input/output size metrics

Pull Request - State: closed - Opened by Bslabe123 4 months ago

#122 - Performance optimized interleaved mode JetStream server

Pull Request - State: open - Opened by JoeZijunZhou 4 months ago - 2 comments

#121 - Various request time metrics

Pull Request - State: closed - Opened by Bslabe123 4 months ago - 1 comment

#120 - when to support gpu?

Issue - State: open - Opened by Mddct 4 months ago - 1 comment

#109 - Add loadgen in dev image

Pull Request - State: closed - Opened by morgandu 5 months ago

#107 - Update docs with metrics observation instructions

Pull Request - State: closed - Opened by Bslabe123 5 months ago

#106 - Update docs for benchmark warmup mode

Pull Request - State: closed - Opened by JoeZijunZhou 5 months ago

#105 - Prefill return first token

Pull Request - State: closed - Opened by jwyang-google 5 months ago

#104 - Bump urllib3 from 2.2.0 to 2.2.2 in the pip group across 1 directory

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies

#101 - Add profiling server for proxy backend

Pull Request - State: closed - Opened by zhihaoshan-google 6 months ago

#100 - Add inference sampling utils in JetStream

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#99 - Add ssh port forward support for profile readme

Pull Request - State: closed - Opened by FanhaiLu1 6 months ago

#98 - Minor fix

Pull Request - State: closed - Opened by morgandu 6 months ago

#97 - Add tensorboard plugin dep for remote access

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#96 - Update benchmark config for xlml automation

Pull Request - State: closed - Opened by morgandu 6 months ago

#95 - Release v0.2.2

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#94 - Enable JetStream Standalone Server

Pull Request - State: open - Opened by JoeZijunZhou 6 months ago - 1 comment

#93 - chore: update model_ckpt_conversion.sh

Pull Request - State: closed - Opened by eltociear 6 months ago - 2 comments

#92 - Model warmup support with AOT and endpoint for JetStream

Pull Request - State: open - Opened by vivianrwu 6 months ago - 2 comments

#91 - Ensure server warmup before benchmark

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago - 4 comments

#90 - Add healthcheck support for JetStream

Pull Request - State: closed - Opened by vivianrwu 6 months ago - 1 comment

#89 - Add JetStream E2E test CI

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#88 - Remove jax dependencies in JetStream

Issue - State: open - Opened by FanhaiLu1 6 months ago

#87 - Add ray disaggregated serving support

Pull Request - State: closed - Opened by FanhaiLu1 6 months ago - 2 comments

#86 - Bump requests from 2.31.0 to 2.32.0 in the pip group across 1 directory

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: dependencies

#85 - Add profiling support and update docs

Pull Request - State: closed - Opened by JoeZijunZhou 6 months ago

#84 - Allow tokenizer to customize stop_tokens

Pull Request - State: closed - Opened by qihqi 6 months ago

#83 - Update benchmark script to easily test llama-3

Pull Request - State: closed - Opened by bhavya01 6 months ago

#82 - Decode Batch Percentage Metrics/Improved Scraping

Pull Request - State: closed - Opened by Bslabe123 7 months ago

#81 - Unit test coverage cleanup

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#80 - Fix pad_tokens function description

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#79 - Support I/O with text and token ids

Issue - State: closed - Opened by JoeZijunZhou 7 months ago - 2 comments

#78 - Update JetStream grpc proto to support I/O with text and token ids

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago - 8 comments

#77 - Add metadata metrics

Pull Request - State: closed - Opened by yeandy 7 months ago

#76 - Accuracy eval mlperf

Pull Request - State: closed - Opened by jwyang-google 7 months ago

#74 - Release v0.2.1 with docs update

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago - 1 comment

#73 - Bump tqdm from 4.66.1 to 4.66.3 in the pip group across 1 directory

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago
Labels: dependencies

#72 - Release v0.2.1

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#71 - Prometheus Metrics

Pull Request - State: closed - Opened by Bslabe123 7 months ago - 6 comments

#70 - Add tokenize_and_pad function to backward compatible

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#69 - Create __init__.py in Jetstream/third_party

Pull Request - State: closed - Opened by bhavya01 7 months ago

#68 - Prerequisite work for supporting disaggregation:

Pull Request - State: closed - Opened by zhihaoshan-google 7 months ago

#67 - Support llama3 tokenizer

Pull Request - State: closed - Opened by bhavya01 7 months ago

#66 - Support llama3 tokenizer

Pull Request - State: closed - Opened by bhavya01 7 months ago

#65 - refactor slice_to_num_chips to adapt to Cloud config

Pull Request - State: closed - Opened by zhihaoshan-google 7 months ago

#64 - Detokenize error

Issue - State: closed - Opened by yeandy 7 months ago - 2 comments

#62 - Fix float division by zero in benchmark

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#61 - float division by zero in benchmark

Issue - State: open - Opened by FanhaiLu1 7 months ago - 2 comments

#60 - Fix requester flag default value

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#59 - Fix benchmark script type issue

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago - 2 comments

#58 - Benchmark serving: Failed to connect to remote host

Issue - State: closed - Opened by yeandy 7 months ago - 1 comment

#57 - Error with mutable list value in dataclass

Issue - State: closed - Opened by yeandy 7 months ago - 1 comment

#56 - Update maxtext user guide

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#55 - Add np padding support

Issue - State: closed - Opened by FanhaiLu1 7 months ago - 1 comment

#54 - Add jax_padding support driver and server lib

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#53 - Add an abstract class for Tokenizer

Pull Request - State: closed - Opened by bhavya01 7 months ago - 2 comments

#52 - Do nothing for nd array in copy_to_host_async

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#51 - Format token utils and test

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#50 - Update README.md to fix broken link

Pull Request - State: closed - Opened by charbull 7 months ago

#49 - Add np padded token support

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago - 2 comments

#48 - llama3 hack

Pull Request - State: closed - Opened by qihqi 7 months ago

#47 - Add missing Documentation

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago

#46 - CogVLM support

Issue - State: closed - Opened by BitPhinix 7 months ago - 1 comment

#45 - Refactor jestream to allow different tokenizers

Issue - State: open - Opened by qihqi 7 months ago - 1 comment

#44 - Support on Huggingface transformers

Issue - State: closed - Opened by ImKeTT 7 months ago - 2 comments

#43 - Update server host default value

Pull Request - State: closed - Opened by JoeZijunZhou 7 months ago

#42 - Reformat benchmark metrics

Pull Request - State: closed - Opened by yeandy 7 months ago - 3 comments

#41 - Refactor readme

Pull Request - State: closed - Opened by FanhaiLu1 7 months ago - 6 comments

#40 - Align Tokenizer in JetStream

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#39 - Bump idna from 3.6 to 3.7

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#38 - Add badges for JetStream

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#37 - Reorganize unit tests and update CICD

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#36 - Update readme

Pull Request - State: closed - Opened by gangji 8 months ago

#35 - Update README.md with PT user guide

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#34 - Update README.md with user guides

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago

#33 - Add public user guide for serving Gemma on GKE with JetStream

Pull Request - State: closed - Opened by vivianrwu 8 months ago - 2 comments

#32 - add sample_idx in InputRequest for debugging

Pull Request - State: closed - Opened by morgandu 8 months ago

#31 - Release v0.2.0

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago - 1 comment

#30 - Update README

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago - 1 comment

#29 - Enable pylint linter and pyink formatter

Pull Request - State: closed - Opened by JoeZijunZhou 8 months ago