Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / AI-Hypercomputer/jetstream-pytorch issues and pull requests

#208 - Add deepseek distils as options

Pull Request - State: open - Opened by bluecoconut about 1 month ago

#207 - Update README.md

Pull Request - State: closed - Opened by qihqi about 1 month ago

#206 - Raise error if weights are not loaded

Pull Request - State: closed - Opened by qihqi 2 months ago

#205 - Llama 3.1 RoPE scaling

Pull Request - State: closed - Opened by tengomucho 2 months ago - 2 comments

#204 - Update jax version to 0.4.37

Pull Request - State: closed - Opened by qihqi 2 months ago - 1 comment

#202 - update branch tag in tutorial

Pull Request - State: closed - Opened by sixiang-google 2 months ago

#201 - Add `prometheus_port` flag to CLI

Pull Request - State: closed - Opened by Bslabe123 2 months ago

#200 - Support passing custom sampling function.

Pull Request - State: open - Opened by wang2yn84 3 months ago

#199 - Enable jax compilation flags for jpt

Pull Request - State: closed - Opened by vivianrwu 4 months ago

#198 - Add jax compilation cache config

Pull Request - State: closed - Opened by vivianrwu 4 months ago

#197 - Add model warmup flag into cli

Pull Request - State: closed - Opened by vivianrwu 4 months ago

#196 - Fix: correct quantization name filtering

Pull Request - State: closed - Opened by tengomucho 4 months ago

#195 - Add per request sampling support.

Pull Request - State: open - Opened by wang2yn84 4 months ago

#194 - feat: add quantize exclude layer flag

Pull Request - State: closed - Opened by tengomucho 4 months ago - 2 comments

#193 - fix: correct error message

Pull Request - State: closed - Opened by tengomucho 4 months ago - 1 comment

#192 - add local tokenizer option for automated testing without hf token

Pull Request - State: closed - Opened by sixiang-google 4 months ago - 1 comment

#190 - Delete convert_checkpoints and helper classmethods.

Pull Request - State: closed - Opened by qihqi 5 months ago

#188 - Make jpt the default cli - remove other entry point scripts

Pull Request - State: closed - Opened by qihqi 5 months ago - 2 comments

#149 - Fix blockwise sharding

Pull Request - State: closed - Opened by lsy323 7 months ago

#100 - Fix ray conflict changes

Pull Request - State: closed - Opened by FanhaiLu1 9 months ago - 2 comments

#99 - Pass metrics client config through to Jetstream

Pull Request - State: closed - Opened by Bslabe123 9 months ago - 1 comment

#98 - Fix gemma model, enable_weight_quantization is available through quant_config.

Pull Request - State: closed - Opened by wang2yn84 9 months ago - 1 comment

#96 - Fix flax and ray dependencies

Pull Request - State: closed - Opened by FanhaiLu1 9 months ago

#95 - Fixes tests. Can now run on CPU by default.

Pull Request - State: closed - Opened by wang2yn84 9 months ago - 4 comments

#93 - Integrates ragged attention to JetStream Pytorch

Pull Request - State: closed - Opened by wang2yn84 9 months ago

#92 - Move flags in scripts to a common function

Pull Request - State: closed - Opened by lsy323 9 months ago

#91 - Update README.md

Pull Request - State: closed - Opened by qihqi 9 months ago

#90 - Leverage tokens_utils to process result tokens

Pull Request - State: closed - Opened by FanhaiLu1 9 months ago

#89 - Move deps to git submodule

Pull Request - State: closed - Opened by qihqi 9 months ago

#88 - Update version of jetstream; misc fixes

Pull Request - State: closed - Opened by qihqi 9 months ago

#87 - Update README.md

Pull Request - State: closed - Opened by JackCaoG 9 months ago - 3 comments

#86 - Fix sharding config file name bug

Pull Request - State: closed - Opened by FanhaiLu1 9 months ago

#85 - Add Gemma 2b benchmark; fix a typo.

Pull Request - State: closed - Opened by qihqi 9 months ago

#84 - Enable Blockwise Int4 quantized linear layer

Pull Request - State: closed - Opened by lsy323 9 months ago - 1 comment

#83 - Clean up flags

Issue - State: closed - Opened by qihqi 9 months ago

#82 - How to run benchmark on CloudTPU v4-8

Issue - State: closed - Opened by JackCaoG 9 months ago - 7 comments

#81 - Add Gemma 2b benchmark; fix a typo.

Pull Request - State: closed - Opened by qihqi 9 months ago

#80 - Add shard on batch mode. Als update version of torchxla2

Pull Request - State: closed - Opened by qihqi 9 months ago

#79 - Add llama-3 instructions to readme

Pull Request - State: closed - Opened by bhavya01 9 months ago

#78 - Fix attention kernel of GQA use case

Pull Request - State: closed - Opened by lsy323 10 months ago

#77 - Enable quantization for Gemma 7b

Pull Request - State: closed - Opened by qihqi 10 months ago

#76 - Add benchmark results

Pull Request - State: closed - Opened by qihqi 10 months ago

#75 - Enable Gemma 2B

Pull Request - State: closed - Opened by qihqi 10 months ago

#74 - Add gemma and update recent changes to multiple host

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#73 - Fix sharding config for quant

Pull Request - State: closed - Opened by lsy323 10 months ago

#72 - Use GemmaAttention for Gemma

Pull Request - State: closed - Opened by qihqi 10 months ago

#71 - Support converting hf gemma weights

Pull Request - State: closed - Opened by lsy323 10 months ago - 6 comments

#70 - Gemma sharding and test

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#69 - Add gemma support

Pull Request - State: closed - Opened by qihqi 10 months ago

#68 - Add prefill only benchmark for different token length

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#67 - Pick a slot from 0 to batch_size-1 during run_interactive.py

Pull Request - State: closed - Opened by bhavya01 10 months ago - 1 comment

#66 - Add vscode to gitignore

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#65 - Refactor so that environment and engine

Pull Request - State: closed - Opened by qihqi 10 months ago - 1 comment

#64 - Support llama3

Pull Request - State: closed - Opened by bhavya01 10 months ago - 6 comments

#63 - Add ray multiple host support

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago - 4 comments

#62 - Ignore duplicated lines check now

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#61 - Output all token text

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#59 - Use property instead of function

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#58 - Enable pylint check

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#57 - Fix run_server lint check

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#56 - Fix run_interactive lint check

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#55 - Fix convert checkpoint lint check

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#54 - Add pylintrc and init in root dir

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#53 - Fix quantizaiton, jax lint and llama e2e

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#52 - Fix quantizaiton and jax lint check

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#51 - Fix test quantization lint check

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#50 - Fix test_model_impl lint

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#49 - Clean up llama_e2e test

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#48 - Cleanup test_jax_torch

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#47 - Disable test_engine check for now

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#46 - Add pylintrc to tests

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#45 - Clean up config.py

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#44 - Cleanup quantize

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#43 - Cleanup environment

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#42 - Clean up engine

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#41 - Cleanup cache_manager

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#40 - Add .pylintrc

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#39 - Clean up benchmarks files

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#38 - Cleanup run_offline

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#37 - Remove duplicated test

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#36 - Fix pylint for micro benchmark

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#35 - Use 2 space as indentation

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#34 - Enable pylint check

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#33 - Enable pyink check

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#32 - Cleanup and format main dir code

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#31 - Cleanup and format benchmark code

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#30 - Cleanup and format test code

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#29 - Cleanup and format engine code

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#28 - Cleanup and format third party code

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#27 - Ray multiple host support

Issue - State: closed - Opened by FanhaiLu1 10 months ago - 1 comment

#26 - llama3

Pull Request - State: closed - Opened by qihqi 10 months ago

#25 - Add original llama prefill and decode

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#24 - update create TPU VM link

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago

#23 - Add jetstream links

Pull Request - State: closed - Opened by FanhaiLu1 10 months ago