exo-explore/exo issues and pull requests

#351 - TFLOPS on GTX 1660 - [email protected]

Pull Request - State: open - Opened by cabelo 29 days ago

#350 - 如何添加其他节点

Issue - State: open - Opened by ZH4201 29 days ago

#349 - Fix null download progress bug

Pull Request - State: open - Opened by Sean-fn 29 days ago

#348 - Screenshoot

Pull Request - State: closed - Opened by cabelo 30 days ago - 1 comment

#347 - TFLOPS on GTX 1050 - [email protected]

Pull Request - State: closed - Opened by cabelo 30 days ago - 1 comment

#346 - Adaptive Flops Partitioning Strategy

Pull Request - State: open - Opened by DevEmilio96 30 days ago

#345 - GPU Support for Linux Virtual Environment on Windows Machines

Issue - State: open - Opened by Shivp1413 about 1 month ago - 1 comment

#344 - Fix gpu capabilities display

Pull Request - State: closed - Opened by Sean-fn about 1 month ago - 1 comment

#343 - Incorrect FLOPS Display with GPU Names Including VRAM Size

Issue - State: closed - Opened by Sean-fn about 1 month ago

#342 - benchmark for different inference engines

Pull Request - State: open - Opened by AlexCheema about 1 month ago

#341 - Llama Vision & Pixtral support

Pull Request - State: open - Opened by varshith15 about 1 month ago

#340 - Manual Network Try 3.

Pull Request - State: open - Opened by lipere123 about 1 month ago - 1 comment

#339 - Display download progress for all nodes in tinychat

Pull Request - State: closed - Opened by Sean-fn about 1 month ago - 2 comments

#338 - Fix TFLOPS on 4060 Ti - [email protected]

Pull Request - State: closed - Opened by cabelo about 1 month ago

#337 - Tinygrad Inference Router

Pull Request - State: open - Opened by reddyn12 about 1 month ago - 1 comment

#336 - Add new partition strategy

Pull Request - State: open - Opened by shivghai about 1 month ago - 1 comment

#335 - Add LLama CPP Support

Pull Request - State: open - Opened by bayedieng about 1 month ago

#334 - feat: Implement cross-platform executable compilation and distribution (WIP)

Pull Request - State: open - Opened by SethBurkart123 about 1 month ago - 2 comments

#333 - feat: Use uv for Python Environment Management to Improve Install Speed

Pull Request - State: open - Opened by Yvictor about 1 month ago - 3 comments

#332 - feat: add CircleCI job to create installables and script for standalone executable

Pull Request - State: open - Opened by PandelisZ about 1 month ago - 1 comment

#331 - Dummy inference engine #325

Pull Request - State: open - Opened by ji-cryptocafe about 1 month ago - 4 comments

#330 - feat: partition by mem & node latency

Pull Request - State: open - Opened by thenatlog about 1 month ago

#329 - fix: tokenize in llava pipeline

Pull Request - State: closed - Opened by varshith15 about 1 month ago - 2 comments

#328 - [BOUNTY - $100] Vision Model Integration Test

Issue - State: open - Opened by AlexCheema about 1 month ago - 7 comments

#327 - LLaVa Broken

Issue - State: closed - Opened by reddyn12 about 1 month ago - 4 comments

#326 - also initialize embed_tokens if last layer and tie_word_embeddings true

Pull Request - State: closed - Opened by AlexCheema about 1 month ago - 1 comment

#325 - [BOUNTY - $100] DummyInferenceEngine

Issue - State: open - Opened by AlexCheema about 1 month ago - 1 comment

#324 - Error processing prompt: Nvrtc Error 6, NVRTC_ERROR_COMPILATION When Running exo Command

Issue - State: open - Opened by iwoogy about 1 month ago - 2 comments

#323 - Adding NVIDIA RTX 4000 ADA Try 2

Pull Request - State: closed - Opened by lipere123 about 1 month ago

#322 - CUDA out of memroy - Benjamin.

Issue - State: open - Opened by lipere123 about 1 month ago - 1 comment

#321 - Feature Request 「plz support InternLM2.5」

Issue - State: open - Opened by boshallen about 1 month ago

#320 - What is the difference between this framework and DeepSpeed and FairScale

Issue - State: closed - Opened by thangpnb about 1 month ago - 1 comment

#319 - Added my GPU NVIDIA RTX 4000 ADA GENERATION

Pull Request - State: closed - Opened by lipere123 about 1 month ago - 2 comments

#318 - Error processing prompt (see logs with DEBUG>=2): module load failed with status code 222: CUDA_ERROR_UNSUPPORTED_PTX_VERSION

Issue - State: open - Opened by Pentar0o about 1 month ago

#317 - runtime error on device.py

Issue - State: open - Opened by gyillikci about 1 month ago

#316 - License

Issue - State: open - Opened by mahald about 1 month ago - 2 comments

#315 - Fix GPU names for RTX Ampere cards

Pull Request - State: closed - Opened by GaetanLepage about 1 month ago - 8 comments

#314 - feat: available memory partition

Pull Request - State: open - Opened by thenatlog about 1 month ago

#313 - The return of step function is time consuming

Issue - State: closed - Opened by HysenX-LI about 1 month ago - 2 comments

#312 - [BOUNTY - $100] tinychat download progress should show all nodes

Issue - State: open - Opened by AlexCheema about 1 month ago - 4 comments

#311 - Manual discovery Try 2

Pull Request - State: closed - Opened by lipere123 about 1 month ago - 10 comments

#310 - race condition in on_listen_message for udp discovery fixes #308

Pull Request - State: closed - Opened by AlexCheema about 1 month ago

#309 - fix the race condition in cleanup peers and run the peer checks concurrently. fixes #308

Pull Request - State: closed - Opened by AlexCheema about 1 month ago

#308 - Networking issue on cluster of two raspberry pis

Issue - State: closed - Opened by dtnewman about 1 month ago - 8 comments

#307 - [BOUNTY - $200] make it so process_prompt is cancellable outside of a download (follow up to #305)

Issue - State: open - Opened by AlexCheema about 1 month ago - 1 comment

#306 - shield process_prompt so downloads dont get cancelled when chatgpt api request times out fixes #305

Pull Request - State: closed - Opened by AlexCheema about 1 month ago

#305 - exo stops downloading when a chatgpt api request times out

Issue - State: closed - Opened by AlexCheema about 1 month ago - 1 comment

#304 - [BOUNTY - $1000] exo browser node (WebGPU)

Issue - State: open - Opened by AlexCheema about 1 month ago

#303 - error: no commands supplied

Issue - State: closed - Opened by fdzl22 about 1 month ago - 3 comments

#302 - [BOUNTY - $1500] Package exo as installable(s)

Issue - State: open - Opened by AlexCheema about 1 month ago - 6 comments

#301 - Pr139 dev oct24

Pull Request - State: closed - Opened by risingsunomi about 1 month ago

#300 - Will exo support public internet access and service provider payment systems in the future?

Issue - State: open - Opened by dengbuqi about 1 month ago - 2 comments

#299 - Manualdiscovery

Pull Request - State: closed - Opened by lipere123 about 1 month ago - 7 comments

#298 - Pr139 dev oct24

Pull Request - State: closed - Opened by risingsunomi about 1 month ago

#297 - Dynamic TFLOPS Calculation

Pull Request - State: open - Opened by snico432 about 1 month ago - 8 comments

#296 - Feature request: specify GPU # if several installed

Issue - State: open - Opened by FFAMax about 1 month ago - 2 comments

#295 - RuntimeError: Wait timeout: 10000 ms (local run)

Issue - State: open - Opened by FFAMax about 1 month ago - 2 comments

#294 - No module named 'llvmlite'

Issue - State: open - Opened by FFAMax about 1 month ago - 2 comments

#293 - [BOUNTY - $300] Support function/tool calling as laid out by OpenAI's API spec

Issue - State: open - Opened by vanakema about 1 month ago - 3 comments

#292 - replace tailscale.devices with good old http, removing the need for tailscale dependency

Pull Request - State: closed - Opened by AlexCheema about 1 month ago - 1 comment

#291 - Point `llama-3.1-70b-bf16` model to an actually bf16 version

Pull Request - State: closed - Opened by vanakema about 1 month ago - 4 comments

#290 - Will it run on Raspberry Pi?

Issue - State: open - Opened by shakedzy about 1 month ago - 4 comments

#289 - Use official nvidia-ml-py instead of pynvml

Pull Request - State: closed - Opened by GaetanLepage about 1 month ago - 1 comment

#288 - (Bug?) `ValueError: size mismatched, can't reshape self.shape=(1, 25, 128256, 4096) -> new_shape=(1, 25, 32, 128)`

Issue - State: open - Opened by fullofcaffeine about 1 month ago - 3 comments

#287 - Documentation around opening ports

Issue - State: open - Opened by jameszampa about 1 month ago

#285 - Support for Jetson?

Issue - State: open - Opened by gyillikci about 1 month ago - 2 comments

#284 - [BOUNTY - $500] Better PartitioningStrategy

Issue - State: open - Opened by AlexCheema about 1 month ago - 2 comments

#279 - [BOUNTY - $200] Manual networking with configuration files

Issue - State: open - Opened by AlexCheema about 1 month ago - 7 comments

#274 - Host not healthy.

Issue - State: open - Opened by lipere123 about 1 month ago - 9 comments

#269 - Many things to improve or fix

Issue - State: open - Opened by darkanubis0100 about 1 month ago - 2 comments

#267 - source install.sh

Issue - State: open - Opened by MiguelSanzBr about 1 month ago - 6 comments

#253 - Unable to format index.html

Issue - State: closed - Opened by pr4j3sh about 1 month ago - 3 comments

#249 - [BOUNTY - $100] Add support for LLaVA (tinygrad)

Issue - State: open - Opened by AlexCheema about 1 month ago - 1 comment

#245 - The return of step function is time consuming

Issue - State: closed - Opened by HysenX-LI about 1 month ago - 2 comments

#243 - [BOUNTY - $200] Dynamic TFLOPS calculation

Issue - State: open - Opened by AlexCheema about 2 months ago - 1 comment
Labels: bug

#241 - we need option to use intel graphics like (intel iris xe)

Issue - State: open - Opened by Kbassem10 about 2 months ago - 8 comments

#238 - [BOUNTY - $1000] Compile tinygrad to swift

Issue - State: open - Opened by AlexCheema about 2 months ago - 12 comments

#234 - [BOUNTY - $500] JAX Inference Engine

Issue - State: open - Opened by AlexCheema about 2 months ago - 2 comments

#233 - Removing download task for Shard(model_id='mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated', start_layer=0, end_layer=31, n_layers=32):

Issue - State: open - Opened by csmVIc about 2 months ago - 2 comments

#232 - Health checks

Pull Request - State: closed - Opened by AlexCheema about 2 months ago

#231 - Issue with loading weights

Issue - State: open - Opened by JohnLee1360 about 2 months ago - 4 comments

#230 - Combine with the Bitcoin blockchain reward mechanism

Issue - State: open - Opened by jkm199 about 2 months ago - 7 comments

#229 - Tailscale

Pull Request - State: closed - Opened by AlexCheema about 2 months ago - 1 comment

#228 - Update README.md

Pull Request - State: closed - Opened by Yazington about 2 months ago - 1 comment

#227 - Fix issue where offline node cannot detect online node over thunderbolt

Pull Request - State: closed - Opened by vanakema about 2 months ago - 1 comment

#226 - fix allow patterns

Pull Request - State: closed - Opened by bayedieng about 2 months ago - 6 comments

#224 - Update README.md

Pull Request - State: open - Opened by nicholasyfu1 about 2 months ago

#223 - [BOUNTY - $300] Support Multi-GPU

Issue - State: open - Opened by AlexCheema about 2 months ago - 1 comment

#218 - Pixtral support

Pull Request - State: closed - Opened by varshith15 about 2 months ago - 6 comments

#217 - feat: support HF_ENDPOINT base url ENV VAR

Pull Request - State: open - Opened by jshield 2 months ago - 3 comments

#216 - HF_ENDPOINT support

Issue - State: open - Opened by jshield 2 months ago - 1 comment

#215 - [BOUNTY - $100] Pixtral Support

Issue - State: open - Opened by AlexCheema 2 months ago - 2 comments

#214 - batched inference

Pull Request - State: open - Opened by varshith15 2 months ago - 2 comments

#213 - Tinygrad quantization support

Pull Request - State: open - Opened by varshith15 2 months ago - 3 comments

#211 - Implement parallel model preloading

Pull Request - State: open - Opened by aybanda 2 months ago - 2 comments

#210 - Improve setup.py for proper installation

Pull Request - State: open - Opened by GaetanLepage 2 months ago

GitHub / exo-explore/exo issues and pull requests