exo-explore/exo issues and pull requests

#359 - Dummy Inference Engine

Pull Request - State: closed - Opened by nikpocuca 4 months ago - 2 comments

#357 - [BOUNTY - $100] Support running any model from huggingface

Issue - State: open - Opened by AlexCheema 4 months ago - 11 comments

#355 - Eror.faled to fetch completions: ror procesing prompt (see logswith DEUG>=2r: Cannot connect to host hugoingface.co.443 sstdefauit Connect calfailed (10424443.6, 43)

Issue - State: open - Opened by svm87601 4 months ago - 7 comments

#354 - Package exo as installable

Pull Request - State: closed - Opened by josh1593 4 months ago - 5 comments

#353 - LLaVa not working correctly

Issue - State: open - Opened by kuri54 4 months ago - 2 comments

#352 - [BOUNTY - $1000] Get exo Python node running on iOS

Issue - State: open - Opened by AlexCheema 4 months ago - 9 comments

#351 - TFLOPS on GTX 1660 - [email protected]

Pull Request - State: open - Opened by cabelo 4 months ago

#350 - 如何添加其他节点

Issue - State: open - Opened by ZH4201 4 months ago

#349 - Fix null download progress bug

Pull Request - State: open - Opened by Sean-fn 4 months ago

#348 - Screenshoot

Pull Request - State: closed - Opened by cabelo 4 months ago - 1 comment

#347 - TFLOPS on GTX 1050 - [email protected]

Pull Request - State: closed - Opened by cabelo 4 months ago - 1 comment

#346 - Adaptive Flops Partitioning Strategy

Pull Request - State: closed - Opened by DevEmilio96 4 months ago - 1 comment

#345 - GPU Support for Linux Virtual Environment on Windows Machines

Issue - State: open - Opened by Shivp1413 4 months ago - 3 comments

#344 - Fix gpu capabilities display

Pull Request - State: closed - Opened by Sean-fn 4 months ago - 1 comment

#343 - Incorrect FLOPS Display with GPU Names Including VRAM Size

Issue - State: closed - Opened by Sean-fn 4 months ago

#342 - benchmark for different inference engines

Pull Request - State: closed - Opened by AlexCheema 4 months ago - 1 comment

#341 - Vision Llama, Pixtral support and Vision integration test

Pull Request - State: closed - Opened by varshith15 4 months ago - 2 comments
Labels: revisit later

#340 - Manual Network Try 3.

Pull Request - State: closed - Opened by lipere123 4 months ago - 2 comments

#339 - Display download progress for all nodes in tinychat

Pull Request - State: closed - Opened by Sean-fn 4 months ago - 2 comments

#338 - Fix TFLOPS on 4060 Ti - [email protected]

Pull Request - State: closed - Opened by cabelo 4 months ago

#337 - Tinygrad Inference Router

Pull Request - State: open - Opened by reddyn12 4 months ago - 1 comment

#336 - Add new partition strategy

Pull Request - State: open - Opened by shivghai 4 months ago - 1 comment

#335 - Add LLama CPP Support

Pull Request - State: open - Opened by bayedieng 4 months ago

#334 - feat: Implement cross-platform executable compilation and distribution (WIP)

Pull Request - State: closed - Opened by SethBurkart123 4 months ago - 3 comments

#333 - feat: Use uv for Python Environment Management to Improve Install Speed

Pull Request - State: open - Opened by Yvictor 4 months ago - 5 comments

#332 - feat: add CircleCI job to create installables and script for standalone executable

Pull Request - State: open - Opened by PandelisZ 4 months ago - 1 comment

#331 - Dummy inference engine #325

Pull Request - State: closed - Opened by ji-cryptocafe 4 months ago - 6 comments

#330 - feat: partition by mem & node latency

Pull Request - State: closed - Opened by thenatlog 4 months ago - 1 comment

#329 - fix: tokenize in llava pipeline

Pull Request - State: closed - Opened by varshith15 4 months ago - 2 comments

#328 - [BOUNTY - $100] Vision Model Integration Test

Issue - State: open - Opened by AlexCheema 4 months ago - 7 comments

#327 - LLaVa Broken

Issue - State: closed - Opened by reddyn12 4 months ago - 4 comments

#326 - also initialize embed_tokens if last layer and tie_word_embeddings true

Pull Request - State: closed - Opened by AlexCheema 4 months ago - 1 comment

#325 - [BOUNTY - $100] DummyInferenceEngine

Issue - State: open - Opened by AlexCheema 4 months ago - 1 comment

#324 - Error processing prompt: Nvrtc Error 6, NVRTC_ERROR_COMPILATION When Running exo Command

Issue - State: open - Opened by iwoogy 4 months ago - 3 comments

#323 - Adding NVIDIA RTX 4000 ADA Try 2

Pull Request - State: closed - Opened by lipere123 4 months ago

#322 - CUDA out of memroy - Benjamin.

Issue - State: open - Opened by lipere123 4 months ago - 1 comment

#321 - Feature Request 「plz support InternLM2.5」

Issue - State: open - Opened by boshallen 4 months ago

#320 - What is the difference between this framework and DeepSpeed and FairScale

Issue - State: closed - Opened by thangpnb 4 months ago - 1 comment

#319 - Added my GPU NVIDIA RTX 4000 ADA GENERATION

Pull Request - State: closed - Opened by lipere123 4 months ago - 2 comments

#318 - Error processing prompt (see logs with DEBUG>=2): module load failed with status code 222: CUDA_ERROR_UNSUPPORTED_PTX_VERSION

Issue - State: open - Opened by Pentar0o 4 months ago

#317 - runtime error on device.py

Issue - State: open - Opened by gyillikci 4 months ago

#316 - License

Issue - State: open - Opened by mahald 4 months ago - 3 comments

#315 - Fix GPU names for RTX Ampere cards

Pull Request - State: closed - Opened by GaetanLepage 5 months ago - 8 comments

#314 - feat: available memory partition

Pull Request - State: closed - Opened by thenatlog 5 months ago

#313 - The return of step function is time consuming

Issue - State: closed - Opened by HysenX-LI 5 months ago - 2 comments

#312 - [BOUNTY - $100] tinychat download progress should show all nodes

Issue - State: open - Opened by AlexCheema 5 months ago - 4 comments

#311 - Manual discovery Try 2

Pull Request - State: closed - Opened by lipere123 5 months ago - 10 comments

#310 - race condition in on_listen_message for udp discovery fixes #308

Pull Request - State: closed - Opened by AlexCheema 5 months ago

#309 - fix the race condition in cleanup peers and run the peer checks concurrently. fixes #308

Pull Request - State: closed - Opened by AlexCheema 5 months ago

#308 - Networking issue on cluster of two raspberry pis

Issue - State: closed - Opened by dtnewman 5 months ago - 8 comments

#307 - [BOUNTY - $200] make it so process_prompt is cancellable outside of a download (follow up to #305)

Issue - State: open - Opened by AlexCheema 5 months ago - 1 comment

#306 - shield process_prompt so downloads dont get cancelled when chatgpt api request times out fixes #305

Pull Request - State: closed - Opened by AlexCheema 5 months ago

#305 - exo stops downloading when a chatgpt api request times out

Issue - State: closed - Opened by AlexCheema 5 months ago - 1 comment

#304 - [BOUNTY - $1000] exo browser node (WebGPU)

Issue - State: open - Opened by AlexCheema 5 months ago - 5 comments

#303 - error: no commands supplied

Issue - State: closed - Opened by fdzl22 5 months ago - 3 comments

#302 - [BOUNTY - $1500] Package exo as installable(s)

Issue - State: closed - Opened by AlexCheema 5 months ago - 8 comments

#301 - Pr139 dev oct24

Pull Request - State: closed - Opened by risingsunomi 5 months ago

#300 - Will exo support public internet access and service provider payment systems in the future?

Issue - State: open - Opened by dengbuqi 5 months ago - 7 comments

#299 - Manualdiscovery

Pull Request - State: closed - Opened by lipere123 5 months ago - 7 comments

#298 - Pr139 dev oct24

Pull Request - State: closed - Opened by risingsunomi 5 months ago

#297 - Dynamic TFLOPS Calculation

Pull Request - State: open - Opened by snico432 5 months ago - 13 comments

#296 - Feature request: specify GPU # if several installed

Issue - State: open - Opened by FFAMax 5 months ago - 2 comments

#295 - RuntimeError: Wait timeout: 10000 ms (local run)

Issue - State: open - Opened by FFAMax 5 months ago - 2 comments

#294 - No module named 'llvmlite'

Issue - State: open - Opened by FFAMax 5 months ago - 5 comments

#293 - [BOUNTY - $300] Support function/tool calling as laid out by OpenAI's API spec

Issue - State: open - Opened by vanakema 5 months ago - 16 comments

#292 - replace tailscale.devices with good old http, removing the need for tailscale dependency

Pull Request - State: closed - Opened by AlexCheema 5 months ago - 1 comment

#291 - Point `llama-3.1-70b-bf16` model to an actually bf16 version

Pull Request - State: closed - Opened by vanakema 5 months ago - 4 comments

#290 - Will it run on Raspberry Pi?

Issue - State: open - Opened by shakedzy 5 months ago - 4 comments

#289 - Use official nvidia-ml-py instead of pynvml

Pull Request - State: closed - Opened by GaetanLepage 5 months ago - 1 comment

#288 - (Bug?) `ValueError: size mismatched, can't reshape self.shape=(1, 25, 128256, 4096) -> new_shape=(1, 25, 32, 128)`

Issue - State: open - Opened by fullofcaffeine 5 months ago - 4 comments

#287 - Documentation around opening ports

Issue - State: open - Opened by jameszampa 5 months ago - 1 comment

#285 - Support for Jetson?

Issue - State: open - Opened by gyillikci 5 months ago - 29 comments

#284 - [BOUNTY - $500] Better PartitioningStrategy

Issue - State: open - Opened by AlexCheema 5 months ago - 3 comments

#283 - [BOUNTY - $500] Support multiple models running concurrently

Issue - State: open - Opened by AlexCheema 5 months ago - 8 comments

#279 - [BOUNTY - $200] Manual networking with configuration files

Issue - State: closed - Opened by AlexCheema 5 months ago - 7 comments

#275 - download progress & error messages

Issue - State: open - Opened by DevEmilio96 5 months ago - 5 comments

#274 - Host not healthy.

Issue - State: open - Opened by lipere123 5 months ago - 9 comments

#271 - minimal tokenizer wip

Pull Request - State: open - Opened by AlexCheema 5 months ago - 1 comment

#271 - minimal tokenizer wip

Pull Request - State: open - Opened by AlexCheema 5 months ago - 1 comment

#270 - add script to calculate pipsize

Pull Request - State: closed - Opened by AlexCheema 5 months ago - 1 comment

#270 - add script to calculate pipsize

Pull Request - State: closed - Opened by AlexCheema 5 months ago - 1 comment

#269 - Many things to improve or fix

Issue - State: open - Opened by darkanubis0100 5 months ago - 4 comments

#268 - better ring topology image

Pull Request - State: closed - Opened by AlexCheema 5 months ago - 1 comment

#268 - better ring topology image

Pull Request - State: closed - Opened by AlexCheema 5 months ago - 1 comment

#267 - source install.sh

Issue - State: open - Opened by MiguelSanzBr 5 months ago - 6 comments

#253 - Unable to format index.html

Issue - State: closed - Opened by pr4j3sh 5 months ago - 3 comments

#249 - [BOUNTY - $100] Add support for LLaVA (tinygrad)

Issue - State: open - Opened by AlexCheema 5 months ago - 5 comments

#248 - add support for qwen2.5 coder 1.5b and 7b fixes #247

Pull Request - State: closed - Opened by AlexCheema 5 months ago - 2 comments

#246 - Support local and custom models

Pull Request - State: open - Opened by leo4life2 5 months ago - 1 comment

#245 - The return of step function is time consuming

Issue - State: closed - Opened by HysenX-LI 5 months ago - 2 comments

#243 - [BOUNTY - $200] Dynamic TFLOPS calculation

Issue - State: open - Opened by AlexCheema 5 months ago - 1 comment
Labels: bug

#241 - we need option to use intel graphics like (intel iris xe)

Issue - State: open - Opened by Kbassem10 5 months ago - 9 comments

#238 - [BOUNTY - $1000] Compile tinygrad to swift

Issue - State: open - Opened by AlexCheema 5 months ago - 26 comments

#235 - Showing 0 TFLOPS for Linux (Ubuntu 22.04, Quadro RTX 4000) + CUDA out of memory error on Llama 3.1 8B

Issue - State: open - Opened by fullofcaffeine 5 months ago - 4 comments

#234 - [BOUNTY - $500] JAX Inference Engine

Issue - State: open - Opened by AlexCheema 5 months ago - 4 comments

GitHub / exo-explore/exo issues and pull requests