openucx/sparkucx issues and pull requests

#41 - bug fix: metadata buffer resident in Spark driver may go out of range

Pull Request - State: open - Opened by endersuu almost 2 years ago

#40 - will ucx release its support for spark >= 3.1

Issue - State: open - Opened by mtsol over 2 years ago

#39 - java.lang.VerifyError: class org.apache.spark.shuffle.UcxShuffleManager overrides final method getReader.(Lorg/apache/spark/shuffle/ShuffleHandle;IILorg/apache/spark/TaskContext;Lorg/apache/spark/shuffle/ShuffleReadMetricsReporter;)Lorg/apache/spark/shuffle/ShuffleReader;

Issue - State: open - Opened by mtsol over 2 years ago

#38 - Didn't get worker address for BlockManagerId(2, xxx, xxx, None) during 3600

Issue - State: open - Opened by eric-doug over 2 years ago

#37 - Is UCX also supported in spark 3.1.2 with java 11

Issue - State: open - Opened by KunwarAkanksha almost 3 years ago - 1 comment

#36 - feat: Support Spark-3.1 version.

Pull Request - State: closed - Opened by trietopsoft over 3 years ago - 1 comment

#35 - Update LICENSE

Pull Request - State: closed - Opened by petro-rudenko over 3 years ago

#34 - Fix errors on UcxNode close.

Pull Request - State: closed - Opened by petro-rudenko over 3 years ago

#33 - Support Spark-2.1 version.

Pull Request - State: closed - Opened by petro-rudenko over 3 years ago

#32 - Update master version with JUCX 1.11-rc3 and update README.

Pull Request - State: closed - Opened by petro-rudenko over 3 years ago

#31 - Latest work done for unified API

Pull Request - State: open - Opened by petro-rudenko over 3 years ago

#30 - SIGSEGV in JVM Runtime

Issue - State: open - Opened by stevenybw almost 4 years ago - 9 comments

#29 - Fix java path in AZP + update JUCX version.

Pull Request - State: closed - Opened by petro-rudenko over 4 years ago - 1 comment

#28 - Avoid get lock from synchronized in every shuffle

Pull Request - State: closed - Opened by wenxuanguan over 4 years ago - 5 comments

#27 - Performance benchmark

Pull Request - State: open - Opened by petro-rudenko over 4 years ago - 1 comment

#26 - [WIP] Spark Shuffle manager implementation.

Pull Request - State: open - Opened by petro-rudenko over 4 years ago - 2 comments

#25 - Public transport api implementation

Pull Request - State: closed - Opened by petro-rudenko over 4 years ago - 5 comments

#24 - Can the sparkucx can be used when UCX_TLS=tcp ?

Issue - State: open - Opened by X-zhazhaxi over 4 years ago - 4 comments

#23 - Public Shuffle Transport API.

Pull Request - State: closed - Opened by petro-rudenko over 4 years ago - 5 comments

#22 - Update README and prepare release action.

Pull Request - State: closed - Opened by petro-rudenko almost 5 years ago - 1 comment

#21 - [CORE] Spark-3.0 reducer protocol.

Pull Request - State: closed - Opened by petro-rudenko almost 5 years ago - 1 comment

#20 - [CORE] Spark-3.0 mapper writer plugin implementation.

Pull Request - State: closed - Opened by petro-rudenko almost 5 years ago - 1 comment

#19 - [CORE] use ucx from hpcx module, disable mt workers.

Pull Request - State: closed - Opened by petro-rudenko almost 5 years ago - 1 comment

#18 - [CORE] Split common / version dependent code.

Pull Request - State: closed - Opened by petro-rudenko about 5 years ago - 1 comment

#17 - [CORE] Update to jucx-1.8.

Pull Request - State: closed - Opened by petro-rudenko about 5 years ago - 1 comment

#16 - [CORE] Reducer protocol.

Pull Request - State: closed - Opened by petro-rudenko about 5 years ago - 2 comments

#15 - [CORE] Mapper protocol implementation.

Pull Request - State: closed - Opened by petro-rudenko about 5 years ago

#14 - [CORE] UcxShuffleManager implementation.

Pull Request - State: closed - Opened by petro-rudenko about 5 years ago

#14 - [CORE] UcxShuffleManager implementation.

Pull Request - State: closed - Opened by petro-rudenko about 5 years ago

#13 - [DNM] POC branch

Pull Request - State: closed - Opened by petro-rudenko about 5 years ago
Labels: DNM

#12 - [CI] Testing script.

Pull Request - State: closed - Opened by petro-rudenko about 5 years ago - 13 comments

#11 - Benchmark on performance

Issue - State: open - Opened by TheForgotten69 about 5 years ago