oap-project/remote-shuffle issues and pull requests

#77 - Remote Shuffle Implementation for Spark 3.3.1

Pull Request - State: open - Opened by raviranak 11 months ago - 2 comments

#76 - [REMOTE-SUFFULE 75] fix OpenSSF issues

Pull Request - State: closed - Opened by minmingzhu 12 months ago - 2 comments

#75 - OpenSSF issue

Issue - State: closed - Opened by minmingzhu 12 months ago

#74 - Bump org.apache.spark:spark-core_2.12 from 3.1.1 to 3.3.3

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies

#73 - Bump spark-core_2.12 from 3.1.1 to 3.4.0

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 2 comments
Labels: dependencies

#72 - [REMOTE-SHUFFLE-101] fixed UT errors

Pull Request - State: closed - Opened by jiafuzha over 1 year ago - 1 comment

#71 - [REMOTE-SHUFFLE-70] use DAOS object class hint instead of DAOS object class

Pull Request - State: closed - Opened by jiafuzha over 1 year ago - 1 comment

#70 - use DAOS object class hint instead of DAOS object class

Issue - State: open - Opened by jiafuzha over 1 year ago

#69 - [REMOTE-SHUFFLE-66] Enhance shuffle removing logic

Pull Request - State: closed - Opened by jiafuzha almost 2 years ago - 1 comment

#68 - RemoteUnsafeShuffleWriterSuite keep failing

Issue - State: open - Opened by zhaohc10 almost 2 years ago

#67 - [REMOTE-SHUFFLE-66] Enhance shuffle removing logic

Pull Request - State: closed - Opened by jiafuzha almost 2 years ago - 1 comment

#66 - Enhance shuffle removing logic

Issue - State: closed - Opened by jiafuzha almost 2 years ago - 1 comment

#65 - [REMOTE-SHUFFLE-64] remove password from url in shuffle hadoop script

Pull Request - State: closed - Opened by jiafuzha about 2 years ago - 1 comment

#64 - remove password from url in shuffle hadoop script

Issue - State: closed - Opened by jiafuzha about 2 years ago - 1 comment

#63 - [REMOTE-SHUFFLE-62] Adjust some default parameters for aurora env

Pull Request - State: closed - Opened by jiafuzha about 2 years ago - 1 comment

#62 - Adjust some default parameters for aurora env

Issue - State: closed - Opened by jiafuzha about 2 years ago - 1 comment

#61 - [REMOTE-SHUFFLE-60] Support akey offset size bigger than 2GB

Pull Request - State: closed - Opened by jiafuzha over 2 years ago - 1 comment

#60 - Support akey offset size bigger than 2GB

Issue - State: closed - Opened by jiafuzha over 2 years ago

#59 - [REMOTE-SHUFFLE-56] Make shuffle object class and object hint configurable

Pull Request - State: closed - Opened by jiafuzha over 2 years ago - 1 comment

#58 - Is this plugin available for Spark Suffle and stored on Alluxio

Issue - State: closed - Opened by liangrui1988 almost 3 years ago - 1 comment

#57 - why the DAGScheduler in remote-shuffle will be used ?

Issue - State: closed - Opened by kevincmchen about 3 years ago

#56 - Make shuffle object class and object hint configurable

Issue - State: closed - Opened by jiafuzha about 3 years ago

#55 - [REMOTE-SHUFFLE-52] Update shuffle write to not encode/decode parameters

Pull Request - State: closed - Opened by jiafuzha about 3 years ago - 1 comment

#54 - [REMOTE-SHUFFLE-53] Make spark dependency provided

Pull Request - State: closed - Opened by jiafuzha about 3 years ago - 1 comment

#53 - Make spark dependency provided

Issue - State: closed - Opened by jiafuzha about 3 years ago - 1 comment

#52 - Update shuffle write to not encode/decode parameters

Issue - State: closed - Opened by jiafuzha about 3 years ago - 1 comment

#51 - [REMOTE-SHUFFLE-50] Support Spark-3.1 and Spark-3.2 in shuffle-daos

Pull Request - State: closed - Opened by jiafuzha about 3 years ago - 1 comment

#50 - Support Spark-3.1 and Spark-3.2 in shuffle-daos

Issue - State: closed - Opened by jiafuzha about 3 years ago - 1 comment

#49 - [REMOTE-SHUFFLE-43] Read Partitions from Highly Compressed Map Status

Pull Request - State: closed - Opened by jiafuzha about 3 years ago - 1 comment

#48 - Add latest version web page

Pull Request - State: closed - Opened by HongW2019 about 3 years ago

#47 - [REMOTE-SHUFFLE-46] Fixed some issues when run with I/O synchronously

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#46 - Fixed some issues when run with I/O synchronously.

Issue - State: closed - Opened by jiafuzha over 3 years ago

#45 - [REMOTE-SHUFFLE-44] Set mapIndex to -1 when FetchFailedException to avoid clear map output

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#44 - Set mapIndex to -1 when FetchFailedException to avoid clear map output

Issue - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#43 - Read Partitions from Highly Compressed Map Status

Issue - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#42 - Update OAP 1.2.0 documentation on pages website

Pull Request - State: closed - Opened by HongW2019 over 3 years ago

#41 - [REMOTE-SHUFFLE-40] Update Changelog and OAP guide

Pull Request - State: closed - Opened by HongW2019 over 3 years ago - 1 comment

#40 - Update the documents for OAP 1.2.0

Issue - State: closed - Opened by HongW2019 over 3 years ago

#39 - Enable Serialized Shuffle in shuffle-daos

Issue - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#38 - [REMOTE-SHUFFLE-34] Enhance map-combine and map-ordering

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#37 - Issue 34

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#36 - [REMOTE-SHUFFLE-35] Update version to 1.2.0

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#35 - Update version to 1.2.0

Issue - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#34 - Enhance map-combine and map-ordering

Issue - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#33 - Issue 31

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#32 - PerformanceEvaluationTool not in repository

Issue - State: open - Opened by trietopsoft over 3 years ago

#31 - Avoid re-computation of shuffle write when executor lost during shuffle read

Issue - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#30 - Cannot successfully compile remote-shuffle on master branch.

Issue - State: closed - Opened by haojinIntel over 3 years ago - 2 comments

#29 - [REMOTE-SHUFFLE-28] Follow OAP name convention ${project.artifactId}-${project.version}-with-spark-${spark.version}

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#28 - Follow OAP name convention ${project.artifactId}-${project.version}-with-spark-${spark.version}

Issue - State: closed - Opened by jiafuzha over 3 years ago

#27 - [REMOTE-SHUFFLE-26] Follow OAP name convention

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#26 - Follow OAP name convention

Issue - State: closed - Opened by jiafuzha over 3 years ago

#25 - [REMOTE-SHUFFLE-24] Enhance executor memory release

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#24 - Enhance executor memory release

Issue - State: closed - Opened by jiafuzha over 3 years ago
Labels: bug

#23 - Issue 18

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#22 - Update documentation on pages web for OAP 1.1.1

Pull Request - State: closed - Opened by HongW2019 over 3 years ago

#21 - [REMOTE-SUFFLE-20]Update the documents for OAP 1.1.1

Pull Request - State: closed - Opened by HongW2019 over 3 years ago - 1 comment

#20 - [Doc]Update the documents for OAP 1.1.1

Issue - State: closed - Opened by HongW2019 over 3 years ago

#19 - [REMOTE-SHUFFLE-18] upgrade to Spark-3.1.1

Pull Request - State: closed - Opened by jiafuzha over 3 years ago - 1 comment

#18 - upgrade to Spark-3.1.1

Issue - State: closed - Opened by jiafuzha over 3 years ago
Labels: feature

#17 - Update documentation on pages web

Pull Request - State: closed - Opened by HongW2019 almost 4 years ago

#16 - [REMOTE-SHUFFLE-15]Reorg and modify the documents for OAP 1.1.0

Pull Request - State: closed - Opened by HongW2019 almost 4 years ago - 2 comments

#15 - [Doc]Update the documentation for OAP 1.1.0

Issue - State: closed - Opened by HongW2019 almost 4 years ago - 1 comment

#14 - [REMOTE-SHUFFLE-11] Support DAOS Object Async API

Pull Request - State: closed - Opened by jiafuzha almost 4 years ago - 2 comments

#13 - [REMOTE-SHUFFLE-12][SDle][Snyk]Upgrade org.mock-server:mockserver-net…

Pull Request - State: closed - Opened by HongW2019 almost 4 years ago - 3 comments

#12 - [SDLe][Snyk]Upgrade org.mock-server:mockserver-netty to fix vulnerability scanned by Snyk

Issue - State: closed - Opened by HongW2019 almost 4 years ago
Labels: bug

#11 - Support DAOS Object Async API

Issue - State: closed - Opened by jiafuzha almost 4 years ago - 1 comment
Labels: feature

#10 - [REMOTE-SHUFFLE-9]Modify title check and automatic link to Issues for…

Pull Request - State: closed - Opened by HongW2019 almost 4 years ago - 1 comment

#9 - Modify title check and automatic link to Issues for PRs

Issue - State: closed - Opened by HongW2019 almost 4 years ago

#8 - #6 refactor shuffle-daos by abstracting shuffle IO for supporting both synchronous and asynchronous DAOS Object API

Pull Request - State: closed - Opened by jiafuzha about 4 years ago

#7 - #6 refactor shuffle-daos by abstracting shuffle IO for supporting both synchronous and asynchronous DAOS Object API

Pull Request - State: closed - Opened by jiafuzha about 4 years ago

#6 - refactor shuffle-daos by abstracting shuffle IO for supporting both synchronous and asynchronous DAOS Object API

Issue - State: closed - Opened by jiafuzha about 4 years ago
Labels: feature

#5 - check-in remote shuffle based on DAOS Object API

Pull Request - State: closed - Opened by jiafuzha about 4 years ago - 1 comment

#4 - check-in remote shuffle based on DAOS Object API

Issue - State: closed - Opened by jiafuzha about 4 years ago
Labels: feature

#3 - [Remote-Shuffle-2]Add mkdocs.yml and update docs

Pull Request - State: closed - Opened by HongW2019 about 4 years ago

#2 - Build documentation of different versions on website with Github Pages and Mkdocs

Issue - State: closed - Opened by HongW2019 about 4 years ago

#1 - Reorganize the source code for the new repository organization

Issue - State: closed - Opened by jerrychenhf about 4 years ago

GitHub / oap-project/remote-shuffle issues and pull requests