Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / oap-project/raydp issues and pull requests

#419 - fix executor custom resource request+support pyarrow >=15 & spark 3.5.2/3/4

Pull Request - State: closed - Opened by pang-wu 2 months ago - 2 comments

#418 - CNCF TAG Runtime Discussion/Presentation

Issue - State: open - Opened by miao0miao 4 months ago

#417 - fix CVE

Pull Request - State: closed - Opened by minmingzhu 5 months ago

#416 - add support of init_spark from existing SparkSession?

Issue - State: open - Opened by zhh210 5 months ago

#415 - Slack Group for the commiters & maintainers

Issue - State: open - Opened by mehulbatra-d11 5 months ago - 4 comments

#413 - Add Instructions for Ray Jobs with PyModules

Pull Request - State: open - Opened by noahshpak 7 months ago

#412 - RayDP support for spark-connect

Issue - State: open - Opened by aawasthid11 8 months ago - 4 comments

#410 - Samsara/1.6.0

Pull Request - State: closed - Opened by pang-wu 8 months ago

#410 - Samsara/1.6.0

Pull Request - State: closed - Opened by pang-wu 8 months ago

#409 - incompatible with spark 3.4.3 and 3.5.0

Issue - State: open - Opened by wuxiaocheng0506 9 months ago - 4 comments

#408 - how to init raydp resource

Issue - State: open - Opened by yasaorder 9 months ago - 1 comment

#406 - moved the requirements for python from setup.py to requirements.txt

Pull Request - State: closed - Opened by akashd11 10 months ago

#405 - How to develop in intellij?

Issue - State: open - Opened by akashd11 10 months ago

#404 - raydp.init_spark fails

Issue - State: open - Opened by Mayurji 10 months ago - 1 comment

#403 - Fix CI with latest ray

Pull Request - State: closed - Opened by kira-lin 11 months ago

#401 - fix CVE issue

Pull Request - State: closed - Opened by minmingzhu 12 months ago

#400 - fix openssf issue

Pull Request - State: closed - Opened by minmingzhu 12 months ago

#399 - Fix CVE issues

Issue - State: closed - Opened by minmingzhu 12 months ago

#398 - Fix OpenSSF issues

Issue - State: closed - Opened by minmingzhu 12 months ago

#397 - Support Spark 3.4.2, lift pyspark dependency range

Pull Request - State: closed - Opened by pang-wu about 1 year ago - 2 comments

#396 - dynamic allocation executor pending for addition flood fix

Pull Request - State: closed - Opened by raviranak about 1 year ago - 4 comments

#395 - Spark 3.5.0 support on raydp

Pull Request - State: closed - Opened by raviranak about 1 year ago - 1 comment

#394 - Is it possible for raydp to utilize a Spark session created by Apache Livy?

Issue - State: open - Opened by Taurus-Le about 1 year ago - 1 comment

#393 - [stream] does raydp support spark stream data?

Issue - State: open - Opened by fwensen about 1 year ago - 1 comment

#392 - Update raydp-submit

Pull Request - State: closed - Opened by gptbert about 1 year ago - 1 comment

#391 - Changes for executor actor recovery using ray's fault tolerance.

Pull Request - State: closed - Opened by KiranP-d11 about 1 year ago - 2 comments

#390 - RayDP Docker Image with Python 3.10 Failing to Build

Issue - State: closed - Opened by dattasoumya92 over 1 year ago - 2 comments

#389 - Recovery for lost executors 364

Pull Request - State: closed - Opened by KiranP-d11 over 1 year ago - 9 comments

#388 - upgrade Checkpoint usage to fit ray 3.0

Pull Request - State: closed - Opened by harborn over 1 year ago - 1 comment

#387 - Feat/recover lost executors

Pull Request - State: closed - Opened by KiranP-d11 over 1 year ago - 2 comments

#387 - Feat/recover lost executors

Pull Request - State: closed - Opened by KiranP-d11 over 1 year ago - 2 comments

#386 - Issue with Running Multiple Spark Jobs Concurrently on Ray Cluster

Issue - State: closed - Opened by DimitarSirakov over 1 year ago - 1 comment

#385 - import IPEX in torch config

Pull Request - State: closed - Opened by harborn over 1 year ago - 1 comment

#384 - Upgrade snappy version to fix CVE issue

Pull Request - State: closed - Opened by Deegue over 1 year ago - 1 comment

#384 - Upgrade snappy version to fix CVE issue

Pull Request - State: closed - Opened by Deegue over 1 year ago - 1 comment

#382 - Support Spark 3.4.1 and 3.3.3

Pull Request - State: closed - Opened by pang-wu over 1 year ago - 1 comment

#382 - Support Spark 3.4.1 and 3.3.3

Pull Request - State: closed - Opened by pang-wu over 1 year ago - 1 comment

#381 - Bump org.xerial.snappy:snappy-java from 1.1.10.1 to 1.1.10.4 in /core

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, java

#381 - Bump org.xerial.snappy:snappy-java from 1.1.10.1 to 1.1.10.4 in /core

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, java

#380 - Runtime env_vars cannot be passed down to executors

Issue - State: open - Opened by Deegue over 1 year ago - 2 comments

#380 - Runtime env_vars cannot be passed down to executors

Issue - State: open - Opened by Deegue over 1 year ago - 1 comment

#379 - Update ivy and spark base version

Pull Request - State: closed - Opened by Deegue over 1 year ago

#378 - Bump org.apache.ivy:ivy from 2.5.1 to 2.5.2 in /core

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, java

#377 - Bump org.apache.spark:spark-core_2.12 from 3.2.2 to 3.3.3 in /core

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, java

#376 - Added possibility to set custom actor owner when convert spark dataframe to ray dataset

Pull Request - State: closed - Opened by max-509 over 1 year ago - 3 comments

#374 - Bump to 1.7.0

Pull Request - State: closed - Opened by kira-lin over 1 year ago

#373 - Fix Jackson and Scala vulnerabilities

Pull Request - State: closed - Opened by Deegue over 1 year ago

#372 - When submit a script another process start locally in the head node

Issue - State: open - Opened by gbraes over 1 year ago - 1 comment

#371 - Support ray 2.3.1

Issue - State: open - Opened by fengsp over 1 year ago - 3 comments

#370 - [Follow-up] Use OutputStreamWriter instead of FileWriter

Pull Request - State: closed - Opened by Deegue over 1 year ago

#369 - [Follow-up] Add charset to getBytes()

Pull Request - State: closed - Opened by Deegue over 1 year ago

#368 - [Follow-up] Fix encoding in Agent.java

Pull Request - State: closed - Opened by Deegue over 1 year ago

#367 - Fix static code scan

Pull Request - State: closed - Opened by Deegue over 1 year ago

#366 - Implement Spark executor node affinity using custom resource

Pull Request - State: closed - Opened by pang-wu over 1 year ago - 7 comments

#365 - Use environment variable in maven to build

Pull Request - State: open - Opened by kira-lin over 1 year ago

#364 - Executor lost triggered by JVM OOM can't recover and cause subsequent steps stuck

Issue - State: closed - Opened by pang-wu over 1 year ago - 12 comments

#363 - [Follow-up] Fix log4j and some dependencies for `shims-common` (#362)

Pull Request - State: closed - Opened by kira-lin over 1 year ago

#362 - [Follow-up] Fix log4j and some dependencies for `shims-common`

Pull Request - State: closed - Opened by Deegue over 1 year ago - 2 comments

#361 - Merge master branch into 1.6 release

Pull Request - State: closed - Opened by kira-lin over 1 year ago

#360 - [Follow-up] Fix maven dependency and prepare for release

Pull Request - State: closed - Opened by Deegue over 1 year ago

#359 - Merge changes to branch 1.6

Pull Request - State: closed - Opened by kira-lin over 1 year ago

#358 - Use LoggerFactory for agent and add pydantic

Pull Request - State: closed - Opened by Deegue over 1 year ago

#357 - raydp start occur null error

Issue - State: open - Opened by sydt2014 over 1 year ago - 1 comment

#356 - Fix maven dependency and prepare for release

Pull Request - State: closed - Opened by Deegue over 1 year ago

#355 - Fix unbound error in _SparkContext for int memory

Pull Request - State: closed - Opened by guseggert over 1 year ago - 1 comment

#354 - Update RayDP to be compatible with Ray 2.5.0

Pull Request - State: open - Opened by kira-lin over 1 year ago - 1 comment

#353 - fixed some UT errors

Pull Request - State: closed - Opened by jiafuzha over 1 year ago

#352 - Issues with running on Ray Client

Issue - State: open - Opened by wctmanager over 1 year ago - 3 comments

#351 - Fix: Ray nightly now uses its own schema type

Pull Request - State: closed - Opened by kira-lin over 1 year ago

#350 - raydp.init_spark fails

Issue - State: open - Opened by wctmanager over 1 year ago - 3 comments

#347 - enable_hive not working with raydp

Issue - State: closed - Opened by raviranak over 1 year ago - 24 comments

#345 - Update k8s related instructions

Pull Request - State: closed - Opened by kira-lin almost 2 years ago

#343 - Data ownership transfer tests fail in Ray 2.4.0

Issue - State: open - Opened by kira-lin almost 2 years ago

#342 - Add shim layer for Spark 3.4.0 and 3.2.4

Pull Request - State: closed - Opened by kira-lin almost 2 years ago - 2 comments

#341 - Support arrow zerocopy for reader and writer in object store

Pull Request - State: open - Opened by Deegue almost 2 years ago

#340 - Performance benchmark on RayDP v.s. Spark

Issue - State: open - Opened by chenya-zhang almost 2 years ago - 3 comments

#339 - Support/Validate Ray 2.4.0 Release

Issue - State: open - Opened by carsonwang almost 2 years ago

#338 - Add shim layer for Spark 3.4.x

Issue - State: closed - Opened by kira-lin almost 2 years ago

#337 - Bump spark-core_2.12 from 3.2.1 to 3.4.0 in /core

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago - 1 comment
Labels: dependencies, java

#336 - Running RayDP on GPU machine stuck at GCS readiness

Issue - State: open - Opened by chenya-zhang almost 2 years ago - 1 comment

#335 - [raydp-334] fix the workaround of working with ray 2.3.[0-1]

Pull Request - State: closed - Opened by zjf2012 almost 2 years ago - 4 comments

#334 - fix the workaround of working with ray 2.3.[0-1]

Issue - State: open - Opened by zjf2012 almost 2 years ago

#333 - [raydp-332] Fix security issue of protobuf < 3.19.5

Pull Request - State: closed - Opened by zjf2012 almost 2 years ago - 8 comments

#332 - Fix security issue of protobuf < 3.19.5

Issue - State: open - Opened by zjf2012 almost 2 years ago

#331 - [Feature] Write your feature request here!🚀

Issue - State: open - Opened by kira-lin almost 2 years ago - 3 comments

#330 - Building Docker image to run Spark on Ray with RAPIDS

Issue - State: open - Opened by chenya-zhang almost 2 years ago - 2 comments

#330 - Building Docker image to run Spark on Ray with RAPIDS

Issue - State: open - Opened by chenya-zhang almost 2 years ago - 2 comments

#329 - Fix document since PR#313

Pull Request - State: closed - Opened by pang-wu almost 2 years ago - 1 comment