Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / apache/spark-kubernetes-operator issues and pull requests

#145 - [SPARK-49888] Use `registry.k8s.io/pause:3.9` to avoid failure deterministically

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 1 comment
Labels: EXAMPLES

#144 - [SPARK-49887] Update `cluster-with-template.yaml` example with pod annotation

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 2 comments
Labels: EXAMPLES

#143 - [SPARK-49778][FOLLOWUP] Fix `cluster-with-template.yaml` by removing `master` prefix

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 2 comments
Labels: EXAMPLES

#142 - [SPARK-49838] Add `spark-version` label to `Spark Cluster` resources

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 2 comments
Labels: SUBMISSION WORKER, API, OPERATOR

#141 - [SPARK-49832] Make `o.a.s.k8s.operator.utils.Utils` argument naming consistent

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 1 comment
Labels: OPERATOR

#140 - [SPARK-49831] Provide empty `RuntimeVersions` object to `ClusterSpec.runtimeVersions` by default

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 2 comments
Labels: API

#139 - [SPARK-49830] Add required fields for sparkApplicationSentinel

Pull Request - State: closed - Opened by TQJADE about 2 months ago - 1 comment
Labels: BUILD

#138 - [SPARK-49818] Update E2E tests to use Spark 3.5.3

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 2 comments

#137 - [SPARK-49790] Support `HPA` template for `SparkCluster`

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 2 comments
Labels: SUBMISSION WORKER, EXAMPLES, API

#136 - [SPARK-49778] Remove (master|worker) prefix from field names of `(Master|Worker)Spec`

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 2 comments
Labels: SUBMISSION WORKER, EXAMPLES, API

#135 - [SPARK-49754] Support HPA for `SparkCluster`

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 4 comments
Labels: SUBMISSION WORKER, EXAMPLES, BUILD, OPERATOR

#134 - [SPARK-49742] Upgrade `README`, examples, tests to use `preview2`

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 3 comments
Labels: SUBMISSION WORKER, EXAMPLES, DOCS

#133 - [SPARK-49735] Upgrade Spark to `4.0.0-preview2`

Pull Request - State: closed - Opened by dongjoon-hyun about 2 months ago - 2 comments
Labels: BUILD

#132 - [SPARK-49724] Add java21 to the e2e tests

Pull Request - State: closed - Opened by TQJADE 2 months ago - 1 comment

#131 - Try java21

Pull Request - State: closed - Opened by TQJADE 2 months ago

#130 - [SPARK-49715] Add `Java 21`-based `SparkCluster` example

Pull Request - State: closed - Opened by dongjoon-hyun 2 months ago - 2 comments
Labels: EXAMPLES

#129 - [SPARK-49714] Add `Java 21`-based `SparkPi` example

Pull Request - State: closed - Opened by dongjoon-hyun 2 months ago - 2 comments
Labels: EXAMPLES

#128 - [SPARK-49706] Use `apache/spark` images instead of `spark`

Pull Request - State: closed - Opened by dongjoon-hyun 2 months ago - 2 comments
Labels: EXAMPLES, DOCS

#127 - [SPARK-49705] Use `spark-examples.jar` instead of `spark-examples_2.13-4.0.0-preview1.jar`

Pull Request - State: closed - Opened by dongjoon-hyun 2 months ago - 2 comments
Labels: EXAMPLES

#126 - [SPARK-49657] Add multi instances e2e

Pull Request - State: closed - Opened by TQJADE 2 months ago

#125 - [SPARK-49658] Refactor e2e tests pipelines

Pull Request - State: closed - Opened by TQJADE 2 months ago - 1 comment
Labels: INFRA

#124 - WIP

Pull Request - State: closed - Opened by TQJADE 2 months ago
Labels: INFRA

#123 - [SPARK-49645] Update `e2e/python/chainsaw-test.yaml` to use non-R image

Pull Request - State: closed - Opened by dongjoon-hyun 2 months ago - 2 comments

#122 - [SPARK-49625] Add `SparkCluster` state transition test

Pull Request - State: closed - Opened by TQJADE 2 months ago - 1 comment

#121 - [SPARK-49623] Refactor prefix `appResources` to `workloadResources`

Pull Request - State: closed - Opened by jiangzho 2 months ago - 2 comments
Labels: BUILD

#120 - [SPARK-49619] Upgrade Gradle to 8.10.1

Pull Request - State: closed - Opened by dongjoon-hyun 2 months ago - 1 comment
Labels: BUILD

#118 - [SPARK-49527] Add `ConfOptionDocGenerator` to generate Spark Operator Config Property Doc

Pull Request - State: closed - Opened by jiangzho 2 months ago - 4 comments
Labels: BUILD, OPERATOR

#113 - [SPARK-49464] Add documentations

Pull Request - State: closed - Opened by jiangzho 3 months ago - 3 comments
Labels: BUILD

#100 - [SPARK-49379] Enable Pull Request Labeler

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#99 - [SPARK-49377] Fix e2e catch step application not found

Pull Request - State: closed - Opened by TQJADE 3 months ago - 1 comment

#99 - [SPARK-49377] Fix e2e catch step application not found

Pull Request - State: closed - Opened by TQJADE 3 months ago - 1 comment

#98 - [SPARK-49376] Introduce ClusterToleration and WorkerInstanceConfig

Pull Request - State: closed - Opened by jiangzho 3 months ago - 1 comment

#98 - [SPARK-49376] Introduce ClusterToleration and WorkerInstanceConfig

Pull Request - State: closed - Opened by jiangzho 3 months ago - 1 comment

#97 - [SPARK-49324] Add `SparkApplication` state transition e2e test

Pull Request - State: closed - Opened by TQJADE 3 months ago - 3 comments

#97 - [SPARK-49324] Add `SparkApplication` state transition e2e test

Pull Request - State: closed - Opened by TQJADE 3 months ago - 3 comments

#96 - [SPARK-49362][FOLLOWUP] Remove `build-tools/helm/` from the path

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#96 - [SPARK-49362][FOLLOWUP] Remove `build-tools/helm/` from the path

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#93 - [SPARK-49360][FOLLOWUP] Use `/*` for path

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#93 - [SPARK-49360][FOLLOWUP] Use `/*` for path

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#92 - [SPARK-49360] Use `rsync` to upload to `nightlies`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#92 - [SPARK-49360] Use `rsync` to upload to `nightlies`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#91 - [SPARK-49331][FOLLOWUP] Fix `cpu` to `cpus` in `setup-minikube` setting

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 6 comments

#91 - [SPARK-49331][FOLLOWUP] Fix `cpu` to `cpus` in `setup-minikube` setting

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 6 comments

#90 - [SPARK-49351] Add `publish_snapshot_chart.yml` GitHub Action job

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#90 - [SPARK-49351] Add `publish_snapshot_chart.yml` GitHub Action job

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#89 - [SPARK-49348] Support `schedulerName` for SparkCluster

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#89 - [SPARK-49348] Support `schedulerName` for SparkCluster

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#88 - [SPARK-49346] Add `publish_snapshot_dockerhub.yml` Daily GitHub Action job

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#88 - [SPARK-49346] Add `publish_snapshot_dockerhub.yml` Daily GitHub Action job

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#87 - [SPARK-49343] Document nightly versions of operator image and Helm Chart

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#87 - [SPARK-49343] Document nightly versions of operator image and Helm Chart

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#86 - [MINOR] Add `License`/`RepoSize` status images

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#86 - [MINOR] Add `License`/`RepoSize` status images

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#85 - [SPARK-49340] Document `SparkCluster` and add `submit-pi-to-prod.sh` example

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#85 - [SPARK-49340] Document `SparkCluster` and add `submit-pi-to-prod.sh` example

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#84 - [SPARK-49332][FOLLOWUP] Fix worker parameter to match with master service

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#84 - [SPARK-49332][FOLLOWUP] Fix worker parameter to match with master service

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#83 - [SPARK-49332] Add K8s service for `Workers` to `SparkClusterResourceSpec`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#83 - [SPARK-49332] Add K8s service for `Workers` to `SparkClusterResourceSpec`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#82 - [SPARK-49331] Use `setup-minikube` GitHub Action

Pull Request - State: closed - Opened by TQJADE 3 months ago - 4 comments

#82 - [SPARK-49331] Use `setup-minikube` GitHub Action

Pull Request - State: closed - Opened by TQJADE 3 months ago - 4 comments

#81 - [SPARK-49330] Revise `InstanceConfig` to `ExecutorInstanceConfig` class

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 4 comments

#81 - [SPARK-49330] Revise `InstanceConfig` to `ExecutorInstanceConfig` class

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 4 comments

#80 - [SPARK-49329] Support user provided spec for SparkCluster

Pull Request - State: closed - Opened by jiangzho 3 months ago - 2 comments

#80 - [SPARK-49329] Support user provided spec for SparkCluster

Pull Request - State: closed - Opened by jiangzho 3 months ago - 2 comments

#79 - [SPARK-49328] Propagate Spark configurations to `SparkCluster`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#79 - [SPARK-49328] Propagate Spark configurations to `SparkCluster`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#78 - [SPARK-49325] Add `SparkCluster` to `spark-operator` module

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 4 comments

#78 - [SPARK-49325] Add `SparkCluster` to `spark-operator` module

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 4 comments

#77 - [SPARK-49214] Add e2e test in operator workflow

Pull Request - State: closed - Opened by TQJADE 3 months ago

#77 - [SPARK-49214] Add e2e test in operator workflow

Pull Request - State: closed - Opened by TQJADE 3 months ago

#76 - [SPARK-49322] Add `SparkCluster` to `spark-submission-worker` module

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#76 - [SPARK-49322] Add `SparkCluster` to `spark-submission-worker` module

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#75 - [SPARK-49319] Add `SparkCluster` to `spark-operator-api` module and examples

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#75 - [SPARK-49319] Add `SparkCluster` to `spark-operator-api` module and examples

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#74 - [SPARK-49317] Add `pi-on-yunikorn.yaml` example and update `README.md`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#74 - [SPARK-49317] Add `pi-on-yunikorn.yaml` example and update `README.md`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#71 - [SPARK-49309] Use `HTTP_*` constant variables instead of magic numbers

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 4 comments

#71 - [SPARK-49309] Use `HTTP_*` constant variables instead of magic numbers

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 4 comments

#70 - [SPARK-49305] Revise `Spark Operator` docker image

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#70 - [SPARK-49305] Revise `Spark Operator` docker image

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#69 - [SPARK-49304] Add `-SNAPSHOT` postfix to `Spark Operator` version

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#69 - [SPARK-49304] Add `-SNAPSHOT` postfix to `Spark Operator` version

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#68 - [SPARK-49299] Add `buildDockerImage` Gradle Task

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#68 - [SPARK-49299] Add `buildDockerImage` Gradle Task

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 2 comments

#67 - [SPARK-49298] Reduce `spark-operator` fat jar size by excluding dependencies

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#67 - [SPARK-49298] Reduce `spark-operator` fat jar size by excluding dependencies

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 3 comments

#66 - [MINOR] Use `IOException` in `SparkOperatorConfManager`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#66 - [MINOR] Use `IOException` in `SparkOperatorConfManager`

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#65 - [SPARK-49296] Add `deploy.gradle` to support publish-related tasks

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment

#65 - [SPARK-49296] Add `deploy.gradle` to support publish-related tasks

Pull Request - State: closed - Opened by dongjoon-hyun 3 months ago - 1 comment