kubeflow/spark-operator issues and pull requests

#2325 - Execute Spark writing to HDFS reports no permission

Issue - State: open - Opened by wangchao732 about 8 hours ago
Labels: kind/bug

#2324 - Upgrading Spark-Operator guide

Issue - State: open - Opened by jesumyip about 16 hours ago

#2323 - Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.0 to 1.66.3

Pull Request - State: open - Opened by dependabot[bot] 3 days ago - 1 comment
Labels: dependencies, go, size/M

#2322 - Bump golang.org/x/mod from 0.20.0 to 0.22.0

Pull Request - State: open - Opened by dependabot[bot] 3 days ago - 1 comment
Labels: dependencies, go, size/XS

#2321 - Bump golang from 1.23.1 to 1.23.3

Pull Request - State: open - Opened by dependabot[bot] 3 days ago - 1 comment
Labels: dependencies, docker, size/XS

#2320 - Bump `volcano.sh/apis` to 1.10.0

Pull Request - State: closed - Opened by jacobsalway 3 days ago - 2 comments
Labels: size/XS, lgtm, approved

#2319 - The Spark task appears to have started, but it seems unable to allocate tasks to the executors.

Issue - State: closed - Opened by wangchao732 3 days ago - 1 comment

#2318 - Upgrade volcano.sh/apis to 1.10.0-alpha.0 or above

Issue - State: closed - Opened by GajaHebbar 4 days ago - 1 comment
Labels: kind/bug

#2317 - sparkapp running depending on multiple jar files (100+), what methods can be used to reduce manually adding dependencies? deps: jars

Issue - State: open - Opened by wangchao732 4 days ago
Labels: kind/feature

#2316 - Fix: should not add emptyDir sizeLimit conf on executor pods if it is nil

Pull Request - State: closed - Opened by Cian911 4 days ago - 2 comments
Labels: size/S, lgtm, approved

#2315 - Robustness to driver pod taking time to create

Pull Request - State: open - Opened by Tom-Newton 4 days ago - 1 comment
Labels: size/L

#2314 - spark external usage

Issue - State: open - Opened by Nearyou46 6 days ago

#2313 - [FEATURE] Run Spark Applications with readOnlyRootFileSystem

Issue - State: open - Opened by npgretz 7 days ago
Labels: kind/feature

#2312 - Use NSS_WRAPPER_PASSWD instead of /etc/passwd as in spark-operator image entrypoint.sh

Pull Request - State: open - Opened by Aakcht 9 days ago - 2 comments
Labels: size/M

#2311 - Truncate UI service name if over 63 characters

Pull Request - State: open - Opened by jacobsalway 9 days ago - 2 comments
Labels: size/M

#2310 - Bump to k8s 1.31

Pull Request - State: open - Opened by jacobsalway 9 days ago - 1 comment
Labels: size/XS, do-not-merge/work-in-progress

#2309 - Prevent SparkApplication re-submission conflicts by verifying driver pod cleanup

Pull Request - State: closed - Opened by josecsotomorales 10 days ago - 1 comment
Labels: size/XXL

#2308 - Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.0 to 1.66.2

Pull Request - State: closed - Opened by dependabot[bot] 10 days ago - 2 comments
Labels: dependencies, go, size/M

#2307 - Bump github.com/onsi/ginkgo/v2 from 2.20.2 to 2.21.0

Pull Request - State: open - Opened by dependabot[bot] 10 days ago - 1 comment
Labels: dependencies, go, size/S

#2306 - Fix: executor container security context does not work

Pull Request - State: closed - Opened by ChenYi015 10 days ago - 3 comments
Labels: size/XS, lgtm, approved

#2305 - Fix: should not add emptyDir sizeLimit conf if it is nil

Pull Request - State: closed - Opened by ChenYi015 10 days ago - 6 comments
Labels: size/S, lgtm, approved

#2302 - Robustness to the driver pod taking some time to create

Issue - State: open - Opened by Tom-Newton 14 days ago - 1 comment
Labels: kind/feature

#2301 - Unable to run a job with main file point to s3 bucket

Issue - State: open - Opened by nownikhil 15 days ago - 1 comment

#2300 - [FEATURE] Truncate Webui Service name

Issue - State: open - Opened by BCantos17 16 days ago - 3 comments
Labels: kind/feature

#2299 - [BUG] Driver in OOMKilled state not restarted by Spark Operator (2.1.0-rc.0)

Issue - State: open - Opened by TheDevilDan 16 days ago - 6 comments
Labels: kind/bug

#2298 - Allow setting automountServiceAccountToken

Pull Request - State: closed - Opened by Aransh 16 days ago - 3 comments
Labels: size/S, lgtm, approved

#2297 - [Question] Pluggable support for customized substate and events consuming and handling?

Issue - State: open - Opened by leletan 17 days ago - 1 comment

#2296 - [Question] More details about 2.0?

Issue - State: open - Opened by leletan 17 days ago - 1 comment

#2295 - Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.0 to 1.66.1

Pull Request - State: closed - Opened by dependabot[bot] 17 days ago - 2 comments
Labels: dependencies, go, size/XS

#2294 - Bump k8s.io/kubernetes from 1.30.2 to 1.31.2

Pull Request - State: open - Opened by dependabot[bot] 17 days ago - 1 comment
Labels: dependencies, go, size/S

#2293 - Bump sigs.k8s.io/controller-runtime from 0.17.5 to 0.19.1

Pull Request - State: open - Opened by dependabot[bot] 17 days ago - 1 comment
Labels: dependencies, go, size/XS

#2292 - Bump golang.org/x/mod from 0.20.0 to 0.21.0

Pull Request - State: closed - Opened by dependabot[bot] 17 days ago - 2 comments
Labels: dependencies, go, size/XS

#2291 - Disabling uiService does not work

Issue - State: closed - Opened by BCantos17 17 days ago - 2 comments
Labels: kind/bug

#2290 - Add support for suspend

Issue - State: open - Opened by ChenYi015 17 days ago
Labels: kind/feature

#2289 - helm repo update doesn’t fetch the latest Spark Operator version (v2.1.0-rc.0 Pre-release)

Issue - State: closed - Opened by TheDevilDan 17 days ago - 2 comments

#2288 - [BUG] Report: ScheduledSparkApplication Fails to Execute After Helm Chart Upgrade

Issue - State: open - Opened by TheDevilDan 21 days ago - 1 comment

#2287 - Update issue and pull request templates

Pull Request - State: closed - Opened by ChenYi015 21 days ago - 4 comments
Labels: size/L, lgtm, approved

#2286 - Release v2.1.0-rc.0

Pull Request - State: closed - Opened by ChenYi015 21 days ago - 1 comment
Labels: size/XS

#2285 - [FEATURE] Delete old resources and re-submit in a single reconcile when state is `FAILED_SUBMISSION`

Issue - State: open - Opened by Tom-Newton 21 days ago - 3 comments
Labels: enhancement

#2284 - [FEATURE] Add tests covering CRD validation and JSON serialisation

Issue - State: open - Opened by Tom-Newton 21 days ago
Labels: enhancement

#2283 - [BUG] SparkApplication fails to resubmit after entering the PENDING_RERUN state

Issue - State: closed - Opened by josecsotomorales 22 days ago - 4 comments

#2282 - Allow the Controller and Webhook Containers to run with the securityContext: readOnlyRootfilesystem: true

Pull Request - State: closed - Opened by npgretz 22 days ago - 9 comments
Labels: size/M, lgtm, approved

#2281 - [BUG] Internal error occurred: failed calling webhook...Address is not allowed

Issue - State: closed - Opened by BCantos17 22 days ago - 6 comments

#2280 - kubeflow spark operator & SparkHistoryService on k8s - spark driver/executor logs not showing up Spark History Server

Issue - State: open - Opened by karanalang 22 days ago - 2 comments
Labels: question

#2279 - [QUESTION] How to disable spark.properties generation?

Issue - State: open - Opened by meatheadmike 23 days ago
Labels: question

#2278 - Allow --ingress-class-name to be specified in chart

Pull Request - State: closed - Opened by jacobsalway 23 days ago - 3 comments
Labels: size/S, lgtm, approved

#2277 - [BUG] executor pod successfully completed but executorState in SparkApplication is failed

Issue - State: open - Opened by chaosi-zju 23 days ago

#2276 - [QUESTION] Supporting nginxinc ingress

Issue - State: open - Opened by aaronfeng 24 days ago - 3 comments
Labels: question

#2275 - Bump helm.sh/helm/v3 from 3.16.1 to 3.16.2

Pull Request - State: closed - Opened by dependabot[bot] 24 days ago - 1 comment
Labels: dependencies, go, size/S, lgtm, approved

#2274 - Bump github.com/prometheus/client_golang from 1.20.4 to 1.20.5

Pull Request - State: closed - Opened by dependabot[bot] 24 days ago - 1 comment
Labels: dependencies, go, size/XS, lgtm, approved

#2273 - Bump cloud.google.com/go/storage from 1.44.0 to 1.45.0

Pull Request - State: closed - Opened by dependabot[bot] 24 days ago - 1 comment
Labels: dependencies, go, size/XS, lgtm, approved

#2272 - Bump github.com/aws/aws-sdk-go-v2/config from 1.27.43 to 1.28.0

Pull Request - State: closed - Opened by dependabot[bot] 24 days ago - 1 comment
Labels: dependencies, go, size/XS, lgtm, approved

#2271 - Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.65.3 to 1.66.0

Pull Request - State: closed - Opened by dependabot[bot] 24 days ago - 1 comment
Labels: dependencies, go, size/XS, lgtm, approved

#2270 - Bump aquasecurity/trivy-action from 0.27.0 to 0.28.0

Pull Request - State: closed - Opened by dependabot[bot] 24 days ago - 1 comment
Labels: dependencies, github_actions, size/XS, lgtm, approved

#2269 - How I can edit ingress that created by sparkapp

Issue - State: open - Opened by Nearyou46 24 days ago
Labels: question

#2268 - [BUG] Generated clientsets/informers aren't updated

Issue - State: open - Opened by jacobsalway 26 days ago

#2267 - [BUG] Not possible to reference module by release tags

Issue - State: open - Opened by jacobsalway 26 days ago

#2266 - Run e2e tests with Kubernetes version matrix

Pull Request - State: closed - Opened by jacobsalway 27 days ago - 4 comments
Labels: size/S, lgtm, approved

#2265 - Update default container security context

Pull Request - State: closed - Opened by ChenYi015 27 days ago - 7 comments
Labels: size/M, lgtm, approved

#2264 - Add workflow for releasing sparkctl binary

Pull Request - State: closed - Opened by ChenYi015 27 days ago - 4 comments
Labels: size/M, lgtm, approved

#2263 - Add release badge to README

Pull Request - State: closed - Opened by jacobsalway 27 days ago - 2 comments
Labels: size/S, lgtm, approved

#2262 - Draft: fix the minResources calculation logic of podgroup for volcano

Pull Request - State: open - Opened by kaka-zb 27 days ago - 2 comments
Labels: size/L, do-not-merge/work-in-progress

#2261 - Make sure enable-ui-service flag is set to false when controller.uiService.enable is set to false

Pull Request - State: closed - Opened by Roberdvs 28 days ago - 4 comments
Labels: size/XS, lgtm, approved

#2260 - [BUG] Disabling Web UI service in the Helm chart has no effect

Issue - State: closed - Opened by Roberdvs 28 days ago - 1 comment

#2259 - Add Quick Start guide to README

Pull Request - State: closed - Opened by jacobsalway 28 days ago - 2 comments
Labels: size/S, lgtm, approved

#2258 - feat: added nvidia runtime if there's gpu detected

Pull Request - State: open - Opened by reski-rukmantiyo 29 days ago - 2 comments
Labels: size/S

#2257 - [BUG] Secrets Not Being Cleaned Up in Spark Operator & AKV2K8S Integration

Issue - State: open - Opened by gyurcse66 29 days ago

#2256 - feat: support archives param for spark-submit

Pull Request - State: closed - Opened by kaka-zb about 1 month ago - 6 comments
Labels: size/M, lgtm, approved

#2255 - `omitempty` corrections

Pull Request - State: closed - Opened by Tom-Newton about 1 month ago - 12 comments
Labels: size/M, lgtm, approved

#2251 - Bump golang.org/x/net from 0.29.0 to 0.30.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 1 comment
Labels: dependencies, go, size/M, lgtm, approved

#2250 - Bump gocloud.dev from 0.39.0 to 0.40.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 1 comment
Labels: dependencies, go, size/XS, lgtm, approved

#2249 - Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.63.3 to 1.65.3

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 1 comment
Labels: dependencies, go, size/M, lgtm, approved

#2248 - Bump aquasecurity/trivy-action from 0.24.0 to 0.27.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 1 comment
Labels: dependencies, github_actions, size/XS, lgtm, approved

#2247 - Bump manusa/actions-setup-minikube from 2.12.0 to 2.13.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: dependencies, github_actions, size/XS, lgtm, approved

#2245 - [FEATURE] Support --archives option in SparkApplication CRD and spark-submit

Issue - State: closed - Opened by kaka-zb about 1 month ago - 2 comments
Labels: enhancement

#2244 - [BUG] minResources of volcano podGroup didn't take into account dynamicAllocation and memoryOverheadFactor

Issue - State: open - Opened by kaka-zb about 1 month ago - 3 comments

#2243 - remove redundant test.sh file

Pull Request - State: open - Opened by ChenYi015 about 1 month ago - 2 comments
Labels: size/S

#2242 - Minor fixes to e2e test `make` targets

Pull Request - State: closed - Opened by Tom-Newton about 1 month ago - 6 comments
Labels: size/XS, lgtm, approved

#2241 - Fix retries

Pull Request - State: closed - Opened by Tom-Newton about 1 month ago - 8 comments
Labels: size/L, lgtm, approved

#2240 - [QUESTION] Can the Spark Operator Run in a Single Namespace Without Cluster-Level Permissions?

Issue - State: closed - Opened by josecsotomorales about 1 month ago - 2 comments
Labels: question

#2239 - Add changelog for v2.0.2

Pull Request - State: closed - Opened by ChenYi015 about 1 month ago - 2 comments
Labels: size/M, lgtm, approved

#2238 - Refactoring: webhook findContainer to avoid calling it in every patch function

Issue - State: open - Opened by ImpSy about 1 month ago

#2237 - [BUG] Retries don't work

Issue - State: closed - Opened by Tom-Newton about 1 month ago - 9 comments

#2236 - [FEATURE] Remove reliance on uid:185 spark

Issue - State: open - Opened by cccsss01 about 1 month ago
Labels: enhancement

#2235 - Add @ImpSy as reviewer

Pull Request - State: closed - Opened by ChenYi015 about 1 month ago - 8 comments
Labels: size/XS, lgtm, approved

#2234 - Add check for generating manifests and code

Pull Request - State: closed - Opened by ChenYi015 about 1 month ago - 4 comments
Labels: size/M, lgtm, approved

#2233 - Release v2.0.2

Pull Request - State: closed - Opened by ChenYi015 about 1 month ago - 2 comments
Labels: lgtm, approved, size/XL

#2232 - fix: webhook panics due to logging

Pull Request - State: closed - Opened by ChenYi015 about 1 month ago - 10 comments
Labels: size/S, lgtm, approved

#2231 - Bump github.com/aws/aws-sdk-go-v2/config from 1.27.33 to 1.27.42

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: dependencies, go, size/M, lgtm, approved

#2230 - Bump github.com/aws/aws-sdk-go-v2/config from 1.27.33 to 1.27.41

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: dependencies, go, size/M

#2229 - Bump github.com/aws/aws-sdk-go-v2 from 1.31.0 to 1.32.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: dependencies, go, size/S, lgtm, approved

#2228 - Bump cloud.google.com/go/storage from 1.43.0 to 1.44.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: dependencies, go, size/L, lgtm, approved

#2227 - Bump golang.org/x/time from 0.6.0 to 0.7.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: dependencies, go, size/XS, lgtm, approved

#2226 - Bump manusa/actions-setup-minikube from 2.11.0 to 2.12.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: dependencies, github_actions, size/XS, lgtm, approved

#2225 - Bump golang from 1.23.1 to 1.23.2

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: dependencies, docker, size/XS

#2224 - Release 2.0.2

Issue - State: closed - Opened by Nearyou46 about 1 month ago - 2 comments
Labels: question

#2223 - fix: spark-submission failed due to lack of permission by user `spark`

Pull Request - State: closed - Opened by missedone about 1 month ago - 4 comments
Labels: size/XS, lgtm, approved

#2222 - fix: imagePullPolicy was ignored

Pull Request - State: closed - Opened by missedone about 1 month ago - 6 comments
Labels: size/M, lgtm, approved

#2221 - [BUG] imagePullPolicy doesn't work on spark-operator 2.0.0

Issue - State: closed - Opened by missedone about 1 month ago - 3 comments

#2220 - [BUG] secret not getting mounted as VolumeMount

Issue - State: closed - Opened by karanalang about 1 month ago - 1 comment

GitHub / kubeflow/spark-operator issues and pull requests