GoogleCloudPlatform/spark-on-k8s-operator issues and pull requests

#1746 - Bump golang.org/x/net from 0.0.0-20220722155237-a158d28d115b to 0.10.0

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, go

#1745 - Bump golang from 1.14.0-alpine to 1.20.4-alpine

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, docker

#1744 - Hi @joanjiao2016 ,

Issue - State: closed - Opened by jiangjian0920 over 1 year ago

#1743 - Support spark 3.4.0

Issue - State: open - Opened by hajapy over 1 year ago - 2 comments

#1742 - Accessing application jar from aws codeartifact

Issue - State: open - Opened by tbhangalenice over 1 year ago

#1741 - Compatibility Issue with K8s 1.26

Issue - State: open - Opened by beerus11 over 1 year ago - 1 comment

#1740 - Update gencerts.sh to handle longer namespaces and service names

Pull Request - State: open - Opened by JonRossEventus over 1 year ago - 1 comment

#1739 - Max length k8s namespace breaks certificate creation script

Issue - State: open - Opened by JonRossEventus over 1 year ago - 1 comment

#1738 - Bump github.com/aws/aws-sdk-go from 1.38.49 to 1.44.253

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#1737 - ErrImagePull/ImagePullBackOff status of spark driver pod is not surfaced to SparkApplication status

Issue - State: open - Opened by Prad94r over 1 year ago

#1736 - Added qualytics to who is using

Pull Request - State: open - Opened by josecsotomorales over 1 year ago

#1735 - PR_SET_CHILD_SUBREAPER is unavailable on this platform

Issue - State: open - Opened by Hongbo-Miao over 1 year ago

#1734 - Bump github.com/aws/aws-sdk-go from 1.38.49 to 1.44.248

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#1733 - IngressClass support

Issue - State: open - Opened by tomglaza over 1 year ago - 1 comment

#1732 - describe spark application does not give complete error message

Issue - State: open - Opened by kraj007 over 1 year ago - 1 comment

#1731 - Has anyone tested kerberos authentication on Spark operator

Issue - State: open - Opened by jiangjian0920 over 1 year ago - 1 comment

#1730 - Spark base image used by Spark Operator has security issue

Issue - State: open - Opened by JTBS over 1 year ago - 1 comment

#1729 - Bump github.com/aws/aws-sdk-go from 1.38.49 to 1.44.244

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#1728 - Launch multiple SparkApplications

Issue - State: closed - Opened by tamis-laan over 1 year ago - 2 comments

#1727 - Need custom spark image dockerfile

Issue - State: open - Opened by kraj007 over 1 year ago - 2 comments

#1726 - set spark k8s pod request, limit memory with different values

Issue - State: closed - Opened by dfercode over 1 year ago - 2 comments

#1725 - `tolerations` and `affinity` rules not passing to Driver and Executor pods despite webhook enabled

Issue - State: closed - Opened by JunaidChaudry over 1 year ago - 3 comments

#1724 - fix: fix issue #1723 about spark-operator not working with volcano on OCP

Pull Request - State: closed - Opened by disaster37 over 1 year ago - 2 comments

#1723 - SparkApplication with volcano scheduler not working on OCP

Issue - State: closed - Opened by disaster37 over 1 year ago - 1 comment

#1722 - Bump github.com/aws/aws-sdk-go from 1.38.49 to 1.44.239

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#1721 - Bump golang.org/x/net from 0.0.0-20220722155237-a158d28d115b to 0.9.0

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#1720 - Bump golang from 1.14.0-alpine to 1.20.3-alpine

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, docker

#1719 - Fix docs for Volcano integration

Pull Request - State: open - Opened by VVKot over 1 year ago - 2 comments

#1718 - Add priorityClassName to pods

Pull Request - State: open - Opened by boniek83 over 1 year ago - 1 comment

#1717 - [helm chart] add priorityClassName for opertor's pods

Issue - State: open - Opened by boniek83 over 1 year ago

#1716 - failed mount volume after helm upgrade

Issue - State: open - Opened by julienlau over 1 year ago

#1715 - Bump github.com/aws/aws-sdk-go from 1.38.49 to 1.44.234

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#1714 - Molex started using spark K8 operator.

Pull Request - State: closed - Opened by AshishPushpSingh over 1 year ago - 1 comment

#1713 - Can't publish messages from spark operator to PubSub

Issue - State: closed - Opened by yasseraj over 1 year ago - 1 comment

#1712 - Add timeZone support for ScheduledSparkApplications

Issue - State: open - Opened by fanalin over 1 year ago

#1711 - Updating a SparkApplication with incremental launching of executors

Issue - State: open - Opened by mohdmsl over 1 year ago - 1 comment

#1710 - Dynamic ebs volumes for handing off

Pull Request - State: open - Opened by alegoro over 1 year ago - 1 comment

#1709 - [bug] spark job envent affected by operator pod status

Issue - State: open - Opened by Crazybean-lwb over 1 year ago

#1708 - SparkApplication submit fails: `Exception in thread "main" io.fabric8.kubernetes.client.KubernetesClientException: Operation: [create] for kind: [Pod] with name: [null] in namespace: [my-ns] failed.` when running with webhook `enable: true`

Issue - State: closed - Opened by JunaidChaudry over 1 year ago - 13 comments

#1690 - How can we pass the PSS/PSA required parameter as "seccompProfile" to sparkApplication driver and executor through template.

Issue - State: open - Opened by MohanPatidar5 over 1 year ago

#1689 - Example using spark-submit

Issue - State: open - Opened by miande-acxiom over 1 year ago - 5 comments

#1688 - CVE-2021-25741 and others in k8s.io/kubernetes

Issue - State: open - Opened by degant over 1 year ago - 2 comments

#1685 - Add webhook fail on error + fix docs generation

Pull Request - State: open - Opened by maxwell-gobel over 1 year ago

#1684 - feat: add helm flag for cert reload interval

Pull Request - State: open - Opened by DerekTBrown over 1 year ago - 1 comment

#1680 - Fix signal handling for non-leader processes

Pull Request - State: closed - Opened by antonipp almost 2 years ago - 1 comment

#1679 - Writing SparkApplication yaml file for a Spring Boot web application

Issue - State: open - Opened by wschung1113 almost 2 years ago - 1 comment

#1678 - Should we include optional deployment of spark history server with this ?

Issue - State: closed - Opened by debugger24 almost 2 years ago - 1 comment

#1676 - Caused by: java.io.FileNotFoundException: .kube/config (No such file or directory)

Issue - State: open - Opened by allenhaozi almost 2 years ago - 7 comments

#1673 - spark-on-k8s-operator not working with disabled cluster role, clusterRoleBindings and webhook

Issue - State: open - Opened by pm-nuance almost 2 years ago - 4 comments

#1669 - Extra helm chart labels

Pull Request - State: closed - Opened by kvanzuijlen almost 2 years ago - 1 comment

#1654 - driver initContainers Not effective ，How do you use it?

Issue - State: open - Opened by lizu18xz almost 2 years ago - 4 comments

#1650 - Spark memory unit needs to be converted to kubernetes resource util

Pull Request - State: closed - Opened by jiamin13579 almost 2 years ago - 1 comment

#1647 - Added permissions for leader election #1635

Pull Request - State: closed - Opened by ordukhanian almost 2 years ago - 3 comments

#1645 - Fix RBAC for leader election

Pull Request - State: closed - Opened by pdrastil about 2 years ago - 1 comment

#1643 - missing download_dir for jars and files

Issue - State: open - Opened by tardunge about 2 years ago - 2 comments

#1640 - Driver & Executor Env variables are not invoked by custom resource "SparkApplication" Application pods.

Issue - State: open - Opened by bharath-rajendran023 about 2 years ago - 10 comments

#1634 - Wiz scan CRITICAL Vulnerabilities in spark-operator/spark-py:v3.1.1-hadoop3

Issue - State: closed - Opened by sls19050 about 2 years ago - 4 comments

#1633 - Fix #1393 : fix tolerations block in wrong segment for webhook jobs

Pull Request - State: closed - Opened by zhiminglim about 2 years ago - 1 comment

#1629 - add dependabot

Pull Request - State: closed - Opened by monotek about 2 years ago - 2 comments

#1628 - add configurable livenessProbe & readinessProbe to helm chart

Pull Request - State: open - Opened by monotek about 2 years ago - 1 comment

#1624 - Fix #1554 : Run hook on post-delete

Pull Request - State: closed - Opened by DerekTBrown about 2 years ago - 2 comments

#1619 - Config Maps and Volumes are not getting mounted

Issue - State: open - Opened by infa-madhanb about 2 years ago - 18 comments

#1617 - update-api-docs: Added ApplicationStateTypes descriptions

Pull Request - State: open - Opened by namigaliyev about 2 years ago - 2 comments

#1615 - chore: Add Timo to user list

Pull Request - State: open - Opened by vanducng about 2 years ago - 2 comments

#1611 - hostAliases is not refelecting in driver pod yaml

Issue - State: closed - Opened by mohdmsl about 2 years ago - 2 comments

#1606 - Trigger the next scheduled spark application ahead of time

Issue - State: open - Opened by joseparajelesGL about 2 years ago - 2 comments

#1603 - wrong param for enable batch scheduler

Pull Request - State: closed - Opened by tcodehuber about 2 years ago

#1596 - configmaps not getting cleaned up when spark application deleted

Issue - State: open - Opened by jdonnelly-apixio over 2 years ago - 5 comments

#1595 - Remove k8s.io/kubernetes dependency

Pull Request - State: open - Opened by mystic123 over 2 years ago - 1 comment

#1593 - Update who-is-using.md

Pull Request - State: closed - Opened by tcodehuber over 2 years ago - 1 comment

#1568 - Subpath support for config map volume mounts

Pull Request - State: open - Opened by bbenzikry over 2 years ago - 9 comments

#1562 - Spark does not start executors

Issue - State: closed - Opened by dakky over 2 years ago - 13 comments

#1560 - Executor Pods keep getting removed considering non-existent.

Issue - State: open - Opened by dp2608 over 2 years ago - 5 comments

#1559 - Add support to Spark 3.3.0

Issue - State: open - Opened by josecsotomorales over 2 years ago - 27 comments

#1543 - Delete the failed Spark Application driver pods automatically

Issue - State: open - Opened by brshravan-tech over 2 years ago - 1 comment

#1520 - fixed missing driver/executor ports schema in sparkapplication crd

Pull Request - State: open - Opened by oscar-dela over 2 years ago - 10 comments

#1495 - Configmap and Volume mounts are not loading

Issue - State: open - Opened by sohnaeo over 2 years ago - 15 comments

#1489 - Support setting driver/executor `memory` and `memoryLimit` separately

Issue - State: open - Opened by peay over 2 years ago - 2 comments

#1484 - Spark application Driver pods inheriting the labels from SparkScheduledApplication results issues with ArgoCD

Issue - State: open - Opened by brshravan-tech over 2 years ago - 4 comments

#1466 - Launch multiple SparkApplications at same time error.

Issue - State: open - Opened by carlosliarte almost 3 years ago - 4 comments

#1461 - PVC storageClass & sizeLimit aren't exposed when deploying spark executors with dedicated PVCs

Issue - State: open - Opened by orsagiv94 almost 3 years ago - 6 comments

#1440 - Spark application is not running after redeployment

Issue - State: open - Opened by nirdror almost 3 years ago - 1 comment

#1438 - extra volumes are not mounted on driver/executor

Issue - State: closed - Opened by ArshiAAkhavan almost 3 years ago - 6 comments

#1430 - Why my sidecar is not working ?

Issue - State: closed - Opened by everydots almost 3 years ago - 1 comment

#1420 - [WIP] Add a hook to dowload the external jar if it is specified

Pull Request - State: closed - Opened by bagnaram almost 3 years ago

GitHub / GoogleCloudPlatform/spark-on-k8s-operator issues and pull requests