kubeflow/spark-operator issues and pull requests

#945 - Spark driver cannot access --py-files and --files (http / gs / s3 )

Issue - State: closed - Opened by ocassetti over 4 years ago - 8 comments
Labels: lifecycle/stale

#937 - Got error when update crd

Issue - State: closed - Opened by ycwdaaaa over 4 years ago - 7 comments
Labels: lifecycle/stale

#937 - Got error when update crd

Issue - State: closed - Opened by ycwdaaaa over 4 years ago - 7 comments
Labels: lifecycle/stale

#931 - set correct SPARK_USER ENV when submit sparkapplications

Issue - State: closed - Opened by camper42 over 4 years ago - 8 comments
Labels: lifecycle/stale

#931 - set correct SPARK_USER ENV when submit sparkapplications

Issue - State: closed - Opened by camper42 over 4 years ago - 8 comments
Labels: lifecycle/stale

#915 - Add support for arm64

Issue - State: closed - Opened by holdenk over 4 years ago - 12 comments

#913 - Question: does executor needs checkpoint directory?

Issue - State: closed - Opened by FloraZhang over 4 years ago - 2 comments
Labels: lifecycle/stale

#913 - Question: does executor needs checkpoint directory?

Issue - State: closed - Opened by FloraZhang over 4 years ago - 2 comments
Labels: lifecycle/stale

#912 - Weird behavior: Volumes may not attached to driver Pods after a while

Issue - State: closed - Opened by zzvara over 4 years ago - 3 comments
Labels: lifecycle/stale

#912 - Weird behavior: Volumes may not attached to driver Pods after a while

Issue - State: closed - Opened by zzvara over 4 years ago - 3 comments
Labels: lifecycle/stale

#910 - Webhook is dissapearing

Issue - State: closed - Opened by michalzxc over 4 years ago - 9 comments
Labels: lifecycle/stale

#910 - Webhook is dissapearing

Issue - State: closed - Opened by michalzxc over 4 years ago - 9 comments
Labels: lifecycle/stale

#909 - Counters initialization for metrics exposure

Issue - State: closed - Opened by Jimmy-Newtron over 4 years ago - 4 comments
Labels: lifecycle/stale

#909 - Counters initialization for metrics exposure

Issue - State: closed - Opened by Jimmy-Newtron over 4 years ago - 4 comments
Labels: lifecycle/stale

#904 - custom prometheus.yaml file

Issue - State: closed - Opened by mirajgodha over 4 years ago - 3 comments
Labels: lifecycle/stale

#904 - custom prometheus.yaml file

Issue - State: closed - Opened by mirajgodha over 4 years ago - 3 comments
Labels: lifecycle/stale

#900 - Misleading Exception when Executor fails: io.fabric8.kubernetes.client.KubernetesClientException

Issue - State: closed - Opened by YoavNordmann over 4 years ago - 5 comments
Labels: lifecycle/stale

#900 - Misleading Exception when Executor fails: io.fabric8.kubernetes.client.KubernetesClientException

Issue - State: closed - Opened by YoavNordmann over 4 years ago - 5 comments
Labels: lifecycle/stale

#889 - Please support istio with auto inject

Issue - State: closed - Opened by AceHack over 4 years ago - 22 comments
Labels: lifecycle/stale

#889 - Please support istio with auto inject

Issue - State: closed - Opened by AceHack over 4 years ago - 22 comments
Labels: lifecycle/stale

#885 - custom serviceAccount for executor

Issue - State: closed - Opened by cwei-bgl over 4 years ago - 6 comments
Labels: enhancement, lifecycle/stale

#885 - custom serviceAccount for executor

Issue - State: closed - Opened by cwei-bgl over 4 years ago - 6 comments
Labels: enhancement, lifecycle/stale

#883 - Starting multiple Spark jobs in close succession can lead to a deadlock due to resource exhaustion

Issue - State: closed - Opened by jgoeres over 4 years ago - 8 comments
Labels: lifecycle/stale

#883 - Starting multiple Spark jobs in close succession can lead to a deadlock due to resource exhaustion

Issue - State: closed - Opened by jgoeres over 4 years ago - 8 comments
Labels: lifecycle/stale

#873 - Can't have webhook working in multiple namespaces

Issue - State: closed - Opened by doctapp over 4 years ago - 14 comments

#872 - Possible race when creating headless service for a driver

Issue - State: closed - Opened by afilipchik over 4 years ago - 2 comments
Labels: lifecycle/stale

#872 - Possible race when creating headless service for a driver

Issue - State: closed - Opened by afilipchik over 4 years ago - 2 comments
Labels: lifecycle/stale

#870 - Add config/instructions for Beam Python

Issue - State: closed - Opened by ibzib over 4 years ago - 9 comments
Labels: enhancement, lifecycle/stale

#870 - Add config/instructions for Beam Python

Issue - State: closed - Opened by ibzib over 4 years ago - 9 comments
Labels: enhancement, lifecycle/stale

#866 - [proposal] Add `nodeName` in SparkPodSpec

Issue - State: closed - Opened by ringtail over 4 years ago - 7 comments
Labels: enhancement, lifecycle/stale

#866 - [proposal] Add `nodeName` in SparkPodSpec

Issue - State: closed - Opened by ringtail over 4 years ago - 7 comments
Labels: enhancement, lifecycle/stale

#864 - [proposal] Add volumeClaimTemplates to executor spec.

Issue - State: closed - Opened by ringtail over 4 years ago - 11 comments
Labels: enhancement, lifecycle/stale

#864 - [proposal] Add volumeClaimTemplates to executor spec.

Issue - State: closed - Opened by ringtail over 4 years ago - 11 comments
Labels: enhancement, lifecycle/stale

#863 - prometheus jmx scrape failed

Issue - State: closed - Opened by FloraZhang over 4 years ago - 2 comments
Labels: lifecycle/stale

#863 - prometheus jmx scrape failed

Issue - State: closed - Opened by FloraZhang over 4 years ago - 2 comments
Labels: lifecycle/stale

#862 - Mutating Admission Webhook Context Deadline Exceeded

Issue - State: closed - Opened by mattcarrier over 4 years ago - 2 comments
Labels: lifecycle/stale

#862 - Mutating Admission Webhook Context Deadline Exceeded

Issue - State: closed - Opened by mattcarrier over 4 years ago - 2 comments
Labels: lifecycle/stale

#855 - Call from API server to webhook fails because of self-signed certificate

Issue - State: closed - Opened by scheleaap over 4 years ago - 10 comments
Labels: lifecycle/stale

#855 - Call from API server to webhook fails because of self-signed certificate

Issue - State: closed - Opened by scheleaap over 4 years ago - 10 comments
Labels: lifecycle/stale

#850 - Reload sparkapplication when configmap changes?

Issue - State: closed - Opened by apkerr over 4 years ago - 4 comments
Labels: enhancement, lifecycle/stale

#850 - Reload sparkapplication when configmap changes?

Issue - State: closed - Opened by apkerr over 4 years ago - 4 comments
Labels: enhancement, lifecycle/stale

#848 - plaintext http redirection even with spark.ssl.ui.enabled

Issue - State: closed - Opened by cytar over 4 years ago - 3 comments
Labels: lifecycle/stale

#848 - plaintext http redirection even with spark.ssl.ui.enabled

Issue - State: closed - Opened by cytar over 4 years ago - 3 comments
Labels: lifecycle/stale

#843 - can mainApplicationFile python file can be fetched from volume mount or directly from S3?

Issue - State: closed - Opened by ssvinoth22 over 4 years ago - 13 comments
Labels: lifecycle/stale

#843 - can mainApplicationFile python file can be fetched from volume mount or directly from S3?

Issue - State: closed - Opened by ssvinoth22 over 4 years ago - 13 comments
Labels: lifecycle/stale

#839 - [WIP] add documentation for airflow-integration

Pull Request - State: closed - Opened by roitvt over 4 years ago - 8 comments

#838 - SparkR dependencies in SparkApplication

Issue - State: closed - Opened by alessioale over 4 years ago - 3 comments
Labels: lifecycle/stale

#838 - SparkR dependencies in SparkApplication

Issue - State: closed - Opened by alessioale over 4 years ago - 3 comments
Labels: lifecycle/stale

#834 - SparkApplication CRD Deletion: Driver/Executor Pods not deleted

Issue - State: closed - Opened by akhurana001 over 4 years ago - 6 comments
Labels: lifecycle/stale

#834 - SparkApplication CRD Deletion: Driver/Executor Pods not deleted

Issue - State: closed - Opened by akhurana001 over 4 years ago - 6 comments
Labels: lifecycle/stale

#819 - Webhook does not work as expected

Issue - State: closed - Opened by alessioale almost 5 years ago - 5 comments
Labels: lifecycle/stale

#819 - Webhook does not work as expected

Issue - State: closed - Opened by alessioale almost 5 years ago - 5 comments
Labels: lifecycle/stale

#814 - How to bundle operator and sparkapplication helm charts

Issue - State: closed - Opened by FloraZhang almost 5 years ago - 2 comments
Labels: lifecycle/stale

#814 - How to bundle operator and sparkapplication helm charts

Issue - State: closed - Opened by FloraZhang almost 5 years ago - 2 comments
Labels: lifecycle/stale

#789 - executor not running

Issue - State: closed - Opened by wangyhwyh753 almost 5 years ago - 5 comments
Labels: lifecycle/stale

#789 - executor not running

Issue - State: closed - Opened by wangyhwyh753 almost 5 years ago - 5 comments
Labels: lifecycle/stale

#787 - ScheduledSparkApplication stopped creating new SparkApplication instances after failure

Issue - State: open - Opened by duongnt almost 5 years ago - 6 comments
Labels: kind/bug, lifecycle/stale

#753 - Support log4j configuration in SparkApplication

Issue - State: closed - Opened by liyinan926 almost 5 years ago - 6 comments
Labels: enhancement, lifecycle/stale

#744 - Spark SQL support

Issue - State: closed - Opened by liyinan926 almost 5 years ago - 7 comments
Labels: enhancement, lifecycle/stale

#732 - Reliably wait for spark application to start and then to finish

Issue - State: closed - Opened by jkleckner almost 5 years ago - 10 comments
Labels: lifecycle/stale

#698 - 'SparkApplicationSpecUpdateFailed' failed to process spec update for SparkApplication

Issue - State: closed - Opened by kumud-pe about 5 years ago - 2 comments
Labels: lifecycle/stale

#693 - [discussion][API] Custom SparkPodSpec or v1.PodTemplateSpec

Issue - State: closed - Opened by gaocegege about 5 years ago - 10 comments
Labels: lifecycle/stale

#685 - Apply common pod labels to submitted applications

Issue - State: closed - Opened by akirillov about 5 years ago - 7 comments
Labels: enhancement, lifecycle/stale

#657 - Submission failure if too many envSecrets

Issue - State: closed - Opened by michalzxc about 5 years ago - 15 comments
Labels: lifecycle/stale

#651 - Ability to set operator pod and container security context

Issue - State: closed - Opened by AceHack about 5 years ago - 2 comments

#650 - Ability to set driver/executor container security context

Issue - State: closed - Opened by AceHack about 5 years ago - 2 comments
Labels: lifecycle/stale

#641 - Support of dynamic resource allocation

Issue - State: closed - Opened by yuanchen8911 about 5 years ago - 11 comments
Labels: enhancement, lifecycle/stale

#626 - Multiple ways to specify Spark configurations causing duplicate spark-submit args

Issue - State: closed - Opened by michaeljmarshall about 5 years ago - 5 comments
Labels: lifecycle/stale

#621 - Support of spark-shell

Issue - State: closed - Opened by jblankfeld about 5 years ago - 14 comments
Labels: lifecycle/stale

#610 - Multi-version support in master

Issue - State: closed - Opened by akhurana001 about 5 years ago - 16 comments
Labels: lifecycle/stale

#598 - How to run docker image outside K8s locally

Issue - State: closed - Opened by AceHack about 5 years ago - 5 comments
Labels: lifecycle/stale

#597 - Can't install webhook with helm --wait or --atomic operation

Issue - State: closed - Opened by AceHack about 5 years ago - 5 comments
Labels: lifecycle/stale

#590 - Having a dedicated website for documentation

Issue - State: closed - Opened by liyinan926 over 5 years ago - 4 comments
Labels: enhancement, help wanted, documentation

#586 - Please add support for VSCode and IntelliJ for CRD yaml

Issue - State: closed - Opened by AceHack over 5 years ago - 5 comments
Labels: enhancement, lifecycle/stale

#584 - Please add support for dotnet

Issue - State: closed - Opened by AceHack over 5 years ago - 4 comments
Labels: enhancement, lifecycle/stale

#560 - SparkApplication Monitoring Configuration misleading/confusing

Issue - State: closed - Opened by rolandjohann over 5 years ago - 3 comments
Labels: lifecycle/stale

#559 - SparkConf/HadoopConf from secret

Issue - State: closed - Opened by rolandjohann over 5 years ago - 18 comments
Labels: lifecycle/stale

#548 - Add checksum support for SparkApplication to enable rerun after configmap changes.

Issue - State: closed - Opened by ryanli-me over 5 years ago - 4 comments
Labels: lifecycle/stale

#502 - Airflow Integration

Issue - State: closed - Opened by ashishwrt over 5 years ago - 15 comments
Labels: lifecycle/stale

#498 - Update CR when not all Spark app pods are scheduled

Issue - State: closed - Opened by skonto over 5 years ago - 3 comments
Labels: lifecycle/stale

#480 - Improve attributes given by Prometheus monitoring

Issue - State: closed - Opened by ghost over 5 years ago - 5 comments
Labels: lifecycle/stale

#413 - Add minikube support to travis and trigger integration tests

Issue - State: closed - Opened by skonto almost 6 years ago - 2 comments
Labels: lifecycle/stale

#401 - [bug] executor pod memory overhead

Issue - State: closed - Opened by chenqin almost 6 years ago - 4 comments
Labels: lifecycle/stale

#352 - How to define dependency packages

Issue - State: open - Opened by richardxy almost 6 years ago - 40 comments
Labels: enhancement

#313 - Need support for priority queues for spark-submit

Issue - State: closed - Opened by ligao101 about 6 years ago - 2 comments
Labels: enhancement, lifecycle/stale

#302 - Kerberos Support

Issue - State: closed - Opened by kalvinnchau about 6 years ago - 32 comments
Labels: enhancement, lifecycle/stale

#300 - Configuring driver.podName causes Pod already exists error in `ScheduledSparkApplication`

Issue - State: closed - Opened by spjegan about 6 years ago - 5 comments
Labels: lifecycle/stale