apache-spark-on-k8s/spark issues and pull requests

#100 - Run tests against any specified k8s cluster

Issue - State: closed - Opened by ash211 over 7 years ago - 10 comments
Labels: in-alpha

#99 - Note integration tests require Java 8

Pull Request - State: closed - Opened by ash211 over 7 years ago - 1 comment

#99 - Note integration tests require Java 8

Pull Request - State: closed - Opened by ash211 over 7 years ago - 1 comment

#98 - Upgrade minikube

Issue - State: closed - Opened by ash211 over 7 years ago - 1 comment
Labels: in-alpha

#98 - Upgrade minikube

Issue - State: closed - Opened by ash211 over 7 years ago - 1 comment
Labels: in-alpha

#97 - Parse results of minikube status more rigorously

Pull Request - State: closed - Opened by ash211 over 7 years ago - 4 comments

#97 - Parse results of minikube status more rigorously

Pull Request - State: closed - Opened by ash211 over 7 years ago - 4 comments

#96 - Exception when running integration tests with minikube upgrade available

Issue - State: closed - Opened by ash211 over 7 years ago - 2 comments

#96 - Exception when running integration tests with minikube upgrade available

Issue - State: closed - Opened by ash211 over 7 years ago - 2 comments

#95 - Fixed loading the executors page through the kubectl proxy.

Pull Request - State: closed - Opened by lins05 over 7 years ago - 9 comments

#95 - Fixed loading the executors page through the kubectl proxy.

Pull Request - State: closed - Opened by lins05 over 7 years ago - 9 comments

#94 - Ctrl+C on blocking spark-submit doesn't stop running job

Issue - State: closed - Opened by ash211 over 7 years ago - 5 comments
Labels: in-alpha

#94 - Ctrl+C on blocking spark-submit doesn't stop running job

Issue - State: closed - Opened by ash211 over 7 years ago - 5 comments
Labels: in-alpha

#93 - Trigger scalatest plugin in the integration-test phase

Pull Request - State: closed - Opened by kimoonkim over 7 years ago - 26 comments

#93 - Trigger scalatest plugin in the integration-test phase

Pull Request - State: closed - Opened by kimoonkim over 7 years ago - 26 comments

#92 - Match YARN behavior for spark.jars and spark.files

Issue - State: closed - Opened by ash211 over 7 years ago - 4 comments
Labels: in-alpha

#92 - Match YARN behavior for spark.jars and spark.files

Issue - State: closed - Opened by ash211 over 7 years ago - 4 comments
Labels: in-alpha

#91 - Better error message for failure to connect to Nodes

Issue - State: open - Opened by foxish over 7 years ago
Labels: in-alpha

#91 - Better error message for failure to connect to Nodes

Issue - State: open - Opened by foxish over 7 years ago
Labels: in-alpha

#90 - Narrow down the list of Node IPs to external interfaces only

Issue - State: closed - Opened by foxish over 7 years ago - 2 comments

#90 - Narrow down the list of Node IPs to external interfaces only

Issue - State: closed - Opened by foxish over 7 years ago - 2 comments

#89 - Prep for first release

Pull Request - State: closed - Opened by ash211 over 7 years ago - 2 comments

#89 - Prep for first release

Pull Request - State: closed - Opened by ash211 over 7 years ago - 2 comments

#88 - Support exporting Spark metrics to various backends

Issue - State: open - Opened by ssuchter over 7 years ago - 5 comments
Labels: in-beta

#88 - Support exporting Spark metrics to various backends

Issue - State: open - Opened by ssuchter over 7 years ago - 5 comments
Labels: in-beta

#87 - The driver web ui's executors page can't load properly through kubectl proxy

Issue - State: closed - Opened by lins05 over 7 years ago - 2 comments

#87 - The driver web ui's executors page can't load properly through kubectl proxy

Issue - State: closed - Opened by lins05 over 7 years ago - 2 comments

#86 - Check for user jars/files existence before creating the driver pod.

Pull Request - State: closed - Opened by lins05 over 7 years ago - 3 comments

#86 - Check for user jars/files existence before creating the driver pod.

Pull Request - State: closed - Opened by lins05 over 7 years ago - 3 comments

#85 - Check the existence of the user jars/files before creating the driver pod/service

Issue - State: closed - Opened by lins05 over 7 years ago

#85 - Check the existence of the user jars/files before creating the driver pod/service

Issue - State: closed - Opened by lins05 over 7 years ago

#84 - Explicitly disable "waiting for app completion" behavior for the integration tests

Pull Request - State: closed - Opened by lins05 over 7 years ago - 3 comments

#84 - Explicitly disable "waiting for app completion" behavior for the integration tests

Pull Request - State: closed - Opened by lins05 over 7 years ago - 3 comments

#83 - Small refactor of the pod status watcher

Pull Request - State: closed - Opened by lins05 over 7 years ago - 4 comments

#83 - Small refactor of the pod status watcher

Pull Request - State: closed - Opened by lins05 over 7 years ago - 4 comments

#82 - DNS resolution failing in an executor pod during torrent broadcast

Issue - State: closed - Opened by ash211 over 7 years ago - 5 comments

#82 - DNS resolution failing in an executor pod during torrent broadcast

Issue - State: closed - Opened by ash211 over 7 years ago - 5 comments

#81 - Upload jars/files to driver in binary instead of base64

Issue - State: open - Opened by ash211 over 7 years ago
Labels: in-alpha

#81 - Upload jars/files to driver in binary instead of base64

Issue - State: open - Opened by ash211 over 7 years ago
Labels: in-alpha

#80 - Allow setting additional ports on the driver pod

Pull Request - State: closed - Opened by mccheah over 7 years ago - 5 comments

#80 - Allow setting additional ports on the driver pod

Pull Request - State: closed - Opened by mccheah over 7 years ago - 5 comments

#79 - Fix NPE around unschedulable pod specs

Pull Request - State: closed - Opened by ash211 over 7 years ago - 4 comments

#78 - Allow opening additional ports on the driver

Issue - State: closed - Opened by mccheah over 7 years ago - 4 comments

#78 - Allow opening additional ports on the driver

Issue - State: closed - Opened by mccheah over 7 years ago - 4 comments

#77 - NPE during spark submission

Issue - State: closed - Opened by ash211 over 7 years ago - 1 comment

#77 - NPE during spark submission

Issue - State: closed - Opened by ash211 over 7 years ago - 1 comment

#76 - Watch for service readiness instead of pod readiness

Issue - State: closed - Opened by ash211 over 7 years ago - 2 comments

#76 - Watch for service readiness instead of pod readiness

Issue - State: closed - Opened by ash211 over 7 years ago - 2 comments

#75 - Use readiness probe instead of client-side ping.

Pull Request - State: closed - Opened by mccheah over 7 years ago - 16 comments

#75 - Use readiness probe instead of client-side ping.

Pull Request - State: closed - Opened by mccheah over 7 years ago - 16 comments

#74 - Configure Travis to run K8s integration test

Pull Request - State: closed - Opened by cvpatel over 7 years ago - 10 comments

#74 - Configure Travis to run K8s integration test

Pull Request - State: closed - Opened by cvpatel over 7 years ago - 10 comments

#73 - Filter out unschedulable nodes for the driver endpoint more rigorously

Issue - State: open - Opened by mccheah over 7 years ago - 10 comments
Labels: in-alpha

#73 - Filter out unschedulable nodes for the driver endpoint more rigorously

Issue - State: open - Opened by mccheah over 7 years ago - 10 comments
Labels: in-alpha

#72 - Replace manual ping from the client with a liveness probe

Issue - State: closed - Opened by mccheah over 7 years ago - 13 comments

#71 - Allow adding arbitrary files

Pull Request - State: closed - Opened by mccheah over 7 years ago - 5 comments

#71 - Allow adding arbitrary files

Pull Request - State: closed - Opened by mccheah over 7 years ago - 5 comments

#70 - Support creating Ingress services for driver

Issue - State: closed - Opened by ash211 over 7 years ago - 11 comments
Labels: in-alpha

#70 - Support creating Ingress services for driver

Issue - State: closed - Opened by ash211 over 7 years ago - 11 comments
Labels: in-alpha

#69 - Retry the submit-application request to multiple nodes

Pull Request - State: closed - Opened by mccheah over 7 years ago - 16 comments

#69 - Retry the submit-application request to multiple nodes

Pull Request - State: closed - Opened by mccheah over 7 years ago - 16 comments

#68 - Reduce pre-integration-test runtime

Pull Request - State: closed - Opened by mccheah over 7 years ago - 8 comments

#68 - Reduce pre-integration-test runtime

Pull Request - State: closed - Opened by mccheah over 7 years ago - 8 comments

#67 - Regression introduced by NodePort PR

Issue - State: closed - Opened by ash211 over 7 years ago - 2 comments

#67 - Regression introduced by NodePort PR

Issue - State: closed - Opened by ash211 over 7 years ago - 2 comments

#66 - Minimize integration test preparation build time

Issue - State: open - Opened by mccheah over 7 years ago
Labels: in-beta

#66 - Minimize integration test preparation build time

Issue - State: open - Opened by mccheah over 7 years ago
Labels: in-beta

#65 - Extract constants and config into separate file. Launch => Submit.

Pull Request - State: closed - Opened by mccheah over 7 years ago - 4 comments

#65 - Extract constants and config into separate file. Launch => Submit.

Pull Request - State: closed - Opened by mccheah over 7 years ago - 4 comments

#64 - decouple servlets from KubernetesSparkRestServer

Issue - State: closed - Opened by iyanuobidele over 7 years ago - 7 comments
Labels: in-beta

#64 - decouple servlets from KubernetesSparkRestServer

Issue - State: closed - Opened by iyanuobidele over 7 years ago - 7 comments
Labels: in-beta

#63 - spark-submit must work with the local kubectl proxy endpoint

Issue - State: closed - Opened by foxish over 7 years ago - 10 comments

#63 - spark-submit must work with the local kubectl proxy endpoint

Issue - State: closed - Opened by foxish over 7 years ago - 10 comments

#62 - [WIP] Extract constants

Pull Request - State: closed - Opened by mccheah over 7 years ago - 6 comments

#62 - [WIP] Extract constants

Pull Request - State: closed - Opened by mccheah over 7 years ago - 6 comments

#61 - Cut a first release and announce

Issue - State: closed - Opened by ash211 over 7 years ago - 12 comments

#61 - Cut a first release and announce

Issue - State: closed - Opened by ash211 over 7 years ago - 12 comments

#60 - Move executor and driver commands from dockerfile to scheduler

Pull Request - State: closed - Opened by tnachen over 7 years ago - 17 comments

#60 - Move executor and driver commands from dockerfile to scheduler

Pull Request - State: closed - Opened by tnachen over 7 years ago - 17 comments

#59 - Respect kube config at ~/.kube/config for master and namespace

Pull Request - State: closed - Opened by ash211 over 7 years ago - 6 comments

#58 - Respect externalIP setting in spark-submit for jar upload to NodePort service

Issue - State: closed - Opened by ash211 over 7 years ago - 1 comment

#58 - Respect externalIP setting in spark-submit for jar upload to NodePort service

Issue - State: closed - Opened by ash211 over 7 years ago - 1 comment

#57 - Create NodePort service from within driver pod

Issue - State: closed - Opened by foxish over 7 years ago - 3 comments

#57 - Create NodePort service from within driver pod

Issue - State: closed - Opened by foxish over 7 years ago - 3 comments

#56 - Added GC to components

Pull Request - State: closed - Opened by foxish over 7 years ago - 7 comments

#56 - Added GC to components

Pull Request - State: closed - Opened by foxish over 7 years ago - 7 comments

#55 - Weekly meeting

Issue - State: closed - Opened by foxish over 7 years ago - 16 comments

#55 - Weekly meeting

Issue - State: closed - Opened by foxish over 7 years ago - 16 comments

#54 - Remove unused driver extra classpath upload code

Pull Request - State: closed - Opened by mccheah over 7 years ago - 1 comment

#54 - Remove unused driver extra classpath upload code

Pull Request - State: closed - Opened by mccheah over 7 years ago - 1 comment

#53 - Introduce blocking submit to kubernetes by default

Pull Request - State: closed - Opened by ash211 over 7 years ago - 22 comments

#53 - Introduce blocking submit to kubernetes by default

Pull Request - State: closed - Opened by ash211 over 7 years ago - 22 comments

#52 - Use "extraScalaTestArgs" to pass extra options to scalatest.

Pull Request - State: closed - Opened by lins05 over 7 years ago - 3 comments

#52 - Use "extraScalaTestArgs" to pass extra options to scalatest.

Pull Request - State: closed - Opened by lins05 over 7 years ago - 3 comments

#51 - Use openjdk's alpine java image

Pull Request - State: closed - Opened by mccheah over 7 years ago - 3 comments

#51 - Use openjdk's alpine java image

Pull Request - State: closed - Opened by mccheah over 7 years ago - 3 comments

#50 - Create README to better describe project purpose

Pull Request - State: closed - Opened by ash211 over 7 years ago - 3 comments

#49 - Support SSL configuration for the driver application submission

Pull Request - State: closed - Opened by mccheah over 7 years ago - 2 comments

#48 - Support spark.driver.extraJavaOptions

Pull Request - State: closed - Opened by kimoonkim over 7 years ago - 7 comments

#48 - Support spark.driver.extraJavaOptions

Pull Request - State: closed - Opened by kimoonkim over 7 years ago - 7 comments

GitHub / apache-spark-on-k8s/spark issues and pull requests