kubeflow/spark-operator issues and pull requests

#88 - Added linear backoff when retrying failed submissions

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#87 - Added support for SparkApplication updates

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#86 - Refactored the queueing logic of the initializer

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#85 - Minor fix around handling of executor state updates

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#84 - Added a placeholder for handling updates

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#83 - Investigate how updates to existing SparkApplication objects should be handled

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: enhancement

#82 - Use the built-in key function

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#81 - Added support for retrying failed submissions

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#80 - Switch to use the built-in support for mounting secrets in Spark

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#79 - Add a Helm chart for the operator deployment

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 18 comments
Labels: enhancement, help wanted

#78 - Fixed a few places of wording in sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#77 - Investigating migrating sparkctl to be based on kubectl plugins

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: kind/feature

#76 - Added basic jsonschema validation for SparkApplication

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#75 - Use jasonschema to validate CRD objects

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: enhancement

#74 - Use the cache store instead of using the runningApp

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#73 - Simplified the handling of pod state updates

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#72 - Move images to gcr.io

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#71 - Enable Travis CI build

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#70 - Do not wait for application to complete

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#69 - Put double quotes around arguments

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#68 - Initial documentation on design and API definition

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago - 3 comments

#67 - Integration with Prometheus for metrics and monitoring

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 19 comments
Labels: kind/feature

#66 - Replacing the initializer with a mutating webhook

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 5 comments
Labels: enhancement

#65 - Add support for staging local dependencies to a HTTP server (e.g., RSS)

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 1 comment
Labels: kind/feature

#64 - Add support for mounting user-specified volumes

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: kind/feature

#63 - Add support for dumping application logs to GCS

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: kind/feature, gcp

#62 - Delete the CRD definition when the operator is stopped

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#61 - Ran go fmt on code

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#60 - Added basic validation of SparkApplication spec in create

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#59 - Added a field for specifying the init-container image

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#58 - Added support for more Spark configuration properties

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#57 - Improve unit test coverage

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: enhancement

#56 - Added support for core limits, labels, and annotations, node selector, and pull policy

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago - 1 comment

#55 - Alpha release v0.1

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 2 comments

#54 - Finalize SparkApplication API for alpha release

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 4 comments
Labels: enhancement

#53 - Basic e2e testing

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 1 comment
Labels: enhancement

#52 - Specifying driver and executor pod properties

Issue - State: closed - Opened by foxish almost 7 years ago - 1 comment

#51 - Make sure local files are closed

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#50 - Added a flag to control whether to override files already exist remotely

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#49 - Enable travis build

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#48 - Pretty printing executor status

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#47 - Added support for uploading local dependencies to GCS

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#46 - Switched dependency management from glide to dep

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#45 - Added HADOOP_CONF_DIR to SPARK_CLASSPATH

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#44 - Set application state based on driver pod phase

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#43 - Updated to support the single image

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#42 - Update to support using the default single Spark image

Issue - State: closed - Opened by liyinan926 almost 7 years ago

#41 - Updated RBAC setup

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#40 - Spark operator roadmap for 2018

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 4 comments

#39 - Added support for fetching executor logs and some refactoring

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#38 - Fixed import order

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#37 - Added a README for sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#36 - Added a forward command for accessing the Spark UI

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#35 - Better handle crashes in the components

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#34 - Added a list command

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#33 - Fixed a bug in adding configmap mounting annotations

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#32 - Added basic implementation of log command of sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#31 - Added basic implementation of of sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#30 - Initial setup for sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#29 - Implement sparkctl: a cmd tool for working with the operator

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 3 comments
Labels: kind/feature

#28 - Add a flag to control enabling of the initializer

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#27 - Not able to launch a spark operator using standard docker

Issue - State: closed - Opened by devtagare almost 7 years ago - 11 comments

#26 - Support automatic RBAC setup on a per-application basis

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: kind/feature

#25 - Some refactoring to controller.go

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#24 - Switched to use a work queue in the crd controller

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#23 - Refactored the controller code

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#22 - Use versioned pod client to list and watch pods

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#21 - Updated README.md

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#20 - Updated versions of some dependencies

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#19 - Switched to use auto-generated clientset

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#18 - Simplified the way the UI service is named

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#17 - Support application restart with a configurable restart policy

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#16 - Add restartPolicy field

Issue - State: closed - Opened by ozzieba almost 7 years ago - 1 comment

#15 - Support non-container-local application dependencies

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 3 comments
Labels: kind/feature

#14 - Added auto generated clientset, informers, and listers

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#13 - Made the unit tests to use a fake event recorder

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#12 - Added Kubernetes event recording for SparkApplications

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#11 - Updated README.md

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#10 - Simplified names of some fields of SparkApplicationSpec

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#9 - Do not use shared informer in the initializer and pod monitor

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#8 - Wait for caches to sync

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#7 - Get pods from the cache store instead of from the API server

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#6 - Used shared pod informer in the initializer and spark pod monitor

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#5 - Fixed typos

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#4 - Migrated to base off Spark 2.3

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#3 - Updated README.md

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#2 - Fixed build

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#1 - Allow for NodePort to be configurable / switched to LoadBalancer

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 3 comments

GitHub / kubeflow/spark-operator issues and pull requests