kubeflow/spark-operator issues and pull requests

#1018 - "[FATAL tini (16)] exec driver-py failed: No such file or directory" with spark-py:v3.0.0 container image

Issue - State: open - Opened by akuzni2 about 4 years ago - 14 comments
Labels: lifecycle/stale

#1011 - set -Dpackaging.type=jar spark.driver.extraJavaOptions | spec.driver.javaOptions

Issue - State: open - Opened by sulthonzh about 4 years ago - 2 comments
Labels: lifecycle/stale

#1009 - Provide release binary for sparkctl

Issue - State: closed - Opened by sepulworld about 4 years ago - 1 comment
Labels: lifecycle/stale

#1005 - Race condition with webhook admission

Issue - State: open - Opened by andizzle about 4 years ago - 1 comment
Labels: lifecycle/stale

#915 - Add support for arm64

Issue - State: closed - Opened by holdenk over 4 years ago - 12 comments

#873 - Can't have webhook working in multiple namespaces

Issue - State: closed - Opened by doctapp over 4 years ago - 14 comments

#839 - [WIP] add documentation for airflow-integration

Pull Request - State: closed - Opened by roitvt over 4 years ago - 8 comments

#651 - Ability to set operator pod and container security context

Issue - State: closed - Opened by AceHack about 5 years ago - 2 comments

#590 - Having a dedicated website for documentation

Issue - State: closed - Opened by liyinan926 about 5 years ago - 4 comments
Labels: enhancement, help wanted, documentation

#100 - Updated documentation

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#99 - Quick start guide and detailed user guide

Issue - State: closed - Opened by liyinan926 over 6 years ago
Labels: documentation

#98 - Add app name as an additional label selector for the UI service

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#97 - Fixed application state reporting around time of submission

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#96 - Updated README.md

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#95 - Updated crd jsonschema validation to cover the new fields

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#94 - Enable cache re-sync

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#93 - Do not delete the CustomResourceDefinition when the controller stops

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#92 - Check condition for submission in onAdd

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#91 - Update the CustomResourceDefinitions if `install-crds=true` and they already exist

Issue - State: closed - Opened by liyinan926 over 6 years ago - 1 comment
Labels: enhancement

#90 - Investigate enabling cache resync and re-list upon controller restarting

Issue - State: closed - Opened by liyinan926 over 6 years ago
Labels: enhancement

#89 - Switched to use the generated informer and lister

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#88 - Added linear backoff when retrying failed submissions

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#87 - Added support for SparkApplication updates

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#86 - Refactored the queueing logic of the initializer

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#85 - Minor fix around handling of executor state updates

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#84 - Added a placeholder for handling updates

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#83 - Investigate how updates to existing SparkApplication objects should be handled

Issue - State: closed - Opened by liyinan926 over 6 years ago
Labels: enhancement

#82 - Use the built-in key function

Pull Request - State: closed - Opened by liyinan926 over 6 years ago

#81 - Added support for retrying failed submissions

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#80 - Switch to use the built-in support for mounting secrets in Spark

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#79 - Add a Helm chart for the operator deployment

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 18 comments
Labels: enhancement, help wanted

#78 - Fixed a few places of wording in sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#77 - Investigating migrating sparkctl to be based on kubectl plugins

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: kind/feature

#76 - Added basic jsonschema validation for SparkApplication

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#75 - Use jasonschema to validate CRD objects

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: enhancement

#74 - Use the cache store instead of using the runningApp

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#73 - Simplified the handling of pod state updates

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#72 - Move images to gcr.io

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#71 - Enable Travis CI build

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#70 - Do not wait for application to complete

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#69 - Put double quotes around arguments

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#68 - Initial documentation on design and API definition

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago - 3 comments

#67 - Integration with Prometheus for metrics and monitoring

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 19 comments
Labels: kind/feature

#66 - Replacing the initializer with a mutating webhook

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 5 comments
Labels: enhancement

#65 - Add support for staging local dependencies to a HTTP server (e.g., RSS)

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 1 comment
Labels: kind/feature

#64 - Add support for mounting user-specified volumes

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: kind/feature

#63 - Add support for dumping application logs to GCS

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: kind/feature, gcp

#62 - Delete the CRD definition when the operator is stopped

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#61 - Ran go fmt on code

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#60 - Added basic validation of SparkApplication spec in create

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#59 - Added a field for specifying the init-container image

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#58 - Added support for more Spark configuration properties

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#57 - Improve unit test coverage

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: enhancement

#56 - Added support for core limits, labels, and annotations, node selector, and pull policy

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago - 1 comment

#55 - Alpha release v0.1

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 2 comments

#54 - Finalize SparkApplication API for alpha release

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 4 comments
Labels: enhancement

#53 - Basic e2e testing

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 1 comment
Labels: enhancement

#52 - Specifying driver and executor pod properties

Issue - State: closed - Opened by foxish almost 7 years ago - 1 comment

#51 - Make sure local files are closed

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#50 - Added a flag to control whether to override files already exist remotely

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#49 - Enable travis build

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#48 - Pretty printing executor status

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#47 - Added support for uploading local dependencies to GCS

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#46 - Switched dependency management from glide to dep

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#45 - Added HADOOP_CONF_DIR to SPARK_CLASSPATH

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#44 - Set application state based on driver pod phase

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#43 - Updated to support the single image

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#42 - Update to support using the default single Spark image

Issue - State: closed - Opened by liyinan926 almost 7 years ago

#41 - Updated RBAC setup

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#40 - Spark operator roadmap for 2018

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 4 comments

#39 - Added support for fetching executor logs and some refactoring

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#38 - Fixed import order

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#37 - Added a README for sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#36 - Added a forward command for accessing the Spark UI

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#35 - Better handle crashes in the components

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#34 - Added a list command

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#33 - Fixed a bug in adding configmap mounting annotations

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#32 - Added basic implementation of log command of sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#31 - Added basic implementation of of sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#30 - Initial setup for sparkctl

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#29 - Implement sparkctl: a cmd tool for working with the operator

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 3 comments
Labels: kind/feature

#28 - Add a flag to control enabling of the initializer

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#27 - Not able to launch a spark operator using standard docker

Issue - State: closed - Opened by devtagare almost 7 years ago - 11 comments

#26 - Support automatic RBAC setup on a per-application basis

Issue - State: closed - Opened by liyinan926 almost 7 years ago
Labels: kind/feature

#25 - Some refactoring to controller.go

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#24 - Switched to use a work queue in the crd controller

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#23 - Refactored the controller code

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#22 - Use versioned pod client to list and watch pods

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#21 - Updated README.md

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#20 - Updated versions of some dependencies

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#19 - Switched to use auto-generated clientset

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#18 - Simplified the way the UI service is named

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#17 - Support application restart with a configurable restart policy

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#16 - Add restartPolicy field

Issue - State: closed - Opened by ozzieba almost 7 years ago - 1 comment

#15 - Support non-container-local application dependencies

Issue - State: closed - Opened by liyinan926 almost 7 years ago - 3 comments
Labels: kind/feature

#14 - Added auto generated clientset, informers, and listers

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#13 - Made the unit tests to use a fake event recorder

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#12 - Added Kubernetes event recording for SparkApplications

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#11 - Updated README.md

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

#10 - Simplified names of some fields of SparkApplicationSpec

Pull Request - State: closed - Opened by liyinan926 almost 7 years ago

GitHub / kubeflow/spark-operator issues and pull requests