data-workspaces/data-workspaces-core issues and pull requests

#79 - If the filename of a modified file contains spaces, dws snapshot fails

Issue - State: closed - Opened by jfischer about 3 years ago - 1 comment

#78 - Get error in Mypy checking due to presences of dataworkspaces.kits.tensorflow module

Issue - State: closed - Opened by jfischer over 3 years ago

#77 - Snapshots on local-files and rclone resource types are slow due to bug in file hash tree builder

Issue - State: closed - Opened by jfischer over 3 years ago

#76 - When dws repo was created with "main" branch, pushes fail

Issue - State: closed - Opened by jfischer about 4 years ago

#75 - dws should work with a primary branch named "main"

Issue - State: closed - Opened by jfischer over 4 years ago - 2 comments

#74 - dws pull does not work correctly for git resources where branch is not master

Issue - State: closed - Opened by jfischer over 4 years ago

#73 - Import of sklearn kit is slow, due to tensorflow import

Issue - State: open - Opened by jfischer over 4 years ago

#72 - snapshots and snapshot_metadata directories get deleted when you delete all snapshots

Issue - State: open - Opened by jfischer over 4 years ago - 1 comment

#71 - Get an error during snapshot if a .gitignored directory is under a results resource

Issue - State: open - Opened by jfischer over 4 years ago

#70 - Snapshot tags should be able to contain '_', but still get error anyway if included in tag

Issue - State: open - Opened by jfischer over 4 years ago

#69 - HashTree (for local files and rclone resources) too slow

Issue - State: closed - Opened by jfischer over 4 years ago - 1 comment

#68 - Tensorflow 2.2 API changes break our Tensorflow kit

Issue - State: closed - Opened by jfischer over 4 years ago

#67 - pip install from local source tree fails if dependencies missing

Issue - State: closed - Opened by jfischer over 4 years ago - 1 comment

#66 - If a parameter definition is added to a resource type, or a parameter value changes, this changes the overall snapshot hash

Issue - State: open - Opened by jfischer almost 5 years ago - 1 comment

#65 - rclone resource does not handle relative remote paths correctly

Issue - State: closed - Opened by jfischer almost 5 years ago

#64 - In sklearn integration, LineagePredictor should support multiple input resources

Issue - State: open - Opened by jfischer almost 5 years ago - 1 comment
Labels: enhancement

#63 - Upgrade embedded git-fat to Python 3

Issue - State: open - Opened by jfischer almost 5 years ago

#62 - Show more information if someone imports dataworkspaces

Issue - State: closed - Opened by jfischer almost 5 years ago

#61 - Heatmap: problems with binning when qcut() returns number of bins

Issue - State: closed - Opened by jfischer almost 5 years ago

#60 - Error when taking a snapshot due to git problem

Issue - State: closed - Opened by jfischer almost 5 years ago - 1 comment

#59 - Pulling a workspace should not havoc current lineage for resources that didn't change

Issue - State: open - Opened by jfischer almost 5 years ago

#58 - When cloning a workspace, create a virtualenv or conda environment

Issue - State: open - Opened by jfischer almost 5 years ago
Labels: enhancement

#57 - Add documentation for git-lfs usage

Issue - State: closed - Opened by jfischer almost 5 years ago
Labels: documentation

#56 - Problem with --heatmap option on %dws_history

Issue - State: closed - Opened by jfischer almost 5 years ago

#55 - Allow push with uncommitted changes

Issue - State: closed - Opened by jfischer almost 5 years ago

#54 - Add .ipynb_checkpoints/ to initial .gitignore

Issue - State: closed - Opened by jfischer almost 5 years ago

#53 - When restoring an exported resource, should we copy the lineage.json file?

Issue - State: open - Opened by jfischer almost 5 years ago
Labels: needs discussion

#52 - When adding a git repo resource, should be able to specify the URL and have it cloned

Issue - State: open - Opened by jfischer almost 5 years ago
Labels: enhancement

#51 - In lineage object, add_output_path() does not handle resource subpaths

Issue - State: closed - Opened by jfischer almost 5 years ago - 1 comment
Labels: could not reproduce

#50 - Local file and rclone resources: support relative paths for global_local_path

Issue - State: open - Opened by jfischer almost 5 years ago
Labels: enhancement

#49 - dws report lineage fails with a key error

Issue - State: closed - Opened by jfischer about 5 years ago

#48 - When cloning a resource, make sure the user always approves any local paths outside the workspace

Issue - State: open - Opened by jfischer about 5 years ago

#47 - If you rerun the model fit in a Tensorflow notebook, get an exception

Issue - State: open - Opened by jfischer about 5 years ago

#46 - Lineage graph does not work from JupyterHub

Issue - State: closed - Opened by jfischer about 5 years ago

#45 - git_utils.strip_slashes throws an assert

Issue - State: closed - Opened by jfischer about 5 years ago

#44 - get_notebook_name() fails in JupyterHub

Issue - State: closed - Opened by jfischer about 5 years ago - 2 comments

#43 - If the user.name and user.email config parameters for git have not been set, first git commit will fail

Issue - State: closed - Opened by jfischer about 5 years ago - 1 comment

#42 - Missing template file for lineage graph

Issue - State: closed - Opened by jfischer over 5 years ago

#41 - Refactoring for 1.1: Add back in diffs for lineage

Issue - State: open - Opened by jfischer over 5 years ago

#40 - Refactoring for 1.1: Migrate metrics capture to new interface

Issue - State: closed - Opened by jfischer over 5 years ago

#39 - Refactoring for 1.1: when cloning a local resource, handle case where local path does not exist

Issue - State: closed - Opened by jfischer over 5 years ago - 1 comment

#38 - Refactoring for 1.1: Port git-fat handling code to ws-abstraction

Issue - State: closed - Opened by jfischer over 5 years ago - 1 comment

#37 - local files resource: hashing compare misses some newly added files

Issue - State: closed - Opened by jfischer over 5 years ago - 1 comment

#36 - Cross device soft-links are turned to hard-links on taking a snapshot.

Issue - State: closed - Opened by musically-ut over 5 years ago - 1 comment

#35 - Improve documentation on best practices for using the local files resource type

Issue - State: open - Opened by jfischer over 5 years ago
Labels: documentation

#34 - BUG: git-fat script is not included in the package.

Issue - State: closed - Opened by musically-ut over 5 years ago - 1 comment

#33 - Snapshot picks wrong hash when changes are made to a git resource without committing

Issue - State: open - Opened by jfischer almost 6 years ago

#32 - Implement run command for data lineage

Issue - State: open - Opened by jfischer almost 6 years ago

#31 - dws add git should have a --read-only option

Issue - State: closed - Opened by jfischer almost 6 years ago - 1 comment

#30 - Problem when trying to pull from a GitHub repo

Issue - State: closed - Opened by jfischer almost 6 years ago

#29 - Code resources not specified when using Juypter and scikit learn apis

Issue - State: closed - Opened by jfischer almost 6 years ago

#28 - When pulling/pushing, check for duplicate tags

Issue - State: open - Opened by jfischer almost 6 years ago

#27 - Need a way to remove a snapshot

Issue - State: closed - Opened by jfischer almost 6 years ago - 1 comment
Labels: enhancement

#26 - Document the add of specific resource types

Issue - State: closed - Opened by jfischer almost 6 years ago
Labels: documentation

#25 - Add tutorial content to dws documentation

Issue - State: closed - Opened by jfischer almost 6 years ago
Labels: documentation

#24 - Add code to data lineage

Issue - State: closed - Opened by jfischer almost 6 years ago

#23 - For git-subdirectory resources, the hash is of the overall repo, not the subdirectory

Issue - State: closed - Opened by jfischer almost 6 years ago

#22 - Short git hashes should match on the beginning of the hash, not the end

Issue - State: closed - Opened by jfischer almost 6 years ago

#21 - Snapshot fails if /tmp is on a different filesystem

Issue - State: closed - Opened by jfischer almost 6 years ago

#20 - Lineage does not seem to be saving the elapsed time

Issue - State: closed - Opened by jfischer almost 6 years ago - 4 comments

#19 - On dws status --history, show the first results metric for each snapshot

Issue - State: closed - Opened by jfischer almost 6 years ago

#18 - hash code for snapshot history added

Pull Request - State: closed - Opened by udit0304 almost 6 years ago

#17 - Get a warning about no lineage data available for a code resource

Issue - State: closed - Opened by jfischer almost 6 years ago - 1 comment

#16 - Writes to the lineage store should either succeed or restore the prior state

Issue - State: open - Opened by jfischer almost 6 years ago

#15 - Need docs for how to set up development environment

Issue - State: closed - Opened by jfischer almost 6 years ago
Labels: documentation

#14 - Add the snapshot hash to the status --history command

Issue - State: closed - Opened by jfischer almost 6 years ago - 1 comment

#13 - snapshot_history.json file will have git merge issues

Issue - State: closed - Opened by jfischer almost 6 years ago - 1 comment

#12 - If a repo is git-fat enabled, and git-fat is in not in the path, git-add will fail silently.

Issue - State: closed - Opened by jfischer about 6 years ago

#11 - If a local file resource's directory is the same as its name, it cause problems with snapshots

Issue - State: closed - Opened by jfischer about 6 years ago

#10 - Snapshot operation on local files resource can be very slow if you have many files

Issue - State: closed - Opened by jfischer about 6 years ago - 2 comments
Labels: needs discussion

#9 - Git-fat integration

Issue - State: closed - Opened by jfischer about 6 years ago - 1 comment
Labels: enhancement

#8 - Git sub-directory resource: generated readme.txt file can be misleading

Issue - State: closed - Opened by jfischer about 6 years ago

#7 - After setting a non-default hostname, moved results files during a snapshot still use default hostname

Issue - State: closed - Opened by jfischer about 6 years ago

#6 - Don't create a new snapshot on restore?

Issue - State: closed - Opened by jfischer about 6 years ago - 1 comment
Labels: enhancement

#5 - When diffing git resources, can report differences even if resource files are the same

Issue - State: closed - Opened by jfischer about 6 years ago - 2 comments
Labels: needs discussion

#4 - dws restore deletes history for git resources

Issue - State: closed - Opened by jfischer about 6 years ago - 1 comment

#3 - Snapshot and restore fail after the workspace was cloned from remote origin

Issue - State: closed - Opened by jfischer about 6 years ago

#2 - Clone of digits workspace fails

Issue - State: closed - Opened by jfischer about 6 years ago

#1 - When doing a snapshot, git subdirectory resource fails if results were not already added to repo

Issue - State: closed - Opened by jfischer about 6 years ago

GitHub / data-workspaces/data-workspaces-core issues and pull requests