dask/hdfs3 issues and pull requests

#180 - Move default branch from "master" -> "main"

Issue - State: open - Opened by jsignell over 3 years ago

#179 - Change default branch from master to main

Pull Request - State: open - Opened by jsignell over 3 years ago - 1 comment

#178 - Archive this repository?

Issue - State: closed - Opened by jacobtomlinson almost 4 years ago - 2 comments

#177 - Automatically update to python3.8 when run “conda install -c conda-forge hdfs3”

Issue - State: open - Opened by xiaojiongzi over 4 years ago

#176 - ReDoS Vulnerability in HDFileSystem.glob()

Issue - State: open - Opened by Alphadelta14 almost 5 years ago

#175 - pickle file not readable on Mac

Issue - State: closed - Opened by adampara about 5 years ago - 3 comments

#174 - ValueError: Invalid file path or buffer object type: <class 'tuple'>

Issue - State: closed - Opened by PhilippDangelmaier over 5 years ago

#173 - ValueError: Invalid file path or buffer object type: <class 'tuple'>

Issue - State: closed - Opened by PhilippDangelmaier over 5 years ago

#172 - Update hdfs.rst

Pull Request - State: closed - Opened by aswinjoseroy over 5 years ago

#171 - Accessing HDFS without the need of JVM

Issue - State: closed - Opened by DonDebonair almost 6 years ago - 5 comments

#170 - Add non-development messages to documentation and readme

Pull Request - State: closed - Opened by martindurant about 6 years ago - 1 comment

#169 - Strip "hdfs://" from path

Issue - State: closed - Opened by gglanzani about 6 years ago - 2 comments

#168 - pandas DataFrame.to_parquet get killed while writing to hdfs3

Issue - State: open - Opened by eromoe about 6 years ago - 5 comments

#167 - Kerberos support on hdfs3 0.1.4, libgsasl 1.8.0

Issue - State: open - Opened by KimiRaikking about 6 years ago - 3 comments

#166 - Can not find the shared library: libhdfs3.so

Issue - State: open - Opened by iniyanp over 6 years ago - 5 comments

#165 - Add support for Namenode Federation and mountables

Issue - State: closed - Opened by remysaissy over 6 years ago - 2 comments

#164 - add crc=True|False parameter to HDFileSystem(...)

Pull Request - State: open - Opened by sk1p over 6 years ago - 5 comments

#163 - Segfault When Initiating HDFS Connection

Issue - State: open - Opened by lucashu1 over 6 years ago - 26 comments

#162 - Add HDFile.readinto(length, out), re-implement read(...) in terms of readinto(...)

Pull Request - State: closed - Opened by sk1p over 6 years ago - 5 comments

#161 - Bug? The lib skip directory contents

Issue - State: open - Opened by timoninmaxim over 6 years ago - 4 comments

#160 - BYOB ("Bring Your Own Buffer") read interface

Issue - State: closed - Opened by sk1p over 6 years ago - 8 comments

#159 - ImportError: Can not find the shared library: libhdfs3.so

Issue - State: closed - Opened by hisi91 over 6 years ago - 7 comments

#158 - Kerberos // Failed to extract principal from ticket cache: Bad format in credentials cache

Issue - State: open - Opened by mehd-io over 6 years ago - 5 comments

#157 - bash: line 1: 21864 Segmentation

Issue - State: open - Opened by chanansh over 6 years ago - 2 comments

#156 - No file copy support despite appearing in the docs.

Issue - State: closed - Opened by RobertoRRW over 6 years ago - 6 comments

#155 - Is Hdfs3 support hadoop 1.0?

Issue - State: closed - Opened by kurossssd over 6 years ago - 2 comments

#154 - ModuleNotFoundError: No module named 'hdfs3'

Issue - State: closed - Opened by tobinwang over 6 years ago - 1 comment

#153 - fix possible segmentation fault when connecting

Pull Request - State: closed - Opened by martindurant over 6 years ago - 2 comments

#152 - fix Segmentation fault on lastest libhdfs3

Pull Request - State: closed - Opened by thinkiny over 6 years ago - 5 comments

#151 - Mysterious error on a kerberos-enabled cluster

Issue - State: closed - Opened by superbobry over 6 years ago - 5 comments

#150 - Fix bug- overriding the buffer size at file read / write

Pull Request - State: closed - Opened by WYishai over 6 years ago - 2 comments

#149 - Huge image size

Issue - State: open - Opened by gsakkis over 6 years ago - 2 comments

#148 - Update to new dask conventions

Pull Request - State: closed - Opened by jcrist over 6 years ago - 8 comments

#147 - Be more strict about unicode/bytes conversions

Pull Request - State: closed - Opened by jcrist almost 7 years ago - 6 comments

#146 - After HDFS wire encryption enabled on secure cluster, hdfs3 is not working

Issue - State: open - Opened by pkasinathan almost 7 years ago - 5 comments

#145 - Add versioneer

Pull Request - State: closed - Opened by jcrist almost 7 years ago - 4 comments

#144 - Move dask integration to hdfs3

Pull Request - State: closed - Opened by jcrist almost 7 years ago - 9 comments

#143 - Cleanup CI

Pull Request - State: closed - Opened by jcrist almost 7 years ago - 3 comments

#142 - Flake8, add flake8 to tests.

Pull Request - State: closed - Opened by jcrist almost 7 years ago - 1 comment

#141 - Walk matches `os.walk` behavior

Pull Request - State: closed - Opened by jcrist almost 7 years ago - 2 comments

#140 - Add isdir and isfile

Pull Request - State: closed - Opened by jcrist almost 7 years ago - 2 comments

#139 - how does this lib access the hdfs without any username pwd?

Issue - State: open - Opened by venkat-vs-id almost 7 years ago - 1 comment

#138 - libhdfs3 woes

Issue - State: open - Opened by nlevitt almost 7 years ago - 4 comments

#137 - Support for MAC OS loading dylib files for version 0.1.4

Issue - State: open - Opened by kiranvaranasi81 almost 7 years ago

#136 - Show error on .so load failure; fix conf strip

Pull Request - State: closed - Opened by martindurant almost 7 years ago

#135 - RTD fix and text

Pull Request - State: closed - Opened by martindurant almost 7 years ago

#134 - Support 'rb+' mode for open by truncation

Issue - State: open - Opened by martindurant almost 7 years ago - 3 comments

#133 - Skip already evaluated connection properties.

Pull Request - State: closed - Opened by priancho about 7 years ago - 1 comment

#132 - In HA-mode, HDFileSystem() doesn't initialize when port is not given or None is given.

Issue - State: closed - Opened by priancho about 7 years ago - 3 comments

#131 - hdfs3-0.2.0 undefined symbol: hdfsConcat

Issue - State: closed - Opened by beenhead about 7 years ago - 3 comments

#130 - Libhdfs3 HAWQ version

Pull Request - State: closed - Opened by martindurant about 7 years ago - 1 comment

#129 - Try with custom image

Pull Request - State: closed - Opened by martindurant about 7 years ago - 1 comment

#128 - token user - provide default?

Issue - State: closed - Opened by martindurant about 7 years ago

#127 - Conf rework

Pull Request - State: closed - Opened by martindurant about 7 years ago - 4 comments

#126 - Windows Support -- help needed

Issue - State: open - Opened by tadas-subonis about 7 years ago - 7 comments

#125 - Tokens

Pull Request - State: closed - Opened by martindurant about 7 years ago

#124 - Provide a function to recursively put a directory with subdirectories to HDFS

Issue - State: open - Opened by FlorianWilhelm about 7 years ago - 3 comments

#123 - Read fs.default.name settings from core-site.xml

Issue - State: closed - Opened by nsemichev about 7 years ago - 3 comments

#122 - Problems reading from Pandas: invalid path or buffer object type

Issue - State: closed - Opened by prcastro over 7 years ago - 2 comments

#121 - Add next (and next) to HDFile

Pull Request - State: closed - Opened by gglanzani over 7 years ago - 6 comments

#120 - Update default location for conf files

Pull Request - State: closed - Opened by gglanzani over 7 years ago

#119 - Add HA detection during configuration reading

Issue - State: closed - Opened by sagagliardo over 7 years ago - 2 comments

#118 - added fix to prevent None values being used in Default variables

Pull Request - State: closed - Opened by sagagliardo over 7 years ago - 16 comments

#117 - Readline and reads can now be interwoven

Pull Request - State: closed - Opened by martindurant over 7 years ago - 5 comments

#116 - Add test function that emphasize an issue when mixing read and readline calls + partial solution

Pull Request - State: closed - Opened by aabadie over 7 years ago - 4 comments

#115 - Release version 1.3 on conda

Issue - State: closed - Opened by FlorianWilhelm over 7 years ago - 2 comments

#114 - dfs.client.use.datanode.hostname have no effect

Issue - State: open - Opened by prein over 7 years ago - 5 comments

#113 - Publish wheel to PyPI that includes binary dependencies

Issue - State: open - Opened by nchammas over 7 years ago - 2 comments

#112 - Add putiter method to write iterators of bytes to HDFS

Pull Request - State: closed - Opened by cpcloud over 7 years ago - 10 comments

#111 - Update docs for HA mode

Pull Request - State: closed - Opened by martindurant over 7 years ago

#110 - Simplify conffile interpretation

Pull Request - State: closed - Opened by martindurant over 7 years ago

#109 - More usefule conf_to_dict or avoid meaningless conversions

Issue - State: closed - Opened by FlorianWilhelm over 7 years ago - 4 comments

#108 - Cannot load a pickle file containing an array

Issue - State: closed - Opened by aabadie over 7 years ago - 12 comments

#107 - Cannot load a pickle file with python 2.7

Issue - State: closed - Opened by aabadie over 7 years ago

#106 - Pin to Python 3.5 in CI

Pull Request - State: closed - Opened by koverholt over 7 years ago

#105 - index.rst dead link for libhdfs3

Issue - State: closed - Opened by ghost over 7 years ago - 1 comment

#104 - Remove use of lock file

Pull Request - State: closed - Opened by pitrou almost 8 years ago

#103 - Issue a warning if a fork() was detected after first use

Pull Request - State: closed - Opened by pitrou almost 8 years ago

#102 - Replication and block size added to put

Pull Request - State: closed - Opened by tromika almost 8 years ago

#101 - Create new lock_file object each locking use

Pull Request - State: closed - Opened by mrocklin almost 8 years ago

#100 - Usage with multiprocessing.Pool

Issue - State: closed - Opened by FlorianWilhelm almost 8 years ago - 7 comments

#99 - Add file based locks

Pull Request - State: closed - Opened by mrocklin almost 8 years ago - 7 comments

#98 - Add connection retries

Pull Request - State: closed - Opened by martindurant almost 8 years ago - 1 comment

#97 - Can not find the shared library:libhdfs3.so

Issue - State: closed - Opened by SharpLu almost 8 years ago - 5 comments

#96 - Convert readthedocs links for their .org -> .io migration for hosted projects

Pull Request - State: closed - Opened by adamchainz almost 8 years ago

#95 - Creating a branch to work with MapR-FS

Pull Request - State: closed - Opened by stevenmanton about 8 years ago - 4 comments

#94 - Check for libhdfs3 in ../lib

Pull Request - State: closed - Opened by mrocklin about 8 years ago - 8 comments

#93 - MapR compatibility

Issue - State: closed - Opened by stevenmanton about 8 years ago - 20 comments

#92 - Add documentation for HA mode

Issue - State: closed - Opened by martindurant about 8 years ago - 1 comment

#91 - Kerberos Support

Issue - State: closed - Opened by pkasinathan about 8 years ago - 7 comments

#90 - Do not set port if port is None, required for HA mode

Pull Request - State: closed - Opened by jettify about 8 years ago - 5 comments

#89 - PR: Make HDFile pickleable

Pull Request - State: closed - Opened by martindurant about 8 years ago - 4 comments

#88 - read_block should include terminator

Issue - State: closed - Opened by martindurant about 8 years ago - 3 comments

#87 - Incorrect Glob pattern behavior

Issue - State: open - Opened by geoffowens about 8 years ago - 1 comment

#83 - Test delegate tokens

Issue - State: closed - Opened by martindurant over 8 years ago - 1 comment
Labels: wontfix

GitHub / dask/hdfs3 issues and pull requests