springml/spark-sftp issues and pull requests

#93 - support spark3.x and add gradle build script

Pull Request - State: closed - Opened by vivostar over 1 year ago

#92 - support for dbfs and scala 2.12, also version updated

Pull Request - State: open - Opened by MdAfroz almost 2 years ago

#91 - EMR deployment error

Issue - State: open - Opened by snelluri1277 about 2 years ago - 1 comment

#90 - Kerberos username [XXX]: Kerberos password for [XXX]: waiting for enter twice, otherwise spark will be waiting util timeout then failed.

Issue - State: closed - Opened by vvsvv over 2 years ago - 1 comment

#89 - Error in writing a csv to sftp path using spark "Exception in thread "main" 2: No such file"

Issue - State: open - Opened by alaukikharsh over 2 years ago

#88 - spark sftp connector for structured stream

Issue - State: open - Opened by ArmanShakeri almost 3 years ago

#87 - NoSuchMethodError while sending file to ftp location

Issue - State: open - Opened by mrugankatdure almost 3 years ago

#86 - CSV files have double quotes in case of empty field values. How to avoid that?

Issue - State: open - Opened by sukanya-pai over 3 years ago - 3 comments

#85 - updated the project to work with spark3.1.1 and scala 2.12

Pull Request - State: open - Opened by kumgaurav over 3 years ago - 6 comments

#84 - Add Capability to Configure the File Encoding for CSV Files

Pull Request - State: open - Opened by raffael-dzikowski over 3 years ago

#83 - Support for Spark 3

Issue - State: open - Opened by adityashekhar146 over 3 years ago - 6 comments

#82 - Support for Scala 2.12

Issue - State: open - Opened by lverzosa over 3 years ago

#81 - Adding support for Scala 2.12 and Updating to Spark 2.4.3

Pull Request - State: open - Opened by lverzosa over 3 years ago - 3 comments

#80 - New parameter added: 'quoteAll'

Pull Request - State: open - Opened by bang almost 4 years ago - 1 comment

#79 - pem key is throwing error

Issue - State: open - Opened by ucrkarthik almost 4 years ago

#78 - Null(Blank) columns are returned with quotes(" ") when writing to csv

Issue - State: open - Opened by ucrkarthik about 4 years ago - 2 comments

#77 - An error occurred while calling o92.save.

Issue - State: open - Opened by ucrkarthik about 4 years ago - 1 comment

#76 - No such file error

Issue - State: open - Opened by giobaro over 4 years ago - 1 comment

#75 - Algorithm negotiation fail saving csv to SFTP from Azure Databricks

Issue - State: open - Opened by AndyAldersley over 4 years ago - 6 comments

#74 - Minor tweaks to the README.md

Pull Request - State: open - Opened by raffael-dzikowski over 4 years ago

#73 - com.jcraft.jsch.JSchException: java.io.IOException: Pipe closed

Issue - State: open - Opened by lonly197 almost 5 years ago

#72 - fix springml#58 Remove the hard dependency to HDFS

Pull Request - State: open - Opened by PierreAlexMaury almost 5 years ago

#71 - fix #43 for some reason we need to set different folders for temp and…

Pull Request - State: open - Opened by dircsem almost 5 years ago

#70 - using spark sftp with databricks

Issue - State: open - Opened by jch231 almost 5 years ago - 1 comment

#69 - Spark sftp getting auth error

Issue - State: open - Opened by yogeshlokhande24 about 5 years ago - 1 comment

#68 - Fixes #21

Pull Request - State: open - Opened by shaikmanu797 about 5 years ago - 3 comments

#67 - Write operations use the part file name instead of the file name in save call

Issue - State: open - Opened by rcornell about 5 years ago

#66 - Clash with XML library

Issue - State: open - Opened by allen-healthdirect about 5 years ago

#65 - NullPointerException when reading file from sftp

Issue - State: open - Opened by sslavian812 over 5 years ago - 9 comments

#64 - Is it possible to add DataFrame`s data to existing csv file?

Issue - State: open - Opened by nurzhannogerbek over 5 years ago - 2 comments

#63 - Feat/spark2.4

Pull Request - State: closed - Opened by dis-sid over 5 years ago

#62 - filter out additional files from temp file location for Databricks

Pull Request - State: closed - Opened by sshah90 over 5 years ago

#61 - connection is closed

Issue - State: closed - Opened by MihnPorus over 5 years ago - 1 comment

#60 - Connection refused: connect

Issue - State: closed - Opened by MihnPorus over 5 years ago - 1 comment

#59 - Null Pointer Exception When Writing csv to FTP in Databricks

Issue - State: closed - Opened by Rs111 over 5 years ago - 26 comments

#58 - Add support for WASB(s) (Azure Blobs) scheme.

Issue - State: open - Opened by nperumal over 5 years ago - 1 comment

#57 - Why is df.coalesce(1) necessary?

Issue - State: open - Opened by sunayansaikia over 5 years ago - 6 comments

#56 - Deploy new version

Issue - State: closed - Opened by mi7flat5 over 5 years ago - 1 comment

#55 - Support for Spark 2.3.0 quote, escape and multiLine for CSV

Pull Request - State: closed - Opened by alapinsk over 5 years ago - 2 comments

#54 - Is there a way to rename a SFTP file?

Issue - State: closed - Opened by fusionet24 over 5 years ago - 1 comment

#53 - Loading files using wildcard fail

Issue - State: closed - Opened by SamambaMan over 5 years ago - 1 comment

#52 - Getting Path Does Not Exist when loading file from sftp

Issue - State: open - Opened by bennyblum over 5 years ago - 7 comments

#51 - Merge and version upgrade

Issue - State: closed - Opened by mi7flat5 over 5 years ago - 1 comment

#50 - Completing orc support

Pull Request - State: closed - Opened by mi7flat5 over 5 years ago

#49 - Parquet format doesn't work in hdfs.

Pull Request - State: closed - Opened by mi7flat5 over 5 years ago

#48 - Parquet source format doesn't work in cluster environment.

Issue - State: closed - Opened by mi7flat5 over 5 years ago - 1 comment

#47 - File download Problem in spark executor in cluster mode

Issue - State: open - Opened by rabi112 over 5 years ago - 2 comments

#46 - Exception in thread "main" java.lang.NoSuchMethodError: com.springml.sftp.client.SFTPClient

Issue - State: closed - Opened by nurzhannogerbek over 5 years ago - 4 comments

#45 - Incorrect file lookup | Actual file written in worker node and during transmit it is checking on driver node.

Issue - State: open - Opened by lkolla over 5 years ago - 1 comment

#44 - Algorithm negotiation fail

Issue - State: open - Opened by gao13993335271 almost 6 years ago

#43 - Error when using in Azure DataBricks

Issue - State: open - Opened by brynnborton almost 6 years ago - 7 comments

#42 - How to specify the encoding of the source file

Issue - State: closed - Opened by wsy858 almost 6 years ago - 2 comments

#41 - ArrayIndexOutOfBoundsException

Issue - State: open - Opened by pawelantczak almost 6 years ago - 3 comments

#40 - SFTP Passwords are not protected as it is passed in options

Issue - State: open - Opened by bagopalan almost 6 years ago - 1 comment

#39 - Please release XML file and TXT support merges

Issue - State: closed - Opened by bagopalan about 6 years ago - 4 comments

#38 - Write to SFTP only writing crc file

Issue - State: open - Opened by JeffSchott about 6 years ago

#37 - Add support for read/write xml files #36

Pull Request - State: closed - Opened by bagopalan about 6 years ago - 1 comment

#36 - Add support for read/write xml files

Issue - State: closed - Opened by bagopalan about 6 years ago

#35 - Scala SFTP

Issue - State: open - Opened by mail2kitty about 6 years ago - 2 comments

#34 - Downloading Multiple Files into the dataframe

Issue - State: closed - Opened by viveknair89 about 6 years ago - 2 comments

#33 - Add support to text files for read/write #32

Pull Request - State: closed - Opened by bagopalan about 6 years ago - 3 comments

#32 - Add support to text files for read/write

Issue - State: closed - Opened by bagopalan about 6 years ago

#31 - Add high level flow diagram on the read, write API

Issue - State: open - Opened by bagopalan about 6 years ago

#30 - Support of FTP without secure layer

Issue - State: closed - Opened by mycaule about 6 years ago - 4 comments

#29 - File download problem

Issue - State: closed - Opened by luozhao528 about 6 years ago - 1 comment

#28 - Issue fetching file from mainframe sftp

Issue - State: closed - Opened by mshaikiqvia about 6 years ago - 1 comment

#27 - Does anyone maintain this repo at all ?

Issue - State: closed - Opened by kevintrannz about 6 years ago - 1 comment

#26 - java.lang.ClassNotFoundException: com.springml.spark.sftp.DefaultSource

Issue - State: open - Opened by kevintrannz about 6 years ago - 5 comments

#25 - NIT - Build instructions is incorrect

Issue - State: closed - Opened by Dee-Pac over 6 years ago - 1 comment

#24 - Downloading to Tmp in local directory and reading from hdfs

Issue - State: open - Opened by prachiDev over 6 years ago - 4 comments

#23 - incorrect directories

Issue - State: closed - Opened by francopatanojll over 6 years ago - 2 comments

#22 - excel file support ?

Issue - State: closed - Opened by kali786516 over 6 years ago - 1 comment

#21 - Write large dataframes to a directory

Issue - State: open - Opened by ssimeonov over 6 years ago - 2 comments

#20 - (Optional) Compression codec to use when saving to file. Applicable o…

Pull Request - State: closed - Opened by juanvisoler over 6 years ago

#19 - Exception in thread "main" com.jcraft.jsch.JSchException: Auth fail

Issue - State: closed - Opened by sathiyarajanm over 6 years ago - 1 comment

#18 - CRC file uploaded to FTP instead of CSV

Issue - State: closed - Opened by aarafeh2017 over 6 years ago - 4 comments

#17 - Use an UUID instead of Random.nextInt(1000) when creating a temporary filename

Pull Request - State: closed - Opened by utdemir almost 7 years ago - 5 comments

#16 - Is python API available?

Issue - State: closed - Opened by rbheemana about 7 years ago - 1 comment

#15 - ZIP

Issue - State: open - Opened by MielHostens about 7 years ago - 4 comments

#14 - delimiter can't applied

Issue - State: closed - Opened by LEEHYUNGKYU about 7 years ago - 2 comments

#13 - temp location hdfs

Issue - State: closed - Opened by mittalakhilesh about 7 years ago - 2 comments

#12 - write csv with custom delimiter added

Pull Request - State: closed - Opened by gumaz about 7 years ago - 2 comments

#11 - Can not create a Path from an empty string

Issue - State: closed - Opened by rbheemana about 7 years ago - 10 comments

#10 - Fix for specifying customSchema while creating dataframe

Pull Request - State: closed - Opened by vaibhavpals over 7 years ago - 1 comment

#9 - DataFrame created has incorrect schema

Issue - State: closed - Opened by vaibhavpals over 7 years ago - 5 comments

#8 - How do I provide the key passphrase for the pem key?

Issue - State: closed - Opened by jwatte over 7 years ago - 3 comments
Labels: enhancement

GitHub / springml/spark-sftp issues and pull requests