sadikovi/spark-netflow issues and pull requests

#82 - Could you help upgrade the vulnerble dependency in spark-netflow?

Issue - State: open - Opened by HelenParr over 2 years ago - 1 comment

#81 - sbt build issue: org.spark-packages#sbt-spark-package;0.2.6: not found

Issue - State: closed - Opened by czivar over 3 years ago - 2 comments

#80 - Update code to support Spark 3 and Scala 2.12

Pull Request - State: closed - Opened by sadikovi almost 4 years ago

#79 - Spark 3.0 support

Issue - State: closed - Opened by alexott almost 4 years ago - 2 comments

#78 - Test files for version 9

Issue - State: open - Opened by sadikovi almost 7 years ago - 8 comments

#77 - Add version 9 support

Issue - State: open - Opened by raulot-a almost 7 years ago - 14 comments

#76 - Async IO

Pull Request - State: closed - Opened by sadikovi about 7 years ago - 1 comment

#75 - Count with zero columns

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#74 - Fix file system inference when reading file

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#73 - Fail to infer path, wrong FS

Issue - State: closed - Opened by sadikovi over 7 years ago
Labels: bug

#72 - Remove netty ByteBuf dependency, refactor IO

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#71 - Return iterator of InternalRow directly from library

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#70 - Report file for exceptions (1x port)

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#69 - Fix typos in Operators.java

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#68 - Report file for exceptions

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#67 - Report corrupt file when reading fails, and spark.files.ignoreCorruptFiles=false

Issue - State: closed - Opened by sadikovi over 7 years ago
Labels: bug

#66 - Fix minor typos in Operators.java

Issue - State: closed - Opened by sadikovi over 7 years ago
Labels: bug

#65 - Remove secondary array

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#64 - Update convert function

Pull Request - State: closed - Opened by sadikovi over 7 years ago - 1 comment

#63 - Add error message when failed to infer version

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 1 comment

#62 - Exception when inferring version from corrupt files with ignoreCorruptFiles=true

Issue - State: closed - Opened by sadikovi almost 8 years ago - 1 comment
Labels: bug

#61 - Spark 2.x support

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#60 - Refactor RDD compute method

Issue - State: closed - Opened by sadikovi almost 8 years ago

#59 - Ignore corrupt files 2

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#59 - Ignore corrupt files 2

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#58 - Option to ignore corrupt files

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#58 - Option to ignore corrupt files

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#57 - Close iterator on task completion

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 1 comment

#57 - Close iterator on task completion

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 1 comment

#56 - Add support for Spark 2.x

Issue - State: closed - Opened by sadikovi almost 8 years ago - 4 comments

#56 - Add support for Spark 2.x

Issue - State: closed - Opened by sadikovi almost 8 years ago - 4 comments

#55 - Consider adding aggregation similar to flow-tools

Issue - State: open - Opened by sadikovi almost 8 years ago - 9 comments

#54 - Remove log configurator

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#54 - Remove log configurator

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#53 - Add constructor with default buffer size

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#53 - Add constructor with default buffer size

Pull Request - State: closed - Opened by sadikovi almost 8 years ago - 2 comments

#52 - Introduce more rules on predicate resolution

Issue - State: open - Opened by sadikovi almost 8 years ago - 1 comment

#51 - Remove log configurator

Issue - State: closed - Opened by sadikovi almost 8 years ago

#51 - Remove log configurator

Issue - State: closed - Opened by sadikovi almost 8 years ago

#50 - Initialize reader with default buffer size

Issue - State: closed - Opened by sadikovi almost 8 years ago

#49 - Use nio direct buffer input stream for local fs

Pull Request - State: closed - Opened by sadikovi about 8 years ago - 3 comments

#48 - Add closeable iterator

Pull Request - State: closed - Opened by sadikovi about 8 years ago - 5 comments

#48 - Add closeable iterator

Pull Request - State: closed - Opened by sadikovi about 8 years ago - 5 comments

#47 - Return Iterator of InternalRow instead of Row

Issue - State: closed - Opened by sadikovi about 8 years ago

#46 - Add version resolution based on files provided

Pull Request - State: closed - Opened by sadikovi about 8 years ago - 2 comments

#45 - Use interruptible iterator to close stream

Issue - State: closed - Opened by sadikovi about 8 years ago

#45 - Use interruptible iterator to close stream

Issue - State: closed - Opened by sadikovi about 8 years ago

#44 - Redesign file statistics

Issue - State: closed - Opened by sadikovi about 8 years ago - 3 comments

#43 - Profile with Flame Graphs

Issue - State: closed - Opened by sadikovi about 8 years ago - 2 comments

#42 - Update buffered input stream on direct nio buffers

Issue - State: closed - Opened by sadikovi about 8 years ago

#41 - Release 1.0.1

Issue - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: minor

#40 - Use buffered input stream

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: enhancement

#39 - Update column metrics

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: enhancement, minor

#38 - Investigate batch processing

Issue - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: enhancement

#38 - Investigate batch processing

Issue - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: enhancement

#37 - Add notes on using library separately

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: minor

#36 - Improve test coverage

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: test, minor

#35 - [WIP] Whole stage codegen (attempt 2)

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: enhancement, test

#34 - Replace klass with clazz

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: minor

#34 - Replace klass with clazz

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: minor

#33 - Add netflowlib usage in README

Issue - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: minor

#33 - Add netflowlib usage in README

Issue - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: minor

#32 - Improve netflowlib test coverage

Issue - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: test

#32 - Improve netflowlib test coverage

Issue - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: test

#31 - Refactor benchmarks

Issue - State: closed - Opened by sadikovi over 8 years ago
Labels: minor

#31 - Refactor benchmarks

Issue - State: closed - Opened by sadikovi over 8 years ago
Labels: minor

#30 - Add statistics to NetFlow

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 3 comments
Labels: enhancement

#29 - Add statistics to the NetFlow file

Issue - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: enhancement

#28 - Improve performance of NetFlow library

Issue - State: closed - Opened by sadikovi over 8 years ago - 3 comments
Labels: enhancement

#27 - ReadAheadInputStream byte overflow

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 1 comment
Labels: bug

#26 - Fails when aggregating records

Issue - State: closed - Opened by sadikovi over 8 years ago - 3 comments
Labels: bug

#25 - Default buffer size update

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: minor

#25 - Default buffer size update

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: minor

#24 - Update default buffer size

Issue - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: minor

#24 - Update default buffer size

Issue - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: minor

#23 - Code generation for conversion functions

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 12 comments
Labels: enhancement, test

#23 - Code generation for conversion functions

Pull Request - State: closed - Opened by sadikovi over 8 years ago - 12 comments
Labels: enhancement, test

#22 - Codegen for conversion functions

Issue - State: closed - Opened by sadikovi over 8 years ago - 3 comments
Labels: enhancement, wontfix

#21 - Like with wildcard not supported

Issue - State: closed - Opened by xwan010 over 8 years ago - 3 comments
Labels: bug, test

#20 - Reader failure

Issue - State: closed - Opened by sadikovi over 8 years ago - 1 comment

#19 - Explore smart partitioning

Issue - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: enhancement, question

#19 - Explore smart partitioning

Issue - State: closed - Opened by sadikovi over 8 years ago - 2 comments
Labels: enhancement, question

#18 - Update path to the benchmark

Issue - State: closed - Opened by sadikovi over 8 years ago
Labels: minor

#18 - Update path to the benchmark

Issue - State: closed - Opened by sadikovi over 8 years ago
Labels: minor

#18 - Update path to the benchmark

Issue - State: closed - Opened by sadikovi over 8 years ago
Labels: minor

#17 - Benchmark tests

Issue - State: closed - Opened by sadikovi over 8 years ago
Labels: enhancement, test

#17 - Benchmark tests

Issue - State: closed - Opened by sadikovi over 8 years ago
Labels: enhancement, test

#17 - Benchmark tests

Issue - State: closed - Opened by sadikovi over 8 years ago
Labels: enhancement, test

#16 - Add logging in netflowlib

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: minor

#16 - Add logging in netflowlib

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: minor

#16 - Add logging in netflowlib

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: minor

#15 - Fallback to default buffer size

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: bug, test, minor

#15 - Fallback to default buffer size

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: bug, test, minor

#15 - Fallback to default buffer size

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: bug, test, minor

#14 - Predicate pushdown in library

Issue - State: closed - Opened by sadikovi almost 9 years ago - 1 comment
Labels: enhancement, test

#14 - Predicate pushdown in library

Issue - State: closed - Opened by sadikovi almost 9 years ago - 1 comment
Labels: enhancement, test

#13 - Migrate to using InternalRow

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: enhancement, wontfix

#13 - Migrate to using InternalRow

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: enhancement, wontfix

#12 - Replace toString() for NetflowRelation

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: bug, minor

#12 - Replace toString() for NetflowRelation

Issue - State: closed - Opened by sadikovi almost 9 years ago
Labels: bug, minor

GitHub / sadikovi/spark-netflow issues and pull requests