lisad/phaser issues and pull requests

#100 - Refactor that moves process_exception to Context, and constants to a constants file

Pull Request - State: closed - Opened by lisad 10 months ago

#100 - Refactor that moves process_exception to Context, and constants to a constants file

Pull Request - State: closed - Opened by lisad 10 months ago

#99 - Reporting tracebacks

Pull Request - State: closed - Opened by lisad 10 months ago

#99 - Reporting tracebacks

Pull Request - State: closed - Opened by lisad 10 months ago

#98 - Adds a documentation section on running phaser, and fixes docs for cli

Pull Request - State: closed - Opened by lisad 10 months ago - 1 comment

#98 - Adds a documentation section on running phaser, and fixes docs for cli

Pull Request - State: closed - Opened by lisad 10 months ago - 1 comment

#97 - We should create run-id subdirectories inside the working directory

Issue - State: closed - Opened by lisad 10 months ago - 2 comments

#97 - We should create run-id subdirectories inside the working directory

Issue - State: closed - Opened by lisad 10 months ago - 2 comments

#96 - Dataframe step can pass row numbers and preserve, or not

Pull Request - State: closed - Opened by lisad 10 months ago

#96 - Dataframe step can pass row numbers and preserve, or not

Pull Request - State: closed - Opened by lisad 10 months ago

#95 - Adds row number continuation to batch step

Pull Request - State: closed - Opened by lisad 10 months ago - 1 comment

#95 - Adds row number continuation to batch step

Pull Request - State: closed - Opened by lisad 10 months ago - 1 comment

#94 - Row numbers stay consistent

Pull Request - State: closed - Opened by lisad 10 months ago

#94 - Row numbers stay consistent

Pull Request - State: closed - Opened by lisad 10 months ago

#93 - Add helper features for manipulating outputs and sources

Issue - State: closed - Opened by jeffkole 10 months ago - 8 comments
Labels: mvp

#93 - Add helper features for manipulating outputs and sources

Issue - State: closed - Opened by jeffkole 10 months ago - 8 comments
Labels: mvp

#92 - Pipes extra outputs to extra sources

Pull Request - State: closed - Opened by jeffkole 10 months ago

#92 - Pipes extra outputs to extra sources

Pull Request - State: closed - Opened by jeffkole 10 months ago

#91 - Makes ReshapePhase more like Phase - replaces DataFramePhase with dataframe_step

Pull Request - State: closed - Opened by lisad 11 months ago - 1 comment

#91 - Makes ReshapePhase more like Phase - replaces DataFramePhase with dataframe_step

Pull Request - State: closed - Opened by lisad 11 months ago - 1 comment

#90 - Testing batch step more: fixed how it works when the batch step forgets to declare context param

Pull Request - State: closed - Opened by lisad 11 months ago - 1 comment

#90 - Testing batch step more: fixed how it works when the batch step forgets to declare context param

Pull Request - State: closed - Opened by lisad 11 months ago - 1 comment

#89 - Log correct row number with header consistency check

Issue - State: open - Opened by jeffkole 11 months ago - 1 comment

#89 - Log correct row number with header consistency check

Issue - State: open - Opened by jeffkole 11 months ago - 1 comment

#88 - Add CLI support for additional sources

Issue - State: closed - Opened by jeffkole 11 months ago
Labels: mvp

#88 - Add CLI support for additional sources

Issue - State: closed - Opened by jeffkole 11 months ago
Labels: mvp

#87 - Capture traceback information for errors as they occur

Issue - State: closed - Opened by jeffkole 11 months ago
Labels: mvp

#87 - Capture traceback information for errors as they occur

Issue - State: closed - Opened by jeffkole 11 months ago
Labels: mvp

#86 - Fixes a bug caused by DataFrames

Pull Request - State: closed - Opened by jeffkole 11 months ago

#86 - Fixes a bug caused by DataFrames

Pull Request - State: closed - Opened by jeffkole 11 months ago

#85 - Adds more None and null and empty value handling and removes another pandas import

Pull Request - State: closed - Opened by lisad 11 months ago

#85 - Adds more None and null and empty value handling and removes another pandas import

Pull Request - State: closed - Opened by lisad 11 months ago

#84 - Adds more functionality and tests to the method that canonicalizes field names

Pull Request - State: closed - Opened by lisad 11 months ago

#84 - Adds more functionality and tests to the method that canonicalizes field names

Pull Request - State: closed - Opened by lisad 11 months ago

#83 - Adds a test where I had a comment to remember to do one

Pull Request - State: closed - Opened by lisad 11 months ago

#83 - Adds a test where I had a comment to remember to do one

Pull Request - State: closed - Opened by lisad 11 months ago

#82 - clevercsv puts "NULL" in columns that do not have values

Issue - State: closed - Opened by jeffkole 11 months ago

#82 - clevercsv puts "NULL" in columns that do not have values

Issue - State: closed - Opened by jeffkole 11 months ago

#81 - Adds saving CSV via clevercsv, fixes tests, adds test to make sure we don't save NaN

Pull Request - State: closed - Opened by lisad 11 months ago - 1 comment

#81 - Adds saving CSV via clevercsv, fixes tests, adds test to make sure we don't save NaN

Pull Request - State: closed - Opened by lisad 11 months ago - 1 comment

#80 - DataFramePhase must be subclassed ... seems annoying

Issue - State: closed - Opened by lisad 11 months ago
Labels: question

#80 - DataFramePhase must be subclassed ... seems annoying

Issue - State: closed - Opened by lisad 11 months ago
Labels: question

#79 - Add tests to confirm that unicode characters roundtrip from file to pipeline to phase back to file

Issue - State: closed - Opened by lisad 11 months ago - 1 comment
Labels: mvp

#79 - Add tests to confirm that unicode characters roundtrip from file to pipeline to phase back to file

Issue - State: closed - Opened by lisad 11 months ago - 1 comment
Labels: mvp

#78 - Use clevercsv

Pull Request - State: closed - Opened by lisad 11 months ago

#78 - Use clevercsv

Pull Request - State: closed - Opened by lisad 11 months ago

#77 - Move exceptions to their own file in preparation to avoid circular imports

Pull Request - State: closed - Opened by lisad 11 months ago

#77 - Move exceptions to their own file in preparation to avoid circular imports

Pull Request - State: closed - Opened by lisad 11 months ago

#76 - Adds management of extra inputs and outputs

Pull Request - State: closed - Opened by jeffkole 11 months ago - 3 comments

#76 - Adds management of extra inputs and outputs

Pull Request - State: closed - Opened by jeffkole 11 months ago - 3 comments

#75 - Should row numbers be consistent from beginning to end of phase or pipeline?

Issue - State: closed - Opened by lisad 11 months ago - 2 comments

#75 - Should row numbers be consistent from beginning to end of phase or pipeline?

Issue - State: closed - Opened by lisad 11 months ago - 2 comments

#74 - User should be able to gather all errors, warnings and dropped rows at end of pipeline

Issue - State: closed - Opened by lisad 11 months ago

#74 - User should be able to gather all errors, warnings and dropped rows at end of pipeline

Issue - State: closed - Opened by lisad 11 months ago

#73 - Decide whether adding errors and warnings transparently sends location info or the context uses it

Issue - State: closed - Opened by lisad 11 months ago - 1 comment
Labels: mvp

#73 - Decide whether adding errors and warnings transparently sends location info or the context uses it

Issue - State: closed - Opened by lisad 11 months ago - 1 comment
Labels: mvp

#72 - Moves error reporting to the Pipeline, which allows separation of issues by Phase

Pull Request - State: closed - Opened by lisad 11 months ago

#72 - Moves error reporting to the Pipeline, which allows separation of issues by Phase

Pull Request - State: closed - Opened by lisad 11 months ago

#71 - Numbers rows starting from 1 so they can be found easier in data files

Pull Request - State: closed - Opened by lisad 11 months ago

#71 - Numbers rows starting from 1 so they can be found easier in data files

Pull Request - State: closed - Opened by lisad 11 months ago

#70 - Rename exceptions and raise different ones now that we're clearer what they mean

Pull Request - State: closed - Opened by lisad 11 months ago

#70 - Rename exceptions and raise different ones now that we're clearer what they mean

Pull Request - State: closed - Opened by lisad 11 months ago

#69 - Prevents DropRowException from being thrown in batch steps, fix error hierarchy

Pull Request - State: closed - Opened by lisad 11 months ago - 1 comment

#69 - Prevents DropRowException from being thrown in batch steps, fix error hierarchy

Pull Request - State: closed - Opened by lisad 11 months ago - 1 comment

#68 - Finish end to end test (for now)

Pull Request - State: closed - Opened by lisad 11 months ago

#68 - Finish end to end test (for now)

Pull Request - State: closed - Opened by lisad 11 months ago

#67 - Index rows starting at 1

Issue - State: closed - Opened by lisad 11 months ago - 3 comments
Labels: mvp

#67 - Index rows starting at 1

Issue - State: closed - Opened by lisad 11 months ago - 3 comments
Labels: mvp

#66 - Pipeline should report on what files it all created

Issue - State: closed - Opened by lisad 11 months ago - 1 comment

#66 - Pipeline should report on what files it all created

Issue - State: closed - Opened by lisad 11 months ago - 1 comment

#65 - Write our own CSV importer/exporter for phaser

Issue - State: closed - Opened by lisad 11 months ago
Labels: mvp

#65 - Write our own CSV importer/exporter for phaser

Issue - State: closed - Opened by lisad 11 months ago
Labels: mvp

#64 - Errors and warnings generated by phases, and placed in the context, need to be separated by phase

Issue - State: closed - Opened by lisad 11 months ago - 1 comment
Labels: mvp

#64 - Errors and warnings generated by phases, and placed in the context, need to be separated by phase

Issue - State: closed - Opened by lisad 11 months ago - 1 comment
Labels: mvp

#63 - Fix phase instantiation in a pipeline

Issue - State: closed - Opened by jeffkole 11 months ago - 1 comment
Labels: mvp

#63 - Fix phase instantiation in a pipeline

Issue - State: closed - Opened by jeffkole 11 months ago - 1 comment
Labels: mvp

#62 - Phases can take multiple inputs as tables, and these are available in context.extra_inputs

Issue - State: closed - Opened by lisad 11 months ago - 2 comments
Labels: mvp

#62 - Phases can take multiple inputs as tables, and these are available in context.extra_inputs

Issue - State: closed - Opened by lisad 11 months ago - 2 comments
Labels: mvp

#61 - Finish the end-to-end test

Issue - State: closed - Opened by lisad 11 months ago
Labels: mvp

#61 - Finish the end-to-end test

Issue - State: closed - Opened by lisad 11 months ago
Labels: mvp

#60 - Pipeline should be able to pipe outputs to inputs within its ordered Phase list

Issue - State: closed - Opened by lisad 11 months ago - 1 comment
Labels: mvp

#60 - Pipeline should be able to pipe outputs to inputs within its ordered Phase list

Issue - State: closed - Opened by lisad 11 months ago - 1 comment
Labels: mvp

#59 - Move I/O to Pipeline, and introduce Context steps and saving extra outputs

Pull Request - State: closed - Opened by lisad 11 months ago

#59 - Move I/O to Pipeline, and introduce Context steps and saving extra outputs

Pull Request - State: closed - Opened by lisad 11 months ago

#58 - Pipeline should do all I/O, and handle that work for phase

Issue - State: closed - Opened by lisad 12 months ago

#58 - Pipeline should do all I/O, and handle that work for phase

Issue - State: closed - Opened by lisad 12 months ago

#57 - Make Phase runnable outside a pipeline, eg. and still save context extra outputs

Issue - State: closed - Opened by lisad 12 months ago - 3 comments

#57 - Make Phase runnable outside a pipeline, eg. and still save context extra outputs

Issue - State: closed - Opened by lisad 12 months ago - 3 comments

#56 - Fix employee demo

Pull Request - State: closed - Opened by lisad 12 months ago - 2 comments

#56 - Fix employee demo

Pull Request - State: closed - Opened by lisad 12 months ago - 2 comments

#55 - Pipeline handling PipelineErrorException needs to say which phase it occurred in

Issue - State: closed - Opened by lisad 12 months ago
Labels: mvp

#55 - Pipeline handling PipelineErrorException needs to say which phase it occurred in

Issue - State: closed - Opened by lisad 12 months ago
Labels: mvp

#54 - Loading data should really strip spaces and handle quotes properly.

Issue - State: closed - Opened by lisad 12 months ago - 2 comments
Labels: mvp

#54 - Loading data should really strip spaces and handle quotes properly.

Issue - State: closed - Opened by lisad 12 months ago - 2 comments
Labels: mvp

#53 - Adds context_step - this can initiate or format data in context

Pull Request - State: closed - Opened by lisad 12 months ago

#53 - Adds context_step - this can initiate or format data in context

Pull Request - State: closed - Opened by lisad 12 months ago

#52 - Make sure batch_step can't raise DropRowException

Issue - State: closed - Opened by lisad 12 months ago - 1 comment

#52 - Make sure batch_step can't raise DropRowException

Issue - State: closed - Opened by lisad 12 months ago - 1 comment

#51 - Updates readme a little and adds pyproject.toml which was needed for creating a real library

Pull Request - State: closed - Opened by lisad 12 months ago

#51 - Updates readme a little and adds pyproject.toml which was needed for creating a real library

Pull Request - State: closed - Opened by lisad 12 months ago

GitHub / lisad/phaser issues and pull requests