TresAmigosSD/SMV issues and pull requests

#1622 - I1621 spark244

Pull Request - State: closed - Opened by ninjapapa over 4 years ago

#1621 - Support Spark 2.4.*

Issue - State: closed - Opened by ninjapapa over 4 years ago - 1 comment

#1620 - The class FooHiveTableWithQuery is not working as expected

Issue - State: open - Opened by BlacShadou almost 5 years ago

#1619 - SmvMultiCSVInputFiles lacks parallelization

Issue - State: open - Opened by CharlesNaylor about 5 years ago - 2 comments

#1618 - I1617 16sup cdh5.15 err

Pull Request - State: closed - Opened by ninjapapa over 5 years ago

#1617 - [1.6sup] error on cdh5.15.2

Issue - State: closed - Opened by ninjapapa over 5 years ago - 6 comments

#1616 - #1615 support master setting in conf file

Pull Request - State: closed - Opened by cloudysail over 5 years ago

#1615 - support master setting in conf file

Issue - State: closed - Opened by cloudysail over 5 years ago

#1614 - port to Scala 2.12

Issue - State: open - Opened by AliTajeldin over 5 years ago

#1613 - Enhance partial time and panel usability

Issue - State: open - Opened by ninjapapa over 5 years ago

#1612 - #1611 support file based runtimeConfig and kernelConf

Pull Request - State: closed - Opened by cloudysail over 5 years ago

#1611 - support file based runtime config and kernel config

Issue - State: closed - Opened by cloudysail over 5 years ago

#1610 - #1609 parquet persist to default to overwrite

Pull Request - State: closed - Opened by ninjapapa over 5 years ago

#1609 - Delete leftover parquet files when killed in the middle

Issue - State: closed - Opened by ninjapapa over 5 years ago

#1608 - call sc.addPyFile on all user libs incase they have udfs defined.

Issue - State: open - Opened by AliTajeldin over 5 years ago

#1607 - call sc.addPyFile on all user libs incase they have udfs defined.

Issue - State: closed - Opened by AliTajeldin over 5 years ago - 1 comment
Labels: duplicate

#1606 - #1605 added needToRun flag to callback

Pull Request - State: closed - Opened by ninjapapa over 5 years ago

#1605 - Enhance run monitor callback message

Issue - State: closed - Opened by ninjapapa over 5 years ago

#1604 - #1603 error handling when loading user lib

Pull Request - State: closed - Opened by cloudysail over 5 years ago

#1603 - error handling when loading user lib as providers

Issue - State: closed - Opened by cloudysail over 5 years ago

#1602 - #1601 added callback

Pull Request - State: closed - Opened by ninjapapa over 5 years ago

#1601 - Add callback hook to module runner

Issue - State: closed - Opened by ninjapapa over 5 years ago

#1600 - Make a new release

Issue - State: closed - Opened by ninjapapa almost 6 years ago - 1 comment

#1599 - I1585 semicolon as delimiter

Pull Request - State: closed - Opened by fei-cheng almost 6 years ago - 1 comment

#1598 - #1597 used _table_with_schema

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1597 - SmvHiveIoStrategy doesn't use schema

Issue - State: closed - Opened by ninjapapa almost 6 years ago
Labels: bug, high_p

#1596 - Start and shut down spark session programmatically

Issue - State: open - Opened by ninjapapa almost 6 years ago - 1 comment

#1595 - #1594 improve writemode

Pull Request - State: closed - Opened by cloudysail almost 6 years ago

#1594 - improve the writeMode of hiveOuput

Issue - State: closed - Opened by cloudysail almost 6 years ago

#1593 - #1592 made df quick run, also added quickRun, fullRun command

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1592 - df in shell should use quick run

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1591 - #1590 Fix write of SmvHiveIoStrategy

Pull Request - State: closed - Opened by cloudysail almost 6 years ago - 1 comment

#1590 - Fix write of SmvHiveIoStrategy

Issue - State: closed - Opened by cloudysail almost 6 years ago

#1589 - #1586 improve getSchemaByDataFileAsSmvSchema

Pull Request - State: closed - Opened by cloudysail almost 6 years ago

#1588 - #1587 fixed test

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago - 1 comment

#1587 - Fix test

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1586 - support path for getSchemaByDataFileAsSmvSchema

Issue - State: closed - Opened by cloudysail almost 6 years ago - 2 comments

#1585 - Delimiter ";" does not work

Issue - State: closed - Opened by fei-cheng almost 6 years ago - 5 comments

#1584 - temporarily disable two remaining Semaphore CI tests

Issue - State: closed - Opened by AliTajeldin almost 6 years ago - 1 comment
Labels: internal

#1583 - I1571 smv schema

Pull Request - State: closed - Opened by AliTajeldin almost 6 years ago

#1582 - I1579 conn conf

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1581 - I1576 content list

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1580 - I1578 build ci

Pull Request - State: closed - Opened by AliTajeldin almost 6 years ago

#1579 - Support config files in a folder

Issue - State: closed - Opened by ninjapapa almost 6 years ago - 2 comments

#1578 - add make target to build on semaphore CI

Issue - State: closed - Opened by AliTajeldin almost 6 years ago
Labels: internal

#1577 - #1572: initial ci-latest-mgr script

Pull Request - State: closed - Opened by AliTajeldin almost 6 years ago - 1 comment

#1576 - Need a get_content_list method for connections

Issue - State: closed - Opened by ninjapapa almost 6 years ago - 8 comments

#1575 - ☔️ Use SemaphoreCI to build/test SMV

Issue - State: closed - Opened by AliTajeldin almost 6 years ago - 1 comment
Labels: umbrella, internal

#1574 - I1573 assure type

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1573 - Need call _assure_output_type method on run method result

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1572 - create `admin/ci-latest.sh` script to upload/download latest ci build result

Issue - State: closed - Opened by AliTajeldin almost 6 years ago
Labels: internal

#1571 - create SmvSchema python class

Issue - State: closed - Opened by AliTajeldin almost 6 years ago

#1570 - #1569 set smv lock to true for blank project init

Pull Request - State: closed - Opened by cloudysail almost 6 years ago - 1 comment

#1569 - set smv.lock to true for blank project init

Issue - State: closed - Opened by cloudysail almost 6 years ago

#1568 - I1567 get conn to app

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1567 - _get_connection_by_name should be an SmvApp method

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1566 - I1565 connectionType method

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1565 - SmvIoModule should have a connectionType abstract method

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1564 - #1563 made get_providers_by_prefix returns a dict

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1563 - get_providers_by_prefix should return a dict instead of a list

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1562 - #1561 made dicover provider find abs

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1561 - Provider discovery will not pickup module mix-in with provider

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1560 - #1559 made provider cache update when switching appdir

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago - 2 comments

#1559 - provider_cache need to refresh when switched appdir

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1558 - Base provider need to be abstract

Issue - State: closed - Opened by ninjapapa almost 6 years ago - 1 comment

#1557 - #1556 fixed test bug on python 3

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1556 - itest failed on python 3 in PR #1555

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1555 - I1554 semi libs

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1554 - Provider discovery need to discover from semiprivate also

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1553 - I1551 output always run - simpler version

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago - 2 comments

#1552 - I1551 output always run

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago - 1 comment

#1551 - Should output module always run?

Issue - State: closed - Opened by ninjapapa almost 6 years ago - 3 comments

#1550 - I1549 csvoutput overwrite

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1549 - SmvCsvOutputFile need to use writeMode

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1548 - #1546: remove install of r-base

Pull Request - State: closed - Opened by AliTajeldin almost 6 years ago - 2 comments

#1547 - need to handle `^M` in string fields when persisting data to csv files.

Issue - State: closed - Opened by AliTajeldin almost 6 years ago - 1 comment

#1546 - smv release script fails on `apt-key`

Issue - State: closed - Opened by AliTajeldin almost 6 years ago - 1 comment

#1545 - #1544 add_user_option_during_pip_install

Pull Request - State: closed - Opened by cloudysail almost 6 years ago

#1544 - add `--user` option during pip install for publish_to_pypi

Issue - State: closed - Opened by cloudysail almost 6 years ago

#1543 - I1541 default meta strategy

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1542 - Deprecate command line publish

Issue - State: open - Opened by ninjapapa almost 6 years ago - 1 comment

#1541 - metaStrategy should defined in SmvGenericModule

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1540 - Revert " #1442 underscored versioned_fqn"

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1539 - versioned_fqn should be public

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1538 - I1502 iomod doc

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1537 - I1442 private step1 smvgm

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1536 - I1535 conn prov

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1535 - Use provider for connections

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1534 - #1498: added get_providers_by_prefix method

Pull Request - State: closed - Opened by AliTajeldin almost 6 years ago - 4 comments

#1533 - #1521 removed needToRun

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1532 - #1531 renamed smvSchema

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago - 1 comment

#1531 - Rename _smv_schema back to smvSchema

Issue - State: closed - Opened by ninjapapa almost 6 years ago

#1528 - #1521 made get_module_state_json takes a list

Pull Request - State: closed - Opened by ninjapapa almost 6 years ago

#1521 - Drop needsToRun from get_graph_json method in smvapp

Issue - State: closed - Opened by ninjapapa almost 6 years ago - 1 comment

#1502 - User doc for the new iomod interface

Issue - State: closed - Opened by ninjapapa about 6 years ago

#1498 - provide something similar to Java Service Provider API in SMV

Issue - State: closed - Opened by AliTajeldin about 6 years ago - 14 comments

#1484 - Create design doc for generic input and output modules

Issue - State: closed - Opened by ninjapapa about 6 years ago - 6 comments

#1442 - Prefix with underscore for "private" module and methods

Issue - State: open - Opened by ninjapapa about 6 years ago

#1413 - Synchronize release name across repo

Issue - State: open - Opened by laneb about 6 years ago - 4 comments

#1408 - Support multi line for CSV

Issue - State: open - Opened by yw-yang about 6 years ago - 3 comments

GitHub / TresAmigosSD/SMV issues and pull requests