Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / 2DegreesInvesting/tiltDataPipelines issues and pull requests

#118 - Clean spark session file

Pull Request - State: closed - Opened by SKruthoff about 1 year ago

#117 - Changes to data quality checks for output tables

Pull Request - State: open - Opened by lavanzini about 1 year ago

#117 - Changes to data quality checks for output tables

Pull Request - State: open - Opened by lavanzini about 1 year ago

#116 - Custom dataframe classes

Pull Request - State: closed - Opened by SKruthoff about 1 year ago

#114 - onboard tiltProfiles

Pull Request - State: open - Opened by SKruthoff about 1 year ago

#113 - Missing codes from three PRs

Pull Request - State: closed - Opened by ysherstyuk about 1 year ago

#112 - Generating toydata for tiltIndicator

Issue - State: open - Opened by ysherstyuk about 1 year ago - 3 comments

#110 - 98 update dataflow and storage with latest ecoinvent data

Pull Request - State: closed - Opened by ysherstyuk about 1 year ago

#109 - 107 update all input data for tiltindicator and tiltindicatorafter

Pull Request - State: closed - Opened by ysherstyuk about 1 year ago

#108 - fix table ownership and creation of monitoring tables

Pull Request - State: closed - Opened by SKruthoff about 1 year ago

#106 - Onboarding results from matching to input of tIB

Pull Request - State: closed - Opened by ysherstyuk about 1 year ago

#105 - Onboarding two additional tables as input for tIB

Pull Request - State: closed - Opened by ysherstyuk about 1 year ago

#104 - Check permissions to write table to storage

Issue - State: open - Opened by ysherstyuk about 1 year ago

#103 - Implementing DQ checks on matching output

Issue - State: closed - Opened by ysherstyuk about 1 year ago - 1 comment

#102 - Issue with signalling_id in monitoring_values table

Issue - State: open - Opened by ysherstyuk about 1 year ago

#100 - Run indicatorBefore package on sample data

Issue - State: open - Opened by bobresink about 1 year ago

#98 - Update dataflow and storage with latest matching data

Issue - State: closed - Opened by ysherstyuk over 1 year ago

#97 - Check if dashboard shows all necessary output DQ checks

Issue - State: open - Opened by bobresink over 1 year ago

#96 - 86 adapt dq checks to new output table

Pull Request - State: closed - Opened by SKruthoff over 1 year ago

#94 - Map table names from the packages to the data flow structure

Issue - State: closed - Opened by ysherstyuk over 1 year ago - 1 comment

#93 - Implementing data model to be (ecoinvent data)

Issue - State: open - Opened by ysherstyuk over 1 year ago - 2 comments

#90 - fix the non owner issue on deleteing tables

Pull Request - State: closed - Opened by SKruthoff over 1 year ago - 1 comment

#89 - Validating output current tables (DQ)

Issue - State: open - Opened by ysherstyuk over 1 year ago

#88 - Testing and finetuning based on DQ checks

Issue - State: open - Opened by ysherstyuk over 1 year ago

#87 - Build architecture flow "press play"

Issue - State: closed - Opened by ysherstyuk over 1 year ago

#86 - Adapt DQ checks to new output table

Issue - State: closed - Opened by ysherstyuk over 1 year ago

#85 - Adjustment R packages with feedback from Anne

Issue - State: open - Opened by ysherstyuk over 1 year ago

#84 - Testing integration of storage & packages

Issue - State: open - Opened by ysherstyuk over 1 year ago - 7 comments

#81 - 72 start filling data model layer

Pull Request - State: open - Opened by ysherstyuk over 1 year ago

#80 - Onoboard and monitor ouptut tables

Pull Request - State: closed - Opened by SKruthoff over 1 year ago

#79 - Create domain values table containing DQ checks

Issue - State: open - Opened by ysherstyuk over 1 year ago - 2 comments

#77 - Adjust production code to new naming standards

Issue - State: closed - Opened by bobresink over 1 year ago

#76 - test

Issue - State: open - Opened by bobresink over 1 year ago

#75 - Monitoring and hive tables

Pull Request - State: closed - Opened by SKruthoff over 1 year ago - 1 comment

#74 - Brainstorm dummy data for visualisation

Issue - State: open - Opened by ysherstyuk over 1 year ago

#72 - Start filling data model layer

Issue - State: closed - Opened by ysherstyuk over 1 year ago

#70 - Add IndicatorBefore flow to as-is data model

Issue - State: closed - Opened by bobresink over 1 year ago - 1 comment

#69 - Data Quality Checks on output data

Issue - State: open - Opened by ysherstyuk over 1 year ago - 1 comment

#68 - Documentation on already existing functionalities

Issue - State: open - Opened by ysherstyuk over 1 year ago

#67 - add tiltData format and include country_id check

Pull Request - State: closed - Opened by SKruthoff over 1 year ago

#66 - Changed data type from int to string

Pull Request - State: closed - Opened by ysherstyuk over 1 year ago

#65 - Null values are read as Non-null values with spark in table `categories`

Issue - State: closed - Opened by kalashsinghal over 1 year ago - 2 comments
Labels: bug

#64 - Column `country_id` in table `companies` has weird values

Issue - State: closed - Opened by kalashsinghal over 1 year ago - 6 comments
Labels: bug

#63 - Unable to convert table `ecoinvent-v3.9.1` into a pandas dataframe on databricks

Issue - State: closed - Opened by kalashsinghal over 1 year ago - 7 comments
Labels: bug

#62 - Update column type in table `tilt_isic_mapper_2023-07-20`

Issue - State: closed - Opened by kalashsinghal over 1 year ago - 2 comments
Labels: bug

#61 - Implemented checks 1, 3, 5 and 8

Pull Request - State: closed - Opened by ysherstyuk over 1 year ago

#60 - 59 data preparation tiltindicatorbefore

Pull Request - State: closed - Opened by ysherstyuk over 1 year ago

#59 - Data Preparation tiltIndicatorBefore

Issue - State: closed - Opened by SKruthoff over 1 year ago

#58 - Expand Data Quality Checks

Issue - State: closed - Opened by SKruthoff over 1 year ago

#57 - Integrate preprocessing script into Databricks

Issue - State: open - Opened by bobresink over 1 year ago

#56 - 53 build uniqueness format and consistency check funcitonality

Pull Request - State: closed - Opened by SKruthoff over 1 year ago

#55 - Additional tables for values within list

Pull Request - State: closed - Opened by ysherstyuk over 1 year ago

#54 - Include monitoring checks on writing of tables

Issue - State: open - Opened by SKruthoff over 1 year ago

#53 - Build uniqueness, format and consistency check funcitonality

Issue - State: closed - Opened by SKruthoff over 1 year ago - 1 comment

#51 - Implement additional checks from the list

Issue - State: closed - Opened by ysherstyuk over 1 year ago

#50 - Automatically Create Hive Tables for tables

Issue - State: open - Opened by SKruthoff over 1 year ago

#49 - Sector resolving data for Anne

Issue - State: open - Opened by bobresink over 1 year ago

#48 - 47 implement unique format for ecoinvent due to formatting issues

Pull Request - State: closed - Opened by SKruthoff over 1 year ago

#43 - 12 implement slowly changing dimensions

Pull Request - State: closed - Opened by SKruthoff over 1 year ago

#42 - Check year_established in companies_raw

Issue - State: open - Opened by ysherstyuk over 1 year ago

#40 - Adjusted decimal values and delimiter for csv

Pull Request - State: closed - Opened by ysherstyuk over 1 year ago

#39 - Fix bugs based on feedback from developers and analysts

Issue - State: closed - Opened by ysherstyuk over 1 year ago

#38 - 35 onboard input data to the data storage for tiltindicatorbefore

Pull Request - State: closed - Opened by ysherstyuk over 1 year ago

#37 - 28 add mutliple columns to unique data quality criteria

Pull Request - State: closed - Opened by ysherstyuk over 1 year ago

#34 - Create logging of creation of tables

Issue - State: open - Opened by SKruthoff over 1 year ago

#33 - 13 implement unique record

Pull Request - State: closed - Opened by SKruthoff over 1 year ago

#32 - Create Automatic Documentation of Data model

Issue - State: open - Opened by SKruthoff over 1 year ago

#31 - remove unnecessary transform tables

Pull Request - State: closed - Opened by SKruthoff over 1 year ago - 1 comment

#30 - Brainstorm on a new structure of datasets of matching process

Issue - State: open - Opened by ysherstyuk over 1 year ago - 1 comment

#29 - Onboarding product & activity matching

Pull Request - State: closed - Opened by ysherstyuk over 1 year ago - 1 comment

#28 - Add mutliple columns to unique data quality criteria

Issue - State: closed - Opened by SKruthoff over 1 year ago

#27 - Remove uneccesary parts of ecoInvent from transform layer

Issue - State: closed - Opened by SKruthoff over 1 year ago

#26 - Brainstorm on approach for to be data model

Issue - State: open - Opened by ysherstyuk over 1 year ago

#25 - Build functionality for Data record tracing

Issue - State: open - Opened by ysherstyuk over 1 year ago - 1 comment

#24 - Test getting data from storage account using tilt package

Issue - State: closed - Opened by ysherstyuk over 1 year ago

#23 - Onboard prep code resullt

Issue - State: open - Opened by ysherstyuk over 1 year ago

#22 - Onboard matching results to landing and raw layers

Issue - State: open - Opened by ysherstyuk over 1 year ago

#21 - Adjust requirements.txt

Issue - State: open - Opened by ysherstyuk over 1 year ago

#20 - Data quality checks

Pull Request - State: closed - Opened by SKruthoff over 1 year ago - 2 comments