NVIDIA/spark-rapids-tools issues and pull requests

#1235 - Improve console output from python tool for failed/gpu/photon event logs

Pull Request - State: closed - Opened by parthosa 2 months ago - 1 comment
Labels: bug, user_tools, usability

#1234 - [BUG] Update QualX to use stage level aggregate information only

Issue - State: open - Opened by parthosa 2 months ago
Labels: bug, user_tools

#1233 - WIP: [BUG] Fix Dataproc-GKE qual tool unable to find GPU cluster template

Pull Request - State: closed - Opened by cindyyuanjiang 2 months ago - 3 comments
Labels: bug, user_tools

#1232 - [FEA] Generate and use instance description file for Databricks-Azure platform

Pull Request - State: closed - Opened by cindyyuanjiang 2 months ago
Labels: feature request, user_tools, usability

#1231 - Updated models for latest databricks-aws datasets

Pull Request - State: closed - Opened by leewyang 2 months ago
Labels: user_tools

#1230 - Remove arguments related to cost-savings

Pull Request - State: closed - Opened by amahussein 2 months ago - 1 comment
Labels: user_tools, affect-output

#1229 - [TASK] Remove arguments related to cost-savings

Issue - State: closed - Opened by amahussein 2 months ago
Labels: user_tools

#1228 - Refactor QualX for Linter and Test Compatibility

Pull Request - State: closed - Opened by parthosa 2 months ago - 4 comments
Labels: bug, user_tools

#1227 - Fix duplicate records in DataSourceInfo report

Pull Request - State: closed - Opened by amahussein 2 months ago
Labels: bug, tools

#1226 - Updated models for latest dataproc eventlogs

Pull Request - State: closed - Opened by leewyang 2 months ago
Labels: user_tools

#1225 - Qualification tool: Add output stats file for Execs(operators)

Pull Request - State: closed - Opened by nartal1 2 months ago - 15 comments
Labels: feature request, user_tools

#1224 - Fix header check script to exclude files

Pull Request - State: closed - Opened by nartal1 2 months ago - 1 comment
Labels: bug, build

#1223 - [FEA] Remove gcloud CLI dependency for Dataproc platform

Pull Request - State: closed - Opened by cindyyuanjiang 2 months ago - 1 comment
Labels: feature request, user_tools, usability

#1222 - Reduce memory footprint of stageInfo

Pull Request - State: closed - Opened by bilalbari 2 months ago
Labels: tools

#1221 - [FEA] Remove cost-savings from Qualification CLI

Issue - State: open - Opened by amahussein 2 months ago
Labels: feature request, user_tools

#1220 - Remove estimation-model column from qualification summary

Pull Request - State: closed - Opened by amahussein 2 months ago
Labels: user_tools, affect-output

#1219 - Update header check script for pre-commit hooks

Pull Request - State: closed - Opened by nartal1 2 months ago - 3 comments
Labels: build

#1218 - Disable cost saving functionality

Pull Request - State: closed - Opened by amahussein 2 months ago - 1 comment
Labels: feature request, user_tools

#1217 - [FEA] Disable cost savings functionality in qualification CLI

Issue - State: closed - Opened by amahussein 2 months ago
Labels: feature request, user_tools

#1216 - Generate summary metadata file and fix node recommendation in python

Pull Request - State: closed - Opened by parthosa 2 months ago - 3 comments
Labels: bug, feature request, user_tools, affect-output

#1215 - [BUG] Node recommendations not generated for any apps if some apps lack node recommendations

Issue - State: closed - Opened by parthosa 2 months ago
Labels: bug, user_tools

#1214 - [FEA] Add support to map_from_arrays in qualification tools

Issue - State: closed - Opened by amahussein 2 months ago
Labels: feature request, tools

#1213 - [BUG] Dataproc GKE user qualification tool fails because there is no cluster creation script template

Issue - State: closed - Opened by cindyyuanjiang 2 months ago - 1 comment
Labels: bug, user_tools

#1212 - Add option to add features.csv files to training set

Pull Request - State: closed - Opened by leewyang 2 months ago - 2 comments
Labels: feature request, user_tools

#1211 - Ensure UTF-8 encoding for reading non-english characters

Pull Request - State: closed - Opened by parthosa 2 months ago
Labels: bug, tools

#1210 - Fix some basic pylint errors in qualx code

Pull Request - State: closed - Opened by leewyang 2 months ago
Labels: user_tools

#1209 - [BUG] Unit test "output non-english characters" failed in pipeline

Issue - State: closed - Opened by thirtiseven 2 months ago - 1 comment
Labels: bug, tools

#1208 - Follow-up 1189: handle non-english characters in data-output.js

Pull Request - State: closed - Opened by onebox-li 2 months ago - 3 comments

#1207 - [FEA] Remove logging about CSP properties in Initialization phase when input cluster is a file

Issue - State: open - Opened by cindyyuanjiang 3 months ago
Labels: feature request, user_tools

#1206 - [TASK] Create a stub to store Spark StageInfo in core tools

Issue - State: closed - Opened by amahussein 3 months ago
Labels: bug, tools

#1205 - Update pre-commit hooks to check for headers and white-spaces

Pull Request - State: closed - Opened by amahussein 3 months ago
Labels: build

#1204 - Qualification tool should print Kryo related recommendations

Pull Request - State: closed - Opened by tgravescs 3 months ago - 3 comments
Labels: feature request

#1203 - Handle SparkRapidsBuildInfoEvent in GPU event logs

Pull Request - State: closed - Opened by cindyyuanjiang 3 months ago - 1 comment
Labels: feature request, tools

#1202 - [TASK] Optimize the storage of accumulables in core tools

Issue - State: closed - Opened by amahussein 3 months ago
Labels: bug, tools

#1201 - [FEA] Build a generator to describe the current output structure

Issue - State: open - Opened by amahussein 3 months ago
Labels: documentation, feature request, user_tools, tools

#1200 - [FEA] Detect CPU fall-back for special-cases for left join SMJ

Issue - State: closed - Opened by amahussein 3 months ago - 1 comment
Labels: feature request, tools

#1199 - [FEA] Remove qualification output fields related to legacy speedup factors and cost savings

Issue - State: open - Opened by mattahrens 3 months ago - 1 comment
Labels: feature request, user_tools, tools, affect-output

#1198 - Sync plugin support for hash-hive and shift operators

Pull Request - State: closed - Opened by amahussein 3 months ago
Labels: bug, tools

#1197 - Add shap command to internal CLI for debugging

Pull Request - State: closed - Opened by leewyang 3 months ago
Labels: feature request, user_tools

#1196 - [FEA] Remove CLI dependency for EMR and Databricks-AWS platforms in user tool

Pull Request - State: closed - Opened by cindyyuanjiang 3 months ago - 7 comments
Labels: bug, user_tools, usability

#1195 - Sync-up the support of parse_url in qualification tool

Pull Request - State: closed - Opened by amahussein 3 months ago
Labels: bug, tools

#1194 - Issue 367 rocks db poc

Pull Request - State: closed - Opened by bilalbari 3 months ago

#1193 - [FEA] Sync tools supported ops with plugin

Issue - State: closed - Opened by cindyyuanjiang 3 months ago - 2 comments
Labels: feature request, tools

#1192 - [FEA] Add PartitionFilters information in data_source_information table in Profiling Tool

Issue - State: open - Opened by wjxiz1992 3 months ago
Labels: feature request, tools

#1191 - [FEA] Add support to use local cached instance description files

Issue - State: closed - Opened by cindyyuanjiang 3 months ago
Labels: bug, user_tools, usability

#1190 - [BUG] Sync-up the support of parse_url in qualification tool

Issue - State: closed - Opened by amahussein 3 months ago
Labels: bug, tools

#1189 - [BUG] Fix handling of non-english characters in tools output files

Pull Request - State: closed - Opened by amahussein 3 months ago
Labels: bug, tools

#1188 - Qual tool tuning rec based on CPU event log coherently recommend tunings and node setup and infer cluster from eventlog

Pull Request - State: closed - Opened by tgravescs 3 months ago - 2 comments
Labels: feature request, user_tools, affect-output

#1187 - Include status information for failed event logs in core tool

Pull Request - State: closed - Opened by parthosa 3 months ago - 3 comments
Labels: bug, tools

#1186 - Updated models for new training data

Pull Request - State: closed - Opened by leewyang 3 months ago
Labels: user_tools

#1185 - Add evaluate_summary command to internal CLI

Pull Request - State: closed - Opened by leewyang 3 months ago
Labels: user_tools

#1184 - [FEA] Support custom XGBoost model file via user tools CLI

Pull Request - State: closed - Opened by amahussein 3 months ago - 1 comment
Labels: feature request, user_tools

#1183 - [BUG] Accessing closed FileSystem while copying UI folders

Issue - State: closed - Opened by parthosa 3 months ago - 2 comments
Labels: bug, tools

#1182 - [BUG] data_source_information inside raw_metrics duplicates the rows

Issue - State: closed - Opened by amahussein 3 months ago - 1 comment
Labels: bug, tools

#1181 - [BUG] Incorrect handling of non-english characters in tools

Issue - State: closed - Opened by amahussein 3 months ago
Labels: bug, tools

#1180 - [DOC] Fix broken link to qualX docs and update python prerequisites

Pull Request - State: closed - Opened by amahussein 3 months ago
Labels: documentation, user_tools

#1179 - [DOC] pypi.org link to qualx docs is broken

Issue - State: closed - Opened by mattahrens 3 months ago - 1 comment
Labels: documentation, user_tools

#1178 - user-tools:Update --help for cluster argument

Pull Request - State: closed - Opened by nartal1 3 months ago - 1 comment
Labels: documentation

#1177 - [FEA] Enable recursive lookup for event log paths by default

Issue - State: closed - Opened by parthosa 3 months ago - 4 comments
Labels: feature request, tools

#1176 - [FEA] Read eventlogs recursively from directory in Databricks notebook

Issue - State: closed - Opened by nartal1 3 months ago - 1 comment
Labels: feature request, user_tools

#1175 - [FEA] Co-work with Datagen tool in spark-rapids to automatically generate dummy data tables

Issue - State: closed - Opened by wjxiz1992 3 months ago - 3 comments
Labels: feature request, user_tools

#1174 - Support fine-tuning models

Pull Request - State: closed - Opened by leewyang 3 months ago - 1 comment

#1173 - Bump to certifi-2024.7.4 and urllib3-1.26.19

Pull Request - State: closed - Opened by amahussein 3 months ago
Labels: user_tools, build, dependencies

#1172 - [FEA] Add full table name in data_source_information table

Issue - State: open - Opened by wjxiz1992 3 months ago - 4 comments
Labels: feature request, tools

#1171 - Bump certifi from 2023.7.22 to 2024.7.4 in /data_validation

Pull Request - State: closed - Opened by dependabot[bot] 3 months ago - 2 comments
Labels: build, dependencies

#1170 - [BUG] Estimate endTime for non-terminated SQLs in Profiling tool

Issue - State: closed - Opened by amahussein 3 months ago - 2 comments
Labels: bug, tools

#1169 - [FEA] Adding Benchmarking classes to evaluate core tools performance

Pull Request - State: closed - Opened by bilalbari 3 months ago - 1 comment
Labels: feature request, tools

#1168 - Disable UI-HTML report by default in Qualification tool

Pull Request - State: closed - Opened by amahussein 3 months ago
Labels: feature request, user_tools, affect-output

#1167 - Fix parsing App IDs inside metrics directory in QualX

Pull Request - State: closed - Opened by parthosa 3 months ago
Labels: bug, user_tools

#1166 - [FEA] Disable UI-HTML report by default in Qualification CLI

Issue - State: closed - Opened by amahussein 3 months ago
Labels: feature request, user_tools, affect-output

#1165 - [BUG] Qualification tool may show negative numbers in GPU estimates

Issue - State: open - Opened by amahussein 3 months ago
Labels: bug, tools

#1164 - [BUG] Profiling/Qualification Tool does not contain status info for failed event log

Issue - State: closed - Opened by cindyyuanjiang 3 months ago - 1 comment
Labels: bug, tools

#1163 - [BUG] QualX fails to detect profiling metrics for non-standard App IDs

Issue - State: closed - Opened by parthosa 3 months ago
Labels: bug, user_tools

#1162 - [audit 4.0] [SPARK-48479] Investigate new UDF support - make sure tools can recognize

Issue - State: open - Opened by tgravescs 3 months ago
Labels: feature request, tools

#1161 - [Bug] Fix java Qual tool handling of `--platform` argument

Pull Request - State: closed - Opened by cindyyuanjiang 3 months ago - 4 comments
Labels: bug, tools, usability

#1160 - [FEA] Qual tool tuning rec based on CPU event log coherently recommend tunings and node setup and infer cluster from eventlog

Issue - State: closed - Opened by tgravescs 3 months ago
Labels: feature request

GitHub / NVIDIA/spark-rapids-tools issues and pull requests