Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / NVIDIA/spark-rapids-tools issues and pull requests

#531 - [FEA] ascli qualification with no arguments should show simple message

Issue - State: closed - Opened by mattf about 1 year ago - 1 comment
Labels: feature request

#514 - Qualification tool: Add penalty for execs/operators not associated with stages

Issue - State: closed - Opened by nartal1 about 1 year ago - 2 comments
Labels: feature request, tools

#477 - [FEA] Qualification tool should look at spill metrics

Issue - State: closed - Opened by tgravescs about 1 year ago - 3 comments
Labels: feature request, tools

#472 - Improve qualification tool estimation

Issue - State: closed - Opened by nartal1 about 1 year ago - 2 comments
Labels: feature request, tools

#470 - Verify the integrity the downloaded dependencies

Pull Request - State: closed - Opened by parthosa about 1 year ago - 2 comments
Labels: feature request, user_tools

#466 - Refactor arguments to handle options after event logs

Pull Request - State: closed - Opened by parthosa about 1 year ago
Labels: feature request, tools

#457 - [BUG]cupy.cuda.memory.OutOfMemoryError

Issue - State: closed - Opened by ruirui88 about 1 year ago - 2 comments
Labels: bug

#454 - Remove references to oppressive language in core tools

Pull Request - State: closed - Opened by parthosa about 1 year ago - 3 comments
Labels: tools

#453 - Remove references to oppressive language in user tools

Pull Request - State: closed - Opened by parthosa about 1 year ago - 4 comments
Labels: user_tools

#450 - Generate speedup factors for A10 instance types in EMR

Pull Request - State: closed - Opened by parthosa about 1 year ago
Labels: feature request, tools

#448 - [FEA] Dynamic Recommendations in AutoTuner Based on Platform

Issue - State: closed - Opened by parthosa about 1 year ago - 1 comment
Labels: feature request, tools

#446 - Fix mvn warning message for formatting string

Pull Request - State: closed - Opened by parthosa about 1 year ago
Labels: bug, tools

#407 - [FEA] Implement a cross-CSP storage driver

Issue - State: closed - Opened by amahussein over 1 year ago - 1 comment
Labels: feature request, user_tools

#389 - [DOC] Qualification Tool documentation revamp

Issue - State: closed - Opened by amahussein over 1 year ago - 1 comment
Labels: documentation, user_tools, tools

#387 - Improve logging messages in Qualification Tools

Pull Request - State: closed - Opened by parthosa over 1 year ago - 3 comments
Labels: feature request, tools

#370 - [FEA] Detect DeltaLake saveIntoDataSrc operations

Issue - State: closed - Opened by amahussein over 1 year ago - 1 comment
Labels: feature request, tools

#367 - [FEA] Improve performance of core module

Issue - State: open - Opened by amahussein over 1 year ago - 1 comment
Labels: feature request, tools, reliability

#348 - [Followup] Load HadoopConf using SparkHadoopUtil

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, cicd, tools, build

#346 - Keeping spark-rapids-tools and spark-rapids tools docs in sync

Pull Request - State: closed - Opened by mattahrens over 1 year ago
Labels: documentation

#345 - [BUG] NumberFormatException while processing sql-metrics

Issue - State: open - Opened by amahussein over 1 year ago
Labels: bug, cicd, tools

#343 - Skip nds_q86_fail_test for spark-340

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, tools, build

#342 - [WIP] Dataproc savings based on onprem cluster config

Pull Request - State: open - Opened by nartal1 over 1 year ago

#341 - [FEA] Define cluster recommendations for shared YARN clusters in cloud

Issue - State: closed - Opened by tgravescs over 1 year ago - 1 comment
Labels: duplicate, feature request

#340 - [FEA] Bootstrap/profiling tool should set pinned pool size based on executor.cores X optimal maxPartitionBytes

Issue - State: open - Opened by mattahrens over 1 year ago
Labels: feature request, user_tools, tools

#339 - Adding default pageable pool to memoryOverhead for bootstrap/profiler

Pull Request - State: closed - Opened by mattahrens over 1 year ago - 1 comment
Labels: user_tools, tools

#338 - Bump requests from 2.28.2 to 2.31.0 in /data_validation

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#337 - Bump requests from 2.28.2 to 2.31.0 in /user_tools

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#336 - Fix tools version in docs

Pull Request - State: closed - Opened by mattahrens over 1 year ago

#335 - Load HadoopConf using SparkHadoopUtil

Pull Request - State: closed - Opened by amahussein over 1 year ago - 1 comment
Labels: feature request, tools

#334 - Fixing qualification tool docs

Pull Request - State: closed - Opened by mattahrens over 1 year ago

#333 - Adding tools disclaimer for dedicated cluster assumption

Pull Request - State: closed - Opened by mattahrens over 1 year ago

#332 - [FEA] Disk size recommendation for auto tuner or bootstrap tool

Issue - State: open - Opened by tgravescs over 1 year ago
Labels: feature request, user_tools, tools

#331 - [FEA] Add exception list of unsupported operators for qualification tool output to ignore

Issue - State: open - Opened by mattahrens over 1 year ago
Labels: feature request, tools

#330 - [FEA] Check Excel and other spreadsheet software compatibility

Issue - State: open - Opened by rwlee over 1 year ago
Labels: feature request, tools

#329 - [FEA] The tools should be able to pass configuration to Hadoop

Issue - State: closed - Opened by amahussein over 1 year ago - 1 comment
Labels: feature request, tools

#328 - Adding full outer for buildside right for equijoin

Pull Request - State: closed - Opened by mattahrens over 1 year ago

#327 - [EPIC] Support multitenant cluster with user tools

Issue - State: open - Opened by mattahrens over 1 year ago - 1 comment
Labels: feature request, epic

#326 - [FEA] Add multitenant support for profiler user tools

Issue - State: open - Opened by mattahrens over 1 year ago
Labels: feature request, user_tools

#325 - [FEA] Add multitenant support for bootstrap user tools

Issue - State: open - Opened by mattahrens over 1 year ago
Labels: feature request, user_tools

#324 - Add support for SaveIntoDataSourceExec

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: feature request, tools

#323 - [FEA] Add support for SaveIntoDataSourceExec in SqlParser

Issue - State: closed - Opened by amahussein over 1 year ago
Labels: feature request, tools

#322 - [BUG] Expected persql results for `nds_q86_fail_test` do not match on Spark 3.4

Issue - State: closed - Opened by rwlee over 1 year ago - 4 comments
Labels: bug, build

#321 - [FEA] Bootstrap and profiling tools should account for pageable, spill, and shuffle memory in the Spark overhead memory config

Issue - State: closed - Opened by tgravescs over 1 year ago - 3 comments
Labels: feature request, user_tools, tools

#320 - [FEA] Add disclaimer for bootstrap and profiler recommendations regarding assumption of dedicated cluster

Issue - State: closed - Opened by mattahrens over 1 year ago
Labels: documentation, feature request, user_tools, tools

#319 - Updating Dataproc T4 speedup factors based on latest automated benchmarks

Pull Request - State: closed - Opened by mattahrens over 1 year ago
Labels: tools

#318 - Adding --ml-option support to Python wrapper

Pull Request - State: closed - Opened by mattahrens over 1 year ago
Labels: user_tools

#317 - Adding application default credentials step for Dataproc user tools docs

Pull Request - State: closed - Opened by mattahrens over 1 year ago
Labels: documentation, user_tools

#316 - Auto tuner shuffle updates

Pull Request - State: closed - Opened by revans2 over 1 year ago
Labels: feature request, tools

#315 - [FEA] Support onprem platform for user tools profiling command

Issue - State: open - Opened by mattahrens over 1 year ago
Labels: feature request, user_tools

#314 - AutoTuner should make comments based on RAPIDS jar

Pull Request - State: closed - Opened by amahussein over 1 year ago - 3 comments
Labels: bug, feature request, user_tools, tools

#313 - [FEA] control location of html report output from CliOnpremLocalMode

Issue - State: closed - Opened by mattf over 1 year ago - 1 comment
Labels: feature request, user_tools

#312 - [FEA] control location of textual report output from CliOnpremLocalMode

Issue - State: closed - Opened by mattf over 1 year ago - 1 comment
Labels: feature request, user_tools

#311 - [FEA] control for verbosity in CliOnpremLocalMode

Issue - State: closed - Opened by mattf over 1 year ago - 1 comment
Labels: feature request, user_tools

#310 - [FEA] Consider loading constants and properties from a configuration file

Issue - State: open - Opened by amahussein over 1 year ago
Labels: feature request, good first issue, tools

#309 - Qualification tool wrapper should handle empty rows

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, user_tools

#307 - [BUG] Qualification command raises errors with empty rows

Issue - State: closed - Opened by amahussein over 1 year ago
Labels: bug, user_tools

#306 - Update operators score of Dataproc by jenkins-gen-speedup-factors-dat…

Pull Request - State: closed - Opened by mattahrens over 1 year ago - 2 comments
Labels: cicd, tools, build

#305 - [DOC] Update gcloud auth step with application-default for prerequisites

Issue - State: closed - Opened by mattahrens over 1 year ago
Labels: documentation, user_tools

#304 - Add source drawio file of rapids_user_tools overview graph

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: documentation, user_tools

#303 - [DOC] Add source drawio of the rapids_user_tools-overview

Issue - State: closed - Opened by amahussein over 1 year ago
Labels: documentation, user_tools

#302 - [FEA] user-tools: Add support to read from hdfs and S3 for qualification tool OnPrem platform

Issue - State: open - Opened by nartal1 over 1 year ago
Labels: feature request, user_tools

#301 - [FEA] Remove redundant empty string checks and remove `,` alternatives from CSV output

Issue - State: open - Opened by rwlee over 1 year ago
Labels: feature request, tools

#300 - Add stack-trace errors on failure

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, cicd, user_tools, build

#299 - [BUG] Show stack-trace of errors running pytools commands

Issue - State: closed - Opened by amahussein over 1 year ago
Labels: bug, user_tools

#298 - Update operators score by jenkins-gen-speedup-factors-spark2a-8

Pull Request - State: closed - Opened by mattahrens over 1 year ago - 1 comment

#297 - [FEA] In AutoTuner warn about using the default hive output format

Issue - State: open - Opened by revans2 over 1 year ago
Labels: feature request, tools

#296 - [FEA] in AutoTuner provide suggestions about file caching

Issue - State: open - Opened by revans2 over 1 year ago - 1 comment
Labels: feature request, tools

#295 - Add configuration and initialization for Databricks Azure platform

Pull Request - State: open - Opened by cindyyuanjiang over 1 year ago - 4 comments
Labels: feature request, user_tools

#294 - [TASK] Implement configuration and initialization for Databricks Azure platform

Issue - State: open - Opened by cindyyuanjiang over 1 year ago
Labels: feature request, user_tools

#293 - [FEA] Add changelog to the releases/tags

Issue - State: open - Opened by amahussein over 1 year ago
Labels: feature request, cicd, build

#292 - [DOC] update the requirements to run tools

Issue - State: open - Opened by amahussein over 1 year ago
Labels: bug, documentation

#291 - Fix handling of Json parse exceptions on Spark340

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, tools

#290 - Remove references to oppressive language from codebase

Issue - State: open - Opened by amahussein over 1 year ago
Labels: good first issue, user_tools, tools

#289 - [FEA] explore setting advisoryPartitionSizeInBytes for AQE in AutoTuner

Issue - State: open - Opened by revans2 over 1 year ago - 1 comment
Labels: feature request, reliability

#288 - [FEA] explore if it is worth setting minPartitionSize and/or parallelismFirst in AutoTuner

Issue - State: open - Opened by revans2 over 1 year ago - 2 comments
Labels: feature request, tools, reliability

#287 - [FEA] Look for a very idle cluster in the profiling tool

Issue - State: open - Opened by revans2 over 1 year ago
Labels: feature request, tools

#286 - [FEA] Detect slow nodes in profiling tool

Issue - State: open - Opened by revans2 over 1 year ago - 1 comment
Labels: feature request

#285 - Add AQE setting for older versions of Spark.

Pull Request - State: closed - Opened by revans2 over 1 year ago

#284 - User-tools: Add qualfication tool support for Onprem platform

Pull Request - State: closed - Opened by nartal1 over 1 year ago - 7 comments
Labels: feature request, user_tools

#283 - Fix handling of Json parse exceptions on Spark3.40+

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, tools

#282 - [BUG] Qualification tool does not detect malformed eventlogs on Spark3.4.0+

Issue - State: closed - Opened by amahussein over 1 year ago
Labels: bug, tools

#281 - Fix unit tests for spark3x

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, tools

#280 - [BUG] Qualification tool does not detect failed SQLs for Spark3.4.0+

Issue - State: closed - Opened by amahussein over 1 year ago - 3 comments
Labels: bug, tools

#279 - [BUG] Python wrapper does not pass ML support to Qualification cmd

Issue - State: closed - Opened by amahussein over 1 year ago
Labels: bug, user_tools

#278 - [FEA] Profiling does not show progress

Issue - State: open - Opened by amahussein over 1 year ago
Labels: feature request, good first issue, tools

#277 - [BUG] EMR pricing cost catalog is hardcoded

Issue - State: open - Opened by amahussein over 1 year ago
Labels: bug, good first issue, user_tools

#276 - CSV output string reformatting

Pull Request - State: open - Opened by rwlee over 1 year ago - 6 comments
Labels: bug

#275 - roll back version upgrade

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: cicd, user_tools, tools, build

#274 - [FEA] Add support to L4 GPUs in dataproc wrappers

Issue - State: open - Opened by amahussein over 1 year ago - 1 comment
Labels: feature request, user_tools

#273 - Generate speedup factors for Dataproc L4 cluster

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: feature request, tools

#272 - Adding autotuner recommendations for multithreaded settings based on CPU cores

Pull Request - State: closed - Opened by mattahrens over 1 year ago - 5 comments

#271 - Revert incomplete version upgrades

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: user_tools, tools, build

#270 - Add moustache templates to the package data

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, user_tools, build

#269 - [BUG] Moustache template files are not included in the wheel

Issue - State: closed - Opened by amahussein over 1 year ago
Labels: bug, user_tools, build

#268 - Bump snakeyaml version to 2.0

Pull Request - State: closed - Opened by amahussein over 1 year ago
Labels: bug, tools, build

#267 - Updating major version to 23.04.0 for tools artifacts

Pull Request - State: closed - Opened by mattahrens over 1 year ago
Labels: user_tools, tools

#266 - [FEA] warn people about multiple versions of the plugin on the classpath

Issue - State: closed - Opened by revans2 over 1 year ago - 1 comment
Labels: feature request, tools

#265 - [FEA] Upgrade snakeyaml to a version >= 2.0

Issue - State: closed - Opened by mattahrens over 1 year ago
Labels: feature request, user_tools, tools