LucaCanali/sparkMeasure issues and pull requests

#60 - bytesRead not populated in some cases

Issue - State: open - Opened by snowch 6 days ago

#59 - Add application start and end metrics

Pull Request - State: closed - Opened by pulakk 21 days ago - 1 comment

#58 - Add spark.app.name tag to InfluxDBSink metrics

Pull Request - State: closed - Opened by pulakk 22 days ago

#57 - Getting Spark Task related metrics using Prometheus Push Gateway

Issue - State: open - Opened by krishhkk 27 days ago - 1 comment

#56 - AttributeError: 'StageMetrics' object has no attribute 'stagemetrics'

Issue - State: closed - Opened by cometta about 2 months ago - 2 comments

#55 - Question: InfluxDB 2.x Support

Issue - State: open - Opened by MasonLegere 4 months ago - 3 comments

#54 - Feature Request: Support Prometheus Gateway Sink in Flight Recorder Mode

Issue - State: closed - Opened by kiranatlu 4 months ago - 1 comment

#53 - Add support for SparkMeasure Flight Recorder mode - HTTP Sink

Issue - State: closed - Opened by athityakumar 4 months ago - 1 comment

#52 - Fix mistake in README.md

Pull Request - State: closed - Opened by CheneyYin about 1 year ago - 1 comment

#51 - Prepare to release version 0.23

Pull Request - State: closed - Opened by LucaCanali about 1 year ago

#50 - 'JavaPackage' object is not callable when using the Colab Example

Issue - State: closed - Opened by ssalloum about 1 year ago - 3 comments

#49 - Prepare for releasing version 0.23

Pull Request - State: closed - Opened by LucaCanali about 1 year ago - 1 comment

#48 - NoSuchMethodError: org.apache.spark.scheduler.SparkListenerExecutorMetricsUpdate.executorUpdates()

Issue - State: closed - Opened by mlcoop over 1 year ago - 5 comments

#47 - Issue when using sbt dependency - retrofit not resolved

Issue - State: closed - Opened by AnirudhVyas over 1 year ago - 1 comment

#46 - Flight Recorder Mode when Driver crashed from OOM

Issue - State: closed - Opened by maytasm over 1 year ago - 3 comments

#45 - testSparkMeasureScala sbt problem

Issue - State: closed - Opened by DanielAronovich over 1 year ago - 2 comments

#44 - java compatibility

Issue - State: closed - Opened by geofflangenderfer over 1 year ago - 1 comment

#43 - can't find spark-measure 0.21

Issue - State: closed - Opened by hen-shalom-riski almost 2 years ago - 2 comments

#42 - Fix Python TaskMetrics.init

Pull Request - State: closed - Opened by brian-tecton-ai almost 2 years ago - 2 comments

#41 - TypeError: 'JavaPackage' object is not callable

Issue - State: closed - Opened by rogerrogeryau almost 2 years ago - 3 comments

#40 - Peak Memory usage - PySpark 3 on Azure Synapse

Issue - State: closed - Opened by jacwalte almost 2 years ago - 2 comments

#39 - Add epoch milliseconds into stage/task metric

Pull Request - State: closed - Opened by hoaihuongbk about 2 years ago - 1 comment

#38 - throwing error when trying to make work locally

Issue - State: closed - Opened by hardiktalati over 2 years ago - 9 comments

#37 - NoSuchMethodError (ScalaObjectMapper)

Issue - State: closed - Opened by dvanbrug over 2 years ago - 3 comments

#36 - Add KafkaSink to support shipping metrics into a kafka stream

Pull Request - State: closed - Opened by hoaihuongbk over 2 years ago - 3 comments

#35 - How to get the execution time for EACH operator in Spark SQL?

Issue - State: closed - Opened by niewangwen over 2 years ago - 1 comment

#34 - add ability to specify saveMode while writing spark results.

Pull Request - State: closed - Opened by kudhru about 3 years ago - 1 comment

#33 - How to find time spent in I/O for a task

Issue - State: closed - Opened by Niharikadutta over 3 years ago - 2 comments

#32 - Guide for metrics interpretation

Issue - State: closed - Opened by mansenfranzen almost 4 years ago - 1 comment

#31 - Better to have the IO metrics for non-hdfs type such as S3 Storage

Issue - State: closed - Opened by jack1981 almost 4 years ago - 1 comment

#30 - Notable difference to REST API

Issue - State: closed - Opened by mansenfranzen almost 4 years ago - 2 comments

#29 - TaskMetrics and StageMetrics does not extend a common trait

Issue - State: closed - Opened by RodrigoCSoares about 4 years ago

#28 - Send to Prometheus not available from Python

Issue - State: closed - Opened by nadenf over 4 years ago - 1 comment

#27 - Memory usage

Issue - State: closed - Opened by ductuantruong over 4 years ago - 1 comment

#26 - The approach is to deliver a Scala Map rather than a JSON object.

Pull Request - State: closed - Opened by dwurry over 4 years ago - 7 comments

#25 - New maven build

Pull Request - State: closed - Opened by dwurry over 4 years ago - 1 comment

#24 - Support for SparkR

Issue - State: closed - Opened by Shelnutt2 almost 5 years ago - 1 comment

#23 - spark 3.2.3 problems

Issue - State: closed - Opened by dmitrybugakov over 5 years ago

#22 - jobId field only comes as "0" or "1" in stage and task Metrics.

Issue - State: closed - Opened by Amittyagi007 over 5 years ago

#21 - Handle null values when generating report string from task metrics

Pull Request - State: closed - Opened by turtlemonvh over 5 years ago - 3 comments

#20 - Uncaught throwable from user code: scala.MatchError: (elapsedTime,null) (of class scala.Tuple2) (taskmetrics.scala:206)

Issue - State: closed - Opened by turtlemonvh over 5 years ago - 3 comments

#19 - jupyter notebook example missing

Issue - State: closed - Opened by catch93 over 5 years ago - 1 comment

#18 - check if sum(numTasks) is null

Pull Request - State: closed - Opened by Jirapong over 5 years ago - 1 comment

#17 - printReport error on the complex query

Issue - State: closed - Opened by Jirapong over 5 years ago - 3 comments

#16 - Update Flight_recorder_mode.md

Pull Request - State: closed - Opened by Jirapong over 5 years ago - 1 comment

#15 - Update path of metrics analysis example notebook

Pull Request - State: closed - Opened by cruizen almost 6 years ago - 2 comments

#14 - New logo/icon proposal

Issue - State: closed - Opened by mansya almost 6 years ago

#13 - Correction on the method create_taskmetrics_DF

Pull Request - State: closed - Opened by franciscojfs almost 6 years ago - 2 comments

#12 - Error creating a TaskMetrics dataframe

Issue - State: closed - Opened by franciscojfs almost 6 years ago - 2 comments

#11 - taskVals.toDF java.lang.ClassCastException: ch.cern.sparkmeasure.StageVals incompatible with ch.cern.sparkmeasure.TaskVals

Issue - State: closed - Opened by KennethNagin almost 6 years ago

#10 - Prometheus support

Pull Request - State: closed - Opened by alitet01 almost 6 years ago - 2 comments

#9 - Added job group

Pull Request - State: closed - Opened by mimiyan about 6 years ago - 3 comments

#8 - Why sum(bytesWritten) => 0 (0 Bytes) always 0 ?

Issue - State: closed - Opened by gilv about 6 years ago - 2 comments

#7 - Dropping SparkListenerEvent because no remaining room in event queue

Issue - State: closed - Opened by bteeuwen over 6 years ago - 2 comments

#6 - enable travis-ci

Issue - State: closed - Opened by pjfanning over 6 years ago - 1 comment

#5 - Travis build support

Pull Request - State: closed - Opened by pjfanning over 6 years ago

#4 - add support for optionally writing metric data as json

Pull Request - State: closed - Opened by pjfanning over 6 years ago

#3 - use json for the serialized data

Issue - State: closed - Opened by pjfanning over 6 years ago - 3 comments

#2 - slf4j logging

Pull Request - State: closed - Opened by pjfanning over 6 years ago

#1 - switch to slf4j for logging

Issue - State: closed - Opened by pjfanning over 6 years ago - 2 comments

GitHub / LucaCanali/sparkMeasure issues and pull requests