Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / dmwm/cmsspark issues and pull requests

#100 - Apply check utilities to cron jobs

Pull Request - State: open - Opened by kyrylogy over 2 years ago

#99 - Apply check util functions in cron jobs

Issue - State: open - Opened by mrceyhun over 2 years ago - 1 comment
Labels: cron

#98 - Main bash script for cron jobs and exposing cron metrics to push-gateway

Issue - State: closed - Opened by mrceyhun over 2 years ago - 3 comments
Labels: cron

#97 - Add iterative method to not run spark over 3 years data

Pull Request - State: closed - Opened by mrceyhun over 2 years ago

#96 - Add ES document amount testing

Pull Request - State: closed - Opened by kyrylogy over 2 years ago - 1 comment

#95 - Add check file status utility

Pull Request - State: closed - Opened by kyrylogy over 2 years ago

#94 - Creating check functions for critic cron jobs

Issue - State: closed - Opened by mrceyhun over 2 years ago - 1 comment
Labels: enhancement, cron

#93 - Add yearly plots to hpc monitoring page

Pull Request - State: closed - Opened by mrceyhun over 2 years ago

#92 - Create spark job and mongoimport script to store rucio datasets in mongo

Pull Request - State: closed - Opened by mrceyhun over 2 years ago

#91 - F improve spark

Pull Request - State: closed - Opened by mrceyhun over 2 years ago

#90 - Create datatable html page for hpc usage

Pull Request - State: closed - Opened by mrceyhun over 2 years ago - 1 comment

#89 - Delete old notebook and improve comments

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#88 - Rename hpc script name and add url argument

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#87 - Improve hpc usage plots with source link and edit bsc filter

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#86 - Add spark jobs showConsoleProgress=false

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#85 - Fix k8s condor cpu efficiency scripts

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#84 - Improve rucio_datasets_daily_stats and write stats to eos

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago
Labels: production-ready

#83 - Refactor rucio_datasets_daily_stats cron for K8s, refactor spark job

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#82 - Implement rucio datasets daily stats spark job

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#81 - Implement hpc monthly plots for running cores and corehr

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago - 1 comment

#80 - Improve explanations of rucio static pages

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#79 - Fix grammar in-on disk/tape

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#78 - Adjust rucio datasets last access for cmsmonit eos

Pull Request - State: closed - Opened by mrceyhun almost 3 years ago

#77 - Create datasets in tapes last access pages, use dbs tables and refactor

Pull Request - State: closed - Opened by mrceyhun about 3 years ago
Labels: enhancement

#76 - Improve naming and html

Pull Request - State: closed - Opened by mrceyhun about 3 years ago - 2 comments

#75 - enables search url parameter in dataset monitoring

Pull Request - State: closed - Opened by Panos512 about 3 years ago - 1 comment

#74 - Polish spark job that produce datasets not read since N months

Pull Request - State: closed - Opened by mrceyhun about 3 years ago

#73 - Implement cron job and create html page for rucio datasets not read since N months

Pull Request - State: closed - Opened by mrceyhun about 3 years ago - 2 comments

#72 - Improve rucio table and datasets not read n months spark job

Pull Request - State: closed - Opened by mrceyhun about 3 years ago

#71 - Update repo with local changes in vomcs092

Pull Request - State: closed - Opened by mrceyhun about 3 years ago

#70 - [CMSMONIT-436] Add symbolic link that fix broken link

Pull Request - State: closed - Opened by mrceyhun about 3 years ago - 1 comment

#69 - Refactor bash scripts for shellchecks and code style

Pull Request - State: closed - Opened by mrceyhun about 3 years ago - 2 comments

#68 - Improve rucio last access of datasets spark job

Pull Request - State: closed - Opened by mrceyhun over 3 years ago - 2 comments

#67 - Fix filtering and add documentation

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#66 - Add spark job to get last access times of datasets in rucio

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#65 - Add wasted time field to condor cpu eff and format stepchain code

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#64 - Edit aggregations in stepchain cpu eff table

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#63 - Add reqmgr link and new columns

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#62 - Add mean ncores and nthreads aggs

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#61 - Refactor stepchain and condor cpu efficiency k8s cronjobs

Pull Request - State: closed - Opened by mrceyhun over 3 years ago - 2 comments

#60 - Create StepChain cpu efficiency static website

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#59 - Update k8s cpu eff script for outlier params

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#58 - Bug fix for non-production job df joins

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#57 - Add T1 and T2 only calculations and polish html

Pull Request - State: closed - Opened by mrceyhun over 3 years ago

#56 - Add tier efficiency

Pull Request - State: closed - Opened by mrceyhun almost 4 years ago

#55 - Create cpu eff outlier table

Pull Request - State: closed - Opened by mrceyhun almost 4 years ago

#54 - Add Kibana links to cpu eff table

Pull Request - State: closed - Opened by mrceyhun almost 4 years ago

#53 - Add local changes of cmsmonit

Pull Request - State: closed - Opened by mrceyhun almost 4 years ago - 1 comment

#52 - Arrange plot to look more pleasant

Pull Request - State: closed - Opened by mrceyhun almost 4 years ago

#51 - Implement -hpc at cms- c-rsg plot cronjobs

Pull Request - State: closed - Opened by mrceyhun almost 4 years ago - 2 comments

#50 - [cmsmonit-185] Create k8s script for cpu_eff

Pull Request - State: closed - Opened by mrceyhun almost 4 years ago - 1 comment

#49 - Bug fix mean cpu eff

Pull Request - State: closed - Opened by mrceyhun about 4 years ago

#48 - Cron for rucio dumps

Pull Request - State: closed - Opened by mrceyhun about 4 years ago

#46 - Add rec_tsmp field for latency plot

Pull Request - State: closed - Opened by mrceyhun about 4 years ago

#45 - [CMSMONIT-185] Fix log path

Pull Request - State: closed - Opened by mrceyhun over 4 years ago

#44 - [HS06 CpuTime] plot script

Pull Request - State: closed - Opened by cronosnull over 4 years ago

#43 - capture valid and invalid data sets by removing requirement on valid files

Pull Request - State: closed - Opened by davidlange6 over 4 years ago - 6 comments

#42 - [hadoop] Start a login shell to use the profile.d conf

Pull Request - State: closed - Opened by cronosnull over 4 years ago

#41 - [fix]MergePhedex script fails with "" gid ('""')

Pull Request - State: closed - Opened by cronosnull over 4 years ago - 2 comments

#40 - Cpu eff script

Pull Request - State: closed - Opened by cronosnull almost 5 years ago - 2 comments

#39 - [CMSSW] Query the cmssw json data instead of the avro files

Pull Request - State: closed - Opened by cronosnull almost 5 years ago - 3 comments

#38 - crab unique users by weekofyear or month

Pull Request - State: closed - Opened by cronosnull about 5 years ago - 2 comments

#37 - Backfill: If the local file doesn't exits, download it.

Pull Request - State: closed - Opened by cronosnull about 5 years ago

#36 - EventCountPlot: add the option to specify the colors

Pull Request - State: closed - Opened by cronosnull about 5 years ago

#35 - Crab popularity

Pull Request - State: closed - Opened by cronosnull about 5 years ago

#34 - EOS popularity: Changes to run it periodically

Pull Request - State: closed - Opened by cronosnull about 5 years ago

#33 - Event count plots

Pull Request - State: closed - Opened by cronosnull about 5 years ago

#32 - Notebooks

Pull Request - State: open - Opened by cronosnull about 5 years ago

#31 - EOS dataset and eos popularity

Pull Request - State: closed - Opened by cronosnull over 5 years ago

#30 - Switch to CMSMonitoring version of StompAMQ

Pull Request - State: closed - Opened by vkuznet over 5 years ago

#29 - Wrong field name in processing era dataframe?

Issue - State: closed - Opened by sciaba over 5 years ago - 5 comments

#28 - Adding written and read bytes and time

Pull Request - State: closed - Opened by cronosnull almost 6 years ago

#27 - EOS: Modify eos_tables to be able to work with both schemas

Pull Request - State: closed - Opened by cronosnull almost 6 years ago - 1 comment

#26 - Bug in run_spark?

Issue - State: closed - Opened by sciaba almost 6 years ago - 1 comment

#25 - Simple setup for it-hadoop-client

Issue - State: open - Opened by nsmith- almost 6 years ago - 11 comments

#24 - Authentication issues on it-hadoop-client

Issue - State: closed - Opened by nsmith- almost 6 years ago - 8 comments

#23 - Corrupt timestamps in classad csvs

Issue - State: open - Opened by davidlange6 about 6 years ago - 1 comment

#22 - dbs_events script missing header row in output

Issue - State: closed - Opened by davidlange6 about 6 years ago - 2 comments

#21 - Fix missing import and read fnames in Python 3

Pull Request - State: closed - Opened by MircoT about 6 years ago

#20 - Typo in variable name

Issue - State: closed - Opened by sciaba over 6 years ago - 1 comment

#19 - Wrong type

Issue - State: closed - Opened by sciaba over 6 years ago - 4 comments

#18 - Make run_spark compatible with the ithdp-client cluster

Issue - State: closed - Opened by sciaba over 6 years ago - 1 comment

#17 - Reading Avro files as Dataframes instead of RDD?

Issue - State: closed - Opened by sciaba over 6 years ago - 5 comments

#16 - --cvmfs option to run_spark de facto mandatory

Issue - State: closed - Opened by sciaba over 6 years ago - 2 comments

#15 - sparkexjar always empty

Issue - State: closed - Opened by sciaba over 6 years ago - 23 comments

#14 - Typo in date string

Issue - State: closed - Opened by sciaba over 6 years ago - 1 comment

#13 - Missing job reports in JobMonitoring data?

Issue - State: closed - Opened by mxsg over 6 years ago - 9 comments

#12 - Added report generation based in data tiers and campaigns

Pull Request - State: closed - Opened by andrius-k almost 7 years ago - 20 comments

#11 - draft ideas for getting a phedex summary with more information

Pull Request - State: closed - Opened by davidlange6 about 7 years ago - 13 comments

#10 - JobMonitoring attributes

Pull Request - State: closed - Opened by vkuznet over 7 years ago

#9 - Add dn, application, uid attributes

Pull Request - State: closed - Opened by vkuznet over 7 years ago

#8 - Script for first aso and fts metadata aggregation

Pull Request - State: closed - Opened by dciangot over 7 years ago

#6 - Fix download_and_concat.sh

Pull Request - State: closed - Opened by justinasr over 7 years ago

#5 - Update plotting script, add download and concat script

Pull Request - State: closed - Opened by justinasr over 7 years ago

#4 - Update aggregation script, add plotting script, bash script for cron

Pull Request - State: closed - Opened by justinasr over 7 years ago

#3 - Timestamp, tier attributes, empty input handling

Pull Request - State: closed - Opened by justinasr over 7 years ago

#2 - Data aggregation

Pull Request - State: closed - Opened by justinasr over 7 years ago

#1 - Data collection from AAA, CMSSW, EOS and CRAB streams

Pull Request - State: closed - Opened by justinasr over 7 years ago