IRC logs of #shogun for Wednesday, 2018-10-10

« Tuesday, 2018-10-09 Index Thursday, 2018-10-11 »
--- Log opened Wed Oct 10 00:00:12 2018
-!- durovo1 [~durovo@f8.b3.3da9.ip4.static.sl-reverse.com] has quit [Remote host closed the connection]01:04
-!- durovo [~durovo@f8.b3.3da9.ip4.static.sl-reverse.com] has joined #shogun01:04
-!- Netsplit *.net <-> *.split quits: mrohit[m], lisitsyn, shogun-buildbot_, @sukey, pota, @ChanServ, wuwei[m], Trixis, zxtx, rcurtin, (+2 more, use /NETSPLIT to show all of them)03:38
-!- Netsplit over, joins: @wiking03:43
-!- Netsplit over, joins: zxtx03:43
-!- Netsplit over, joins: mrohit[m]03:44
-!- rcurtin [~ryan@knife.lugatgt.org] has joined #shogun03:45
-!- Trixis [~Trixis@unaffiliated/trixis] has joined #shogun03:45
-!- lisitsyn [~lisitsyn@37.139.2.75] has joined #shogun03:46
-!- durovo [~durovo@f8.b3.3da9.ip4.static.sl-reverse.com] has joined #shogun03:46
-!- pota [~pota@catv-176-63-22-135.catv.broadband.hu] has joined #shogun03:46
-!- wuwei[m] [wuweilinma@gateway/shell/matrix.org/x-byuermupebneselk] has joined #shogun03:46
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has joined #shogun03:47
-!- sukey [~nodebot@ks312251.kimsufi.com] has joined #shogun03:47
-!- ServerMode/#shogun [+o sukey] by asimov.freenode.net03:47
-!- durovo [~durovo@f8.b3.3da9.ip4.static.sl-reverse.com] has quit [Write error: Broken pipe]03:47
-!- ChanServ [ChanServ@services.] has joined #shogun03:47
-!- ServerMode/#shogun [+o ChanServ] by asimov.freenode.net03:47
-!- durovo [~durovo@f8.b3.3da9.ip4.static.sl-reverse.com] has joined #shogun03:49
-!- sonney2k [~shogun@7nn.de] has quit [Ping timeout: 272 seconds]07:58
-!- sonney2k [~shogun@7nn.de] has joined #shogun07:58
-!- HeikoS [~heiko@host86-153-76-175.range86-153.btcentralplus.com] has joined #shogun10:52
-!- mode/#shogun [+o HeikoS] by ChanServ10:52
-!- HeikoS [~heiko@host86-153-76-175.range86-153.btcentralplus.com] has quit [Ping timeout: 272 seconds]10:58
-!- ChriSopht [~ChriSopht@ricasa01.informatik.uni-bremen.de] has joined #shogun10:58
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has joined #shogun14:16
-!- mode/#shogun [+o HeikoS] by ChanServ14:16
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has quit [Ping timeout: 252 seconds]14:23
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4400 closed by geektoni14:25
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has joined #shogun15:26
-!- mode/#shogun [+o HeikoS] by ChanServ15:26
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has quit [Ping timeout: 250 seconds]16:09
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has joined #shogun16:11
-!- mode/#shogun [+o HeikoS] by ChanServ16:11
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has quit [Ping timeout: 252 seconds]16:19
-!- ChriSopht [~ChriSopht@ricasa01.informatik.uni-bremen.de] has quit [Quit: Leaving.]18:02
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has joined #shogun21:18
-!- mode/#shogun [+o HeikoS] by ChanServ21:18
@HeikoSlisitsyn: jo21:20
lisitsynHeikoS: hey21:22
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has quit [Ping timeout: 252 seconds]21:25
-!- HeikoS [~heiko@2a00:23c5:e10a:5c00:adf4:8dac:e66a:2204] has joined #shogun22:52
-!- mode/#shogun [+o HeikoS] by ChanServ22:53
@HeikoSlisitsyn:  jo22:55
lisitsynHeikoS: hey23:06
@HeikoSlisitsyn: jo23:08
lisitsynHeikoS: ok so what do we do :)23:08
lisitsynHeikoS: let me prepare the list of papers23:10
@HeikoSlisitsyn: ok23:10
@HeikoSyes23:10
@HeikoSand then23:10
@HeikoSwe need to ask pamela about these checkboxes23:10
@HeikoSand then we need to think how many papers we send to people23:10
@HeikoSwe need *at least* two reviews per submission23:10
@HeikoSwhich means 58 reviews23:11
@HeikoSand we have 1523:11
@HeikoSso 4 reviews pP23:11
@HeikoSand since they are short, that should be ok23:11
@HeikoSthe only other way is to say we ourselves review a lot of papers23:11
@HeikoSand every reviewer does 223:12
@HeikoSevery reviewer 2 reviews gives us one review per submission23:12
@HeikoSlisitsyn: ok23:13
@HeikoScan we copy in the reviewer names/contacts?23:13
lisitsynHeikoS: yes23:15
lisitsynHeikoS:  let me do that23:15
@HeikoSlisitsyn: so you wanna do 3? :)23:19
lisitsynHeikoS: dk23:19
lisitsyn2?23:19
@HeikoSagain, 2 each means 58 reviews23:19
@HeikoSwhich is 4 each23:20
@HeikoSthat seems to be the best compromise23:20
@HeikoSor?23:20
lisitsynI do not understand math23:20
lisitsyn:D23:20
lisitsynah ok23:20
@HeikoSand then we look at the submissions that have widely differing scores ourselves23:20
lisitsynHeikoS: let me try to link these columns23:20
@HeikoSI think we need to look at reviewers and their comments23:21
@HeikoSsome of them send comments on what to look at23:21
@HeikoSlike "python code only"23:21
lisitsynyay!23:21
lisitsynHeikoS: yeah it is easy23:22
@HeikoSactually23:22
@HeikoSwe can just do random assignemtn23:22
@HeikoSlooking at the comments23:22
@HeikoSlet's do that, is fastest :)23:22
lisitsynHeikoS: yes and then adjust23:22
@HeikoSok23:22
@HeikoSshall I just copy the names column twice next to the papers :)23:23
@HeikoSah I see what you are doing there23:23
@HeikoSlisitsyn: ping me when I should do something23:23
@HeikoShow to we send this back to pamela?23:23
lisitsynHeikoS: no idea yet23:24
@HeikoSlisitsyn: Franz Kirlay has 4 submissions crazy23:27
lisitsynHeikoS: yeah23:28
@HeikoSlisitsyn: ok whats happening?23:28
lisitsynHeikoS: I am trying to clean up reviewers list23:28
lisitsynfrom rejectees23:28
lisitsynargh23:28
@HeikoSjust move them aside?23:29
@HeikoSlisitsyn: btw did we check overlap of submitters and reviewers?23:30
lisitsynHeikoS: no23:30
@HeikoSshall I quickly do that?23:31
lisitsynHeikoS: let me try to randomize23:32
@HeikoS"; ".join(["; ".join(x.split(",")) for x in [ str (x) for x in pd.read_csv("Downloads/MLOSS 2018 Reviews - MLOSS_papers_10_09.csv")["authors"]]]).split(";")23:37
@HeikoSoh yeah23:37
lisitsynHeikoS: haha23:37
@HeikoSlisitsyn: ah damn it23:39
@HeikoSemail23:39
@HeikoSwe dont have reviewer names23:39
@HeikoSdo we have submission emails?23:39
@HeikoSlisitsyn: ?23:39
@HeikoSlisitsyn: anyways23:40
@HeikoSit seems you are almost there :)23:40
lisitsynHeikoS: ok lets fill in more reviewers and then reassign23:42
lisitsynand re-adjust23:42
@HeikoSok23:42
@HeikoSlisitsyn: do you have some check that everyone appears twice in there?23:43
lisitsynno23:43
lisitsynI am too stupid for this thing23:43
lisitsyn:D23:43
lisitsynrandomization was top of my skills23:43
@HeikoSlisitsyn: do we allow for reviewers to be submitters?23:43
@HeikoSno right?23:43
@HeikoSsince your collegue is23:43
@HeikoSboth23:43
@HeikoSshould be remove from reviewers actually23:43
lisitsynHeikoS: really? :)23:44
lisitsynuh23:44
lisitsynwhy?23:44
@HeikoSwhere are the submission emails?23:44
@HeikoSactually23:44
lisitsynHeikoS: I deleted this row23:44
@HeikoSno maybe it is ok23:44
lisitsyncan restore it23:44
@HeikoSno it is fine23:44
@HeikoSsame for nips23:44
@HeikoSI review and i submit23:44
@HeikoSall good23:44
@HeikoSlisitsyn: just re-asked marcus23:45
@HeikoSwho opted out since he submitted23:45
@HeikoSlisitsyn:  ok so23:45
@HeikoSlooks like it is dine?23:45
@HeikoSdone23:45
lisitsynno it is far from done23:46
lisitsynbut some progress is here23:46
lisitsyn:)23:46
lisitsynHeikoS: let me add more reviewers and do proper random assignment23:46
lisitsyntomorrow morning23:46
@HeikoSI mean23:46
@HeikoSjust dump the names in there twice23:46
@HeikoSand then we move them around23:46
@HeikoSuntil there is no double23:46
lisitsynyes23:46
@HeikoSrather than this withcery23:46
@HeikoSjust copy all the emails in twice23:46
@HeikoSin both rows23:46
@HeikoSand then we move without deleting23:47
@HeikoSlisitsyn: no good?23:47
lisitsynyeah good23:47
@HeikoSok do it and I will move23:47
@HeikoSand then we can sleep :)23:47
@HeikoSlisitsyn:  lol23:48
@HeikoSit keeps on changing23:48
@HeikoSlisitsyn:  on done :D23:49
lisitsynHeikoS: ok feel free to delete these columns23:49
@HeikoSwhich ones?23:50
@HeikoSlisitsyn: ?23:50
lisitsynHeikoS: mine23:50
@HeikoSlisitsyn: ok so23:51
@HeikoSeveryone now has 223:51
@HeikoSand we are missing 523:51
lisitsynHeikoS: add yourself23:52
lisitsyn:)23:52
@HeikoSI can put my own name down23:52
@HeikoSand yours23:52
@HeikoSok?23:52
lisitsynyeah23:53
@HeikoSlisitsyn: ok you got 423:53
lisitsynI am fine23:53
lisitsyn:)23:53
@HeikoSok23:53
@HeikoSpls check23:53
@HeikoSlisitsyn: every name in there will appear 4 times23:54
@HeikoSsince I just copied the column from sheet 123:54
@HeikoSthis looks ok to me23:54
@HeikoSnow let's send this to pam23:54
@HeikoSand ask for the checkboxes23:54
lisitsynHeikoS: is it random already?23:54
@HeikoSotherwise we have to change instructions saying that this has to be indicated in text23:55
@HeikoSlisitsyn: yes23:55
@HeikoSsince the column was random23:55
@HeikoSwith the emails23:55
@HeikoSalso who cares23:55
@HeikoSlooks random to me :)23:55
lisitsynHeikoS: let me randomize it and adjust tomorrow morning and then I'll send23:55
lisitsyn:)23:55
@HeikoSyou can easily randomize the columns23:55
@HeikoSjust make sure no paper has one person twice23:55
@HeikoSlisitsyn: we are sending instructions directly to reviewers right?23:56
lisitsynHeikoS: yeah I also wanted to check if we consider reviewer opinions23:56
lisitsynHeikoS: openreview can send mails too23:56
@HeikoSkind of23:56
@HeikoSlisitsyn: lets send instructions via openreview then23:56
@HeikoSbut we first need to ask for checkboxes23:56
@HeikoSotherwise the instructions ahve to change23:56
lisitsynHeikoS: do you really think we need that?23:56
@HeikoSit is so much easier23:56
lisitsynwell writing it is easy too23:57
lisitsyn:)23:57
@HeikoSthen we need to read all23:57
@HeikoSreviews23:57
@HeikoSwhich we dont want to23:57
@HeikoSwe want to average scores and we want the reccomendations for talk/etc23:57
@HeikoSand then we want to accept/reject the clear cases23:57
lisitsynah ok ok23:57
@HeikoSand then spend some time looking at those where reviewers dont agree23:57
@HeikoSlisitsyn: we should send the assignments our very soon23:58
@HeikoSso maybe email to pam first23:58
@HeikoSwith the names and all23:58
@HeikoSalready23:58
@HeikoSand then the request23:58
@HeikoSand also we can share the instructions googledoc23:58
@HeikoSOR23:59
@HeikoSwe just send the instructions23:59
@HeikoSseems easier to me23:59
@HeikoSbut I dont know23:59
@HeikoSmaybe not formal enough23:59
@HeikoSso let's send them to pam as well23:59
lisitsynI am lost23:59
@HeikoSlisitsyn:  sorry :)23:59
@HeikoScan you write an email to pam23:59
@HeikoSthat contains the assignments we just made23:59
@HeikoSand also the reviewer instructions23:59
--- Log closed Thu Oct 11 00:00:06 2018
« Tuesday, 2018-10-09 Index Thursday, 2018-10-11 »

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!