IRC logs of #shogun for Wednesday, 2018-05-23

--- Log opened Wed May 23 00:00:18 2018
-!- iglesiasg [~iglesias@f119189.upc-f.chello.nl] has quit [Quit: Leaving]01:02
-!- witness_ [uid10044@gateway/web/irccloud.com/x-zwsdyfqbdwzeepsy] has quit [Quit: Connection closed for inactivity]01:37
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Ping timeout: 260 seconds]03:06
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun03:07
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has joined #shogun08:31
shubham808Hello, today i will be working on fixing #428708:35
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]09:13
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has joined #shogun09:15
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4285 synchronized by vinx1309:43
shubham808HeikoS around ?09:51
@wikingshubham808, can i maybe help?09:59
shubham808@wiking hey10:00
@wikingho10:00
shubham808in #428710:01
@wikingyes10:02
shubham808heiko suggested we use the base class train method10:02
shubham808like CMachine::train10:03
@wikingah yeah i see10:03
shubham808but train will not work for locked data10:03
shubham808thats why the test fails10:03
@wikingyeah i wondered10:04
@wikingwhether all those assumptions/requirements are actually checked10:04
@wikingthat you've removed10:04
@wikinghttps://github.com/shogun-toolbox/shogun/pull/4287/files#diff-8fa006e637a70c2f9b9b026e3b4d39ecL16910:04
shubham808This is checked in CMachine https://github.com/shubham808/shogun/blob/738a505bc469a37e9f4ced25223fd457b00128ee/src/shogun/machine/Machine.cpp#L44 here10:05
@wikingoh ok10:05
@wikingok but wait10:06
@wikingthen lemm see the exact travis error10:06
@wikingas i'm not following yhet10:06
@wiking*yet10:06
shubham808okay10:06
@wikingi see10:07
@wiking"KernelRidgeRegression::train data_lock() was called, only train_locked() is possible. Call data_unlock if you want to call train()"10:07
shubham808yes10:07
@wikingah because originnaly10:08
@wikingall the kernelmachine was supporting only train_locked?10:08
@wikinghttps://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/machine/KernelMachine.cpp#L42210:08
shubham808seems so10:09
@wikingjust a sec10:10
@wikingi just wanna push something10:10
@wiking2 mins10:10
shubham808okay cool10:11
@wikingok nevermind10:12
@wikingi have to write a mini howto for it :D10:12
@wikinglemme see10:12
@wikingok10:13
@wikingthis is not what you want bool result = CMachine::train();10:14
@wikingin kernel machine10:14
@wikingas in kernel machine the original code is actually this bool result=train_machine();10:14
@wikingwhere train_machine is the overloaded train_machine of the actual KernelMachine10:14
shubham808yeah10:14
@wikingyou wanna call the upper class CMachine::train to connect some rx stuff10:15
@wikingno?10:15
shubham808yes exactly10:15
@wikingmmm10:15
@wikingwell10:16
shubham808but i cannot do that because train does not work with locked10:16
@wikingone option i see here10:16
@wikingis that you overload in similar fashion the CMachine::train_locked()10:16
@wikingwhere you actually connect the stuff10:17
@wikingetc etc10:17
@wikingthis is a quick fix10:17
@wikingbecause the problem is that KernelMachine needs train_locked10:17
@wikingwhere you dont want this10:17
@wikingif (m_data_locked)10:17
@wiking{10:17
@wikingSG_ERROR("%s::train data_lock() was called, only train_locked() is"10:17
@wiking" possible. Call data_unlock if you want to call train()\n",10:17
@wikingget_name());10:17
@wiking}10:17
shubham808so we will have both train() and train_locked() in CMachine10:19
shubham808something like that ?10:19
@wikingunfortunately seems like10:20
@wikingif you wanna handled in the same place the subscription10:20
@wikingwhich actually is a good thing to have10:20
@wiking(same place)10:20
shubham808we will still need it twice10:21
@wikingyeah10:23
@wikingbut at least its in the same place10:23
@wiking:)10:23
shubham808yeah10:24
shubham808doable10:24
-!- sukey1 [~nodebot@ks312251.kimsufi.com] has quit [Remote host closed the connection]10:36
-!- sukey [~nodebot@ks312251.kimsufi.com] has joined #shogun10:37
-!- mode/#shogun [+o sukey] by ChanServ10:37
-!- sukey [~nodebot@ks312251.kimsufi.com] has quit [Remote host closed the connection]10:37
-!- sukey [~nodebot@ks312251.kimsufi.com] has joined #shogun10:37
-!- mode/#shogun [+o sukey] by ChanServ10:38
-!- HeikoS [~heiko@eduroam-int-pat-8-249.ucl.ac.uk] has joined #shogun10:54
-!- mode/#shogun [+o HeikoS] by ChanServ10:54
@sukey[https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits:10:59
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/80c4e738eb009fd6e413de90b03a087686c0cd4910:59
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/b57160fe7228679df51904d07615571ba536a92110:59
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/e7300ab42511eea5cec14817e43942423d81c85510:59
@wikingHeikoS, check https://github.com/shogun-toolbox/shogun/commit/e7300ab42511eea5cec14817e43942423d81c85511:00
@wikingusing the same approach we can fix the unit test compilation time11:00
@wikingetc.11:00
wuweiwiking: hey11:01
@wikingwuwei, hello11:01
wuweinow my pr is almost done, there are some tests to be fixed11:02
@wikingwuwei, this patch should fix the problem https://github.com/shogun-toolbox/shogun/commit/80c4e738eb009fd6e413de90b03a087686c0cd4911:02
@wikingwith variant11:02
@wikinggreat11:02
@wikingi saw travis dying :)11:02
wuweiyeah, some tests, with ref counting issues11:03
wuweii'm still fixing them11:03
wuweiand doc is to be updated11:03
@wikingHeikoS, note that in this approach there's actually a separate binary for the benchmark if you create a _benchmark.cc11:04
wuweii'm getting weird error, in least angle regression test11:04
@HeikoSyeah I get it11:04
@HeikoSwiking: thats good11:04
@wikingmeaning the compileation time is way faster if you just wanna test your own module's benchmark11:04
@HeikoSyep good!11:05
@wikingsame should be done for unit test11:05
@wikingi.e. they should be moved out from tests/unit11:05
@wikingetc11:05
@HeikoSyes, I agree11:05
@HeikoSI remember discussing this with you11:05
wuweithat two matrix have a pointer to the same memory area, but have different refcount instance11:05
@wikingctest -L benchmark will run all the benchmarks11:05
@HeikoSwould be better to have them isolated for each file11:05
@HeikoSbetter workflow11:06
@wikingwell once this is .so based plugin11:06
@wikingthen actually it only makes sense to do it likes this11:06
@wikingas currently it's very awkward11:06
@wikingthat the gpl sources have their tests in the main repo11:06
@wikingHeikoS, for future reference: NEWS uses as any other code in shogun \t instead of spaces for indenting11:08
@wikingwuwei, mmm how's that possible? :) somebody override the .matrix manuall?11:18
@wikingsomewhere?11:18
wuweiI don't know, still debugging that11:20
wuweiNot sure if I am doing anything wrong, the test fails after I updated the test using apply11:20
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]11:24
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has joined #shogun11:25
@HeikoSshubham808: hi! :)11:30
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]11:39
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has joined #shogun11:40
shubham808hey11:40
shubham808i am overloading train_locked too11:41
-!- travis-ci [~travis-ci@ec2-54-90-79-5.compute-1.amazonaws.com] has joined #shogun11:46
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/38256628211:46
-!- travis-ci [~travis-ci@ec2-54-90-79-5.compute-1.amazonaws.com] has left #shogun []11:46
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4287 synchronized by shubham80811:49
@HeikoSshubham808: can you explain a bit your reasoning for the train_locked thing?11:54
@wikingHeikoS, see my reasoning in logs11:54
@wikingbasically CMachine::train() asserts the data not being locked11:54
@wikingwhile KernelMachine::train is working on locked11:54
@wikingso calling CMachine::train() from KernelMachine::train_locked is foobar11:55
@HeikoSthe new CMachine::train_locked seems to to exactly the same as CMachine::train?12:00
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4287 synchronized by shubham80812:01
shubham808it is for data locked12:01
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4287 synchronized by shubham80812:03
@HeikoSah the check is different12:04
@HeikoSjust realised12:04
@HeikoSyeah ok then12:04
@HeikoS+112:04
@HeikoSsome minor comments on the PR12:04
shubham808yeah i addressed them12:05
@wikingHeikoS, well it shouldn't be exactly the same12:06
@wikinge.g. -    if (m_data_locked)12:06
@wiking+if (m_compute_bias)12:06
@wiking-    {12:06
@wiking+compute_bias(data);12:06
@wiking-    SG_ERROR("train data_lock() was called, only train_locked() is"12:06
@wiking-    " possible. Call data_unlock if you want to call train()\n",12:06
@wiking-    get_name());12:06
@wiking-    }12:06
@wikingif (m_data_locked) SG_ERROR is not part of it12:06
@wikingwhich is in case of CMachine::train12:06
@HeikoSi got it12:06
-shogun-buildbot:#shogun- Build deb3 - interfaces #336 is complete: Success [build successful] - http://buildbot.shogun-toolbox.org:8080/#builders/37/builds/33612:12
-!- travis-ci [~travis-ci@ec2-54-90-79-5.compute-1.amazonaws.com] has joined #shogun12:13
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/38256628212:13
-!- travis-ci [~travis-ci@ec2-54-90-79-5.compute-1.amazonaws.com] has left #shogun []12:13
-!- HeikoS [~heiko@eduroam-int-pat-8-249.ucl.ac.uk] has quit [Ping timeout: 256 seconds]12:15
-!- HeikoS [~heiko@untrust-out.swc.ucl.ac.uk] has joined #shogun12:52
-!- mode/#shogun [+o HeikoS] by ChanServ12:52
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]13:03
@wikingoh yeah wuwei ^ interface builder is back to green13:07
wuweiwiking: i've figured out what's happening with ref count13:09
@wikingwhat happened? :)13:09
wuweihttps://github.com/vinx13/shogun/blob/28d261c67b8e8e4bb9635e15a69ba31a93f4d5db/src/shogun/preprocessor/PruneVarSubMean.cpp#L10913:09
wuweiit's my fault13:09
@wikingoh yea i see13:09
@wikingit should be false :)13:09
@wikingi mean with refcount13:09
@wikingbtw we should add benchmark test for refcount13:09
@wikingas currently it seems13:09
@wikinglemme add it:D13:10
wuweiyeah but in this way the refcount is not increased13:10
@wikingyeah13:11
wuweicould u suggest some fix?13:11
@wikingok you need refcount++13:11
@wikingor you dont want refcount?13:11
@wikingyou could just use this13:12
@wikingSGMatrix(T* m, index_t nrows, index_t ncols, bool ref_counting=true);13:12
wuweii think we should refcount++13:12
@wikingbasically13:12
wuweiinstead of creating another refcount instance13:12
@wikingSGMatrix<float64_t> result(matrix.data(), m_num_idx, num_vectors, false);13:12
@wikingand then before this13:12
@wikingok this should be enough13:13
@wikingactually13:13
@wikingimo13:13
@wikingmmmm13:14
@wikingbtw why do you need the separate SGMatrix<float64_t> result?13:14
@wikingif it's just a wrapper around the input SGMatrix<float64_t> matrix?13:14
wuweigreat! refcount=false works13:15
@wikingauto v_src = matrix.get_column(i);13:15
@wikingauto v_dst = matrix.get_column(i);13:15
@wikingi'm not so sure why do we need this? :)13:15
@wikingif its the same13:15
@wiking:)13:15
wuweithe dimention changed between input / output13:16
wuweiwe need get_column return vector with the right dim13:16
wuweiwell..  nevermind in this case13:17
@wikingi mean its actually the very same thing :)13:18
wuweiyeah simply changing dim of input matrix also works13:19
@wikingfor all gsoc students https://github.com/boostcon/cppnow_presentations_2018/blob/master/05-10-2018_thursday/debug_cpp_w_o_running__anastasia_kazakova__cppnow_05102018.pdf13:37
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4285 synchronized by vinx1314:05
wuweiwiking: this line is broken in interface https://github.com/vinx13/shogun/blob/9e89c72ba2ad8ee2847d2f1a7075a0e98764da88/examples/meta/src/regression/least_angle_regression.sg#L1714:52
wuweihow to deal with that in interface14:52
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3495 closed by karlnapf15:04
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4287 synchronized by shubham80815:09
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has joined #shogun15:12
@HeikoSshubham808: how are things going?15:15
shubham808the comment now just says "This computes the kernel matrix"15:15
shubham808also i used require in CMachine::train and train_locked15:15
shubham808ah damn15:17
shubham808i missed something15:17
shubham808i will fix it then the pr should be good15:18
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4287 synchronized by shubham80815:20
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]15:30
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has joined #shogun15:31
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4297 opened by shubham80815:35
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4287 synchronized by shubham80815:46
wuweiheiko: hey16:02
@HeikoSwuwei: hi16:06
@HeikoSwuwei: so wrap is not used ?16:07
wuweiyeah16:07
wuweiit's actually an assignment expr16:07
@HeikoSwuwei: https://github.com/shogun-toolbox/shogun/blob/develop/examples/meta/generator/targets/cpp.json#L4416:08
wuweiassignment : identifier EQUALS expr16:08
@HeikoScould you try changing this16:08
@HeikoSand see whether the cpp examples still compille16:08
@HeikoSwuwei: the alternative would be that you declare a new variable in the example16:09
@HeikoSrather than overwriting the old one16:09
@HeikoSsee what I mean16:09
@HeikoS?16:09
wuweiwell.. does that break things, if you always use wrap in assignment16:09
wuweiyeah a new variable is a quickfix16:09
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]16:12
wuweiheiko: chaning translation rule for assignment works.. but now everything is wrapped, like wrap(1.0)16:23
@HeikoSeverything compiles and runs?16:30
@HeikoSwuwei: yes everything is wrapped this way16:30
@HeikoSugly16:30
@HeikoSbut wrap will go once we have smart pointers ready in swig16:30
wuweiyes16:30
wuweithey works but ugly16:30
-!- Elfarouk [9cc4e4dd@gateway/web/freenode/ip.156.196.228.221] has joined #shogun16:31
@HeikoSI leave it for you to choose :) either you do a new variable (I prefer that), or we use wrap in every assignment16:31
@HeikoSElfarouk: hi16:32
ElfaroukHey HeikoS16:32
ElfaroukHeiko*16:32
wuweiif using a new variable name, then there will be six names.. feats_train, feats_train_processed1, feats_train_processed2 :(16:33
@HeikoSwuwei: lol I see16:33
@HeikoSwuwei: if we keep the raw pointer, it will memory leak, right?16:33
@HeikoSwhich is also fine btw16:33
@HeikoSfor the examples, they do leak already16:33
@HeikoSand again, the smart pointer in swig will solve that16:33
@HeikoSwuwei: or doenst that work?16:34
@HeikoSwuwei: just leaving the raw pointer?16:34
wuweino memory leak, the input is unrefed in apply16:34
wuweiso the input becomes invalid after that16:34
@HeikoSso it segfaults?16:34
wuweiwell.. let me try16:35
@HeikoSwuwei: no that sucks as well16:35
@HeikoSas it is an example that people will use16:35
@HeikoSI think I prefer the wrap in assignment as an intermediate solution then16:36
@HeikoSuntil we have smart pointers16:36
@HeikoSElfarouk: could you also send your summary / website to the list?16:36
@HeikoSweekly thing I mean16:36
wuweisure16:36
ElfaroukHeikoS: Sure, will finish addressing the comments in the cookbook and send it (y)16:38
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4297 closed by karlnapf16:39
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4297 reopened by karlnapf16:39
@HeikoSElfarouk: merci16:39
ElfaroukAlso sorry for the "Fixed" comments, didn't realize it sends you an email for each one16:39
ElfaroukI was just mentally keeping track of which ones I've handled16:39
@HeikoSElfarouk: no worries16:43
@wikingdo we have a datagenerator for SparseFeatures?16:50
@HeikoSwiking: dont think so16:57
@wikingnvm16:58
@wikingthnx16:58
@sukey[https://github.com/shogun-toolbox/shogun] vigsterkr pushed 2 commits:16:59
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/470b35c92b7036c144d8baaf76ec12ad98f2480b16:59
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/6721b610bfea608fc98cec9d225d3b667a75484b16:59
@wikingtada16:59
@wikingcrazy that this type of stuff16:59
@wikingwent in :D17:00
@HeikoSnice!17:02
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/4298 karlnapf added label: "testing"17:06
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/4298 opened by karlnapf17:06
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3537 closed by karlnapf17:08
-!- Elfarouk [9cc4e4dd@gateway/web/freenode/ip.156.196.228.221] has quit [Ping timeout: 260 seconds]17:10
@wikingwuwei, i've missed our meeting at 1100 :facepalm:17:35
@wikingnext time plz ping me17:35
@wiking:D17:35
wuweisure nevermind17:36
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4285 synchronized by vinx1317:53
-!- HeikoS [~heiko@untrust-out.swc.ucl.ac.uk] has quit [Ping timeout: 252 seconds]18:18
-!- Elfarouk [9cc4acab@gateway/web/freenode/ip.156.196.172.171] has joined #shogun18:19
ElfaroukI have a question, in the new API, what would: AccuracyMeasure evaluation_criterion() change to?18:24
Elfaroukcause I looked at all the files that were changed to the new API in cross validation and they just had it as: AccuracyMeasure evaluation_criterion()18:24
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has joined #shogun18:54
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4297 synchronized by shubham80819:30
-!- shubham808 [0e8bf0fb@gateway/web/cgi-irc/kiwiirc.com/ip.14.139.240.251] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]19:35
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/4299 opened by FaroukY19:39
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/429919:40
-!- Elfarouk [9cc4acab@gateway/web/freenode/ip.156.196.172.171] has quit [Ping timeout: 260 seconds]20:13
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4206 synchronized by FaroukY20:23
-!- Elfarouk [9cc21215@gateway/web/freenode/ip.156.194.18.21] has joined #shogun20:31
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4206 synchronized by FaroukY20:42
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4294 synchronized by FaroukY21:53
@wikingElfarouk, mmmm21:55
@wikingwe had a baseclass21:55
@wikinglike measurement whatever21:55
@wikinglemme see21:55
@wikingah no21:56
@wiking:(21:56
Elfaroukwiking, This is still being update, didn't address all comments. just did a few changes and clang-format21:56
Elfaroukcause atom was introducing so much whitespace and irregular tabs21:57
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4293 synchronized by geektoni22:09
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4293 synchronized by geektoni22:15
-!- Elfarouk [9cc21215@gateway/web/freenode/ip.156.194.18.21] has quit [Quit: Page closed]22:18
--- Log closed Thu May 24 00:00:19 2018

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!