IRC logs of #shogun for Sunday, 2013-09-29

--- Log opened Sun Sep 29 00:00:19 2013
shogun-notifier-shogun: Soeren Sonnenburg :develop * 4c446fb / CMakeLists.txt,examples/undocumented/libshogun/Makefile: https://github.com/shogun-toolbox/shogun/commit/4c446fb49381fe24f87977487fdb17539f7cd5ae00:13
shogun-notifier-shogun: disable SSE on CYGWIN00:13
@sonney2kwiking, ^ that should fix the build on cygwin00:13
@sonney2khushell, in case you are awake - could you please remove the pickle.dump code from your notebook?00:16
@sonney2kshogun-buildbot: force build --branch=develop 'cyg1 - libshogun'00:18
shogun-buildbotbuild #1552 forced00:18
shogun-buildbotI'll give a shout when the build finishes00:18
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has joined #shogun00:19
-!- mode/#shogun [+o iglesiasg] by ChanServ00:19
@iglesiasghushell, hi there00:19
shogun-buildbotbuild #548 of nightly_default is complete: Failure [failed updatedoc notebooks]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/54800:24
@sonney2kiglesiasg, do you know how to edit ipython notebooks?00:39
@iglesiasgsonney2k, yes00:39
@iglesiasgdo ipython notebook in the directory where the ipynb file is00:39
@iglesiasgand then in the browser click on the notebooks's name you want to edit00:39
shogun-notifier-shogun: Soeren Sonnenburg :develop * 50f3914 / data: https://github.com/shogun-toolbox/shogun/commit/50f3914e4aa55358cfa7d531c3410fa7ec34aec700:40
shogun-notifier-shogun: require new data version00:40
@sonney2kiglesiasg, now notebooks are being build and we get error msgs: http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/548/steps/notebooks/logs/stdio00:40
@iglesiasgI see00:41
@sonney2kiglesiasg, and as you can see the path name for the Image.open is wrong for the bss_image example00:41
@iglesiasgaham yeah00:41
@sonney2kand i the FGM00:41
@sonney2kit fails to pickle.dump the result00:42
@sonney2kso these need fixing00:42
shogun-buildbotbuild #62 of clang34 - static analysis is complete: Failure [failed analyse]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/62  blamelist: Soeren Sonnenburg <sonne@debian.org>00:42
@sonney2kiglesiasg, I dont' get though why lambday's logdet is not working00:42
@sonney2kit says invalid JSON00:42
@sonney2kiglesiasg, and then finally yours00:43
@sonney2kLMNN is taking > 1200s00:43
@sonney2kbuildbot timeout00:43
@sonney2kand killed00:43
@iglesiasgsonne|work, yep. As i mentioned in the message yesterday, I have to fix that.00:43
@iglesiasgIt is my next thing in the list IIRC, should be able to do it tom00:44
@sonney2kiglesiasg, the sooner the better thanks00:44
@iglesiasgI am just going to cut down the dimensions that are used and ensure that it takes less time00:44
@iglesiasgsonney2k, the problem is that there are many outer products computed and the dimension here is 1472 or so00:44
@iglesiasgouter product is quadratic in the dimension so it turns out to be quite slow00:44
@sonney2kiglesiasg, and this is already done in parallel as I've seen00:45
@iglesiasgso I just have to find a number of dimensions such that it can be computed fast enough for the purpose in the notebook, but also so the example remains meaningful00:45
@iglesiasgsonney2k, parallelized in my code?00:45
@sonney2kiglesiasg, well the process had load 800:46
@sonney2kso I guess so00:46
@iglesiasgmmmm00:46
@iglesiasgI didn't do anything to parallelize it :)00:46
@iglesiasgmaybe Eigen does something automatically about it?00:46
@iglesiasglisitsyn, Eigen expert! :) ^00:46
@sonney2kiglesiasg, could you please do one thing00:48
@sonney2kiglesiasg, go to shogun/doc/ipython-notebooks/logdet00:48
@sonney2kand then ipython notebook and open that thing00:48
@sonney2kit always says here JSON error00:49
@iglesiasgsonney2k, all right. Let me try it00:49
@sonney2kso maybe the file is corrupt00:49
@sonney2kiglesiasg, and?00:51
@iglesiasgsonney2k, I cannot load the notebook even00:51
@sonney2kiglesiasg, exactly00:51
@sonney2kso I am removing it00:52
@iglesiasgAn unknown error occurred while loading this notebook. This version can load notebook formats v3 or earlier.00:52
@iglesiasgsonney2k, maybe it happens because lambday made some edit of the ipynb manually00:52
shogun-notifier-shogun: Soeren Sonnenburg :develop * 7ad393e / doc/ipython-notebooks/ (2 files): https://github.com/shogun-toolbox/shogun/commit/7ad393e8da91ee289984b4bb292ce1fa07c81c7800:53
shogun-notifier-shogun: Fix ipython notebooks00:53
shogun-notifier-shogun:00:53
shogun-notifier-shogun: - drop corrupt logdet.ipynb00:53
shogun-notifier-shogun: - don't pickle dump/load results in FGM00:53
@iglesiasgI have experimented doing that and seen that error in the browser when I screwed an edit00:53
@sonney2kiglesiasg, maybe... no idea00:53
shogun-buildbotbuild #1552 of cyg1 - libshogun is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/cyg1%20-%20libshogun/builds/155200:55
@sonney2khurray00:56
@sonney2kcyg1 is green00:56
@sonney2kfor the first time in 100 years :D00:56
@iglesiasghaha yeah00:56
@sonney2kand only 3400 warnings00:56
@iglesiasg"only"00:57
@iglesiasgsonney2k, I am running LMNN in the same data set in my laptop right now and monitoring top01:07
@iglesiasgone process and over 300% CPU01:08
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has quit [Quit: Ex-Chat]01:09
-!- iglesiasg_ [~iglesias@s83-179-44-135.cust.tele2.se] has joined #shogun01:09
iglesiasg_so there is some parallelization taking place in there01:10
-!- iglesiasg_ is now known as iglesiasg01:10
iglesiasgjust google it, it seems that Eigen does some parallelization in matrix-matrix operations01:12
iglesiasgI've just googled* it, I meant01:13
iglesiasgall right, I am off now. See ya!01:14
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has quit [Client Quit]01:14
-!- AndChat49209 [~AndChat49@dab-bas1-h-1-5.dab.02.net] has joined #shogun01:26
-!- AndChat49209 [~AndChat49@dab-bas1-h-1-5.dab.02.net] has quit [Client Quit]01:26
-!- AndChat|49209 [~AndChat49@dab-hlw1-h-36-9.dab.02.net] has quit [Ping timeout: 256 seconds]01:28
shogun-buildbotbuild #45 of clang34 - thread analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/45  blamelist: Soeren Sonnenburg <sonne@debian.org>02:03
-!- new_lido [~walid@41.218.180.72] has quit [Ping timeout: 248 seconds]02:22
-!- travis-ci [~travis-ci@ec2-107-20-121-49.compute-1.amazonaws.com] has joined #shogun02:33
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/1191436302:33
-!- travis-ci [~travis-ci@ec2-107-20-121-49.compute-1.amazonaws.com] has left #shogun []02:33
-!- new_lido [~walid@41.218.173.134] has joined #shogun02:35
shogun-buildbotbuild #63 of clang34 - static analysis is complete: Failure [failed analyse]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/63  blamelist: Soeren Sonnenburg <sonne@debian.org>02:46
shogun-buildbotbuild #42 of clang34 - undefined behaviour analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/42  blamelist: Soeren Sonnenburg <sonne@debian.org>02:55
shogun-buildbotbuild #470 of nightly_all is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_all/builds/47003:08
shogun-buildbotbuild #549 of nightly_default is complete: Failure [failed updatedoc notebooks]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/54903:39
-!- sonne|osx_ [~sonne@g225081177.adsl.alicedsl.de] has joined #shogun03:45
-!- sonne|osx [~sonne@f053047221.adsl.alicedsl.de] has quit [Ping timeout: 248 seconds]03:47
-!- sonne|osx_ is now known as sonne|osx03:47
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]03:53
-!- zxtx [~zv@c-50-133-182-155.hsd1.ma.comcast.net] has joined #shogun05:09
-!- zxtx [~zv@c-50-133-182-155.hsd1.ma.comcast.net] has quit [Remote host closed the connection]05:09
-!- gsomix [~gsomix@178.45.81.222] has quit [Read error: Connection reset by peer]06:55
-!- lambday [67157f4c@gateway/web/freenode/ip.103.21.127.76] has joined #shogun07:34
-!- lambday [67157f4c@gateway/web/freenode/ip.103.21.127.76] has quit [Ping timeout: 250 seconds]07:39
-!- lambday [67157e4c@gateway/web/freenode/ip.103.21.126.76] has joined #shogun08:33
lambdaysonne|osx: moin moin08:33
lambdaysonne|osx: fixed the broken notebook08:33
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]08:34
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun08:34
lambdaylisitsyn: hi08:35
lambdaylisitsyn: for submitting the code samples, I collected the patches using git format-patch -1 <hash> for all my commit hash.. would that do?08:36
wikingsonne|osx: ping08:41
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]08:44
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun08:44
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Client Quit]08:45
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has joined #shogun08:45
wikingshogun-buildbot: force build --branch=develop 'nightly_default'08:59
wikingshogun-buildbot_ force build --branch=develop 'nightly_default'08:59
wikingshogun-buildbot_: force build --branch=develop 'nightly_default'09:00
shogun-buildbot_build #550 forced09:00
shogun-buildbot_I'll give a shout when the build finishes09:00
shogun-buildbot_build #550 of nightly_default is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/55009:07
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]09:11
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun09:12
wikingshogun-buildbot: force build --branch=develop 'nightly_default'09:12
shogun-buildbotbuild forced [ETA 6m50s]09:12
shogun-buildbotI'll give a shout when the build finishes09:12
shogun-buildbotHey! build nightly_default #551 is complete: Success [build successful]09:19
shogun-buildbotBuild details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/55109:19
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]09:20
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun09:20
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Client Quit]09:21
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun09:21
wikingshogun-buildbot: force build --branch=develop 'nightly_default'09:21
shogun-buildbotbuild forced [ETA 6m54s]09:21
shogun-buildbotI'll give a shout when the build finishes09:21
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Client Quit]09:25
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun09:25
wikingshogun-buildbot: force build --branch=develop 'nightly_default'09:28
shogun-buildbotbuild forced [ETA 6m55s]09:28
shogun-buildbotI'll give a shout when the build finishes09:28
shogun-buildbotbuild #553 of nightly_default is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/55309:35
-!- besser82 [~besser82@fedora/besser82] has joined #shogun09:36
hushellsonney2k: Sorry I just went back home, pickle.dump is not allowed?09:36
@sonney2khushell, no please fix the notebook if you can10:04
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun10:06
shogun-notifier-shogun: Soeren Sonnenburg :develop * 93ba0ed / doc/ipython-notebooks/structure/FGM.ipynb: https://github.com/shogun-toolbox/shogun/commit/93ba0ed097f8dab6a5f777e305cf2eb62ef82bee10:06
shogun-notifier-shogun: another attempt to fix FGM10:06
shogun-notifier-shogun: lambday :develop * 6a1b8d9 / doc/ipython-notebooks/logdet/logdet.ipynb: https://github.com/shogun-toolbox/shogun/commit/6a1b8d964c9596567e5187282a142ac04cc67de910:10
shogun-notifier-shogun: log-det ipython notebook json error fixed10:10
shogun-notifier-shogun: Soeren Sonnenburg :develop * 9bfee5f / doc/ipython-notebooks/logdet/logdet.ipynb: https://github.com/shogun-toolbox/shogun/commit/9bfee5f2c9d243d0c845f5590b00623436749a3510:10
shogun-notifier-shogun: Merge pull request #1692 from lambday/develop10:10
shogun-notifier-shogun:10:10
shogun-notifier-shogun: log-det ipython notebook json error fixed10:10
hushellsonney2k: then how do I save something? e.g. the model parameters10:14
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]10:15
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun10:15
wikingshogun-buildbot: force build --branch=develop 'nightly_default'10:15
shogun-buildbotThe build has been queued, I'll give a shout when it starts10:15
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Client Quit]10:15
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun10:16
hushellsonney2k: I have prepared the new PR, but can I wait until the SGD PR merged? But I am fine if you want to fix the pickle.dump first.10:20
shogun-buildbotbuild #1835 of bsd1 - libshogun is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/bsd1%20-%20libshogun/builds/1835  blamelist: Soeren Sonnenburg <sonne@debian.org>10:21
wikingshogun-buildbot: force build --branch=develop 'nightly_default'10:24
shogun-buildbotThe build has been queued, I'll give a shout when it starts10:24
wikingsonney2k: can u plz edit the /usr/local/bin/install-latest-shogun-doc.sh or chmod it so that buildbot user can write it and then i'll change it...10:26
@sonney2kwiking, all notebooks fail again http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/553/steps/notebooks/logs/stdio10:28
@sonney2kI guess you changed sth10:28
wikingsonney2k: yes i'm working on it atm...10:30
-!- lambday [67157e4c@gateway/web/freenode/ip.103.21.126.76] has quit [Ping timeout: 250 seconds]10:39
shogun-buildbotbuild forced [ETA 6m55s]11:08
shogun-buildbotI'll give a shout when the build finishes11:08
-!- travis-ci [~travis-ci@ec2-107-20-106-168.compute-1.amazonaws.com] has joined #shogun11:20
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/1192228311:20
-!- travis-ci [~travis-ci@ec2-107-20-106-168.compute-1.amazonaws.com] has left #shogun []11:20
shogun-buildbotbuild #43 of clang34 - undefined behaviour analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/43  blamelist: Soeren Sonnenburg <sonne@debian.org>11:20
shogun-buildbotbuild #46 of clang34 - thread analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/46  blamelist: Soeren Sonnenburg <sonne@debian.org>11:48
-!- travis-ci [~travis-ci@ec2-107-20-106-168.compute-1.amazonaws.com] has joined #shogun11:51
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/1192235211:51
-!- travis-ci [~travis-ci@ec2-107-20-106-168.compute-1.amazonaws.com] has left #shogun []11:51
shogun-buildbotbuild #554 of nightly_default is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/55411:57
shogun-buildbotbuild #1836 of bsd1 - libshogun is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/bsd1%20-%20libshogun/builds/183612:05
wikingokkeeey sonney2k the notebooks are fine now12:16
wikingsonney2k: can u plz chown buildbot:buildbot /usr/local/bin/install-latest-shogun-doc.sh12:16
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]12:18
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun12:18
shogun-buildbotbuild #1555 of cyg1 - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/cyg1%20-%20libshogun/builds/1555  blamelist: lambday <heavensdevil6909@gmail.com>, Soeren Sonnenburg <sonne@debian.org>12:19
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has joined #shogun12:21
-!- mode/#shogun [+o iglesiasg] by ChanServ12:21
@iglesiasghi guys12:21
shogun-notifier-shogun: Viktor Gal :develop * 5e4721c / CMakeLists.txt,src/shogun/lib/config.h.in: https://github.com/shogun-toolbox/shogun/commit/5e4721cf083c925d5edb0901c19e64c96ecf55da12:30
shogun-notifier-shogun: Attempt to fix issue #162512:30
shogun-notifier-shogun: rename macro USE_HMMPARALLELSTRUCTURES -> USE_HMMPARALLEL_STRUCTURES as12:30
shogun-notifier-shogun: it is used in HMM.cpp12:30
wikingiglesiasg: hey12:31
@iglesiasgwiking, what's up12:31
wikingwe are getting 1 cell error in LMNN notebook12:31
@iglesiasgwiking, yeah, too much time, right?12:32
wikinghttps://github.com/shogun-toolbox/shogun/issues/1687#issuecomment-2531799312:32
@iglesiasgwiking, I am on it right now. I am going to see if it gets fast enough reducing the number of features used12:32
wikingthis one is failing atm12:33
@iglesiasgwiking, "failing"12:33
@iglesiasgI think it is simply timing out12:33
wikingokey12:33
wikingi'm just copy-pasting :P12:33
@iglesiasgbut anyway, yes. Let me do something about it12:33
wikingno idea what's happening in depth12:33
wikingiglesiasg: btw i dont think it's timeout problem12:34
wikingas it was running for real25m1.033s12:34
wiking25mins12:34
wikingiglesiasg: http://www.shogun-toolbox.org/static/notebook/current/LMNN.html12:34
@iglesiasgwiking, http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/548/steps/notebooks/logs/stdio12:34
wikingthis the current output12:34
@iglesiasgwiking, check the very last thing12:34
wikinghttp://buildbot.shogun-toolbox.org/builders/nightly_default/builds/554/steps/notebooks/logs/stdio12:34
wikingthis is the last build12:34
@iglesiasgall right12:34
wikingas u can see from the html12:35
wikinghttp://www.shogun-toolbox.org/static/notebook/current/LMNN.html#Multiclass-classification12:35
wikingthe second cell doesn't have an output12:35
@iglesiasgweird12:36
shogun-buildbotbuild #64 of clang34 - static analysis is complete: Failure [failed analyse]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/64  blamelist: Soeren Sonnenburg <sonne@debian.org>12:36
@iglesiasgwiking, it is not the only one without output though12:36
wikingyeah realised in the meanwhile :((12:37
@iglesiasgwiking, mmm the output is weird12:37
@iglesiasgit is not aligned with the corresponding cell12:38
wikinghuh12:38
@iglesiasgwiking, see for instance the cell you told me that it doesn't have output12:38
wikingit's shifted or what?12:38
@iglesiasgit has it, but it appears after the next cell12:38
wikingiglesiasg: ooooh12:39
wikingyeah12:39
wikingi see12:39
wikinglet's check the ipynb12:39
@iglesiasgno idea why that is happening12:39
@iglesiasgbut actually in that HTML everything went fine I think12:39
wikinghttp://www.shogun-toolbox.org/static/notebook/current/LMNN.ipynb12:40
@iglesiasgwiking, in the ipynb it is like that as well12:41
wikingyeah as suspected the generated ipynb has a problem :(12:41
@iglesiasgyes12:41
wikingi wonder why's that12:41
@iglesiasgmy bet is that it is because of the time12:41
@iglesiasgI mean we are seeing weird behaviour, sometimes it fails because of time out12:42
wikingyeah12:42
@iglesiasgsometimes it doesn't but the output is cell-shifted12:42
wikingiglesiasg: there's a 1000s timeout currently12:42
@iglesiasgwiking, for the whole notebook?12:42
@iglesiasgor waiting for a cell's output?12:42
wikingcell12:43
@iglesiasgwiking, it should be more than enough actually. In my computer it takes half that time12:43
@iglesiasgwiking, but I guess the buildbot is just very loaded12:43
@iglesiasgwiking, so let me reduce the number of dimensions and experiment a bit with the time12:43
wikingok maybe there's still a little problem with the timeout settings12:45
@iglesiasgwiking, what is it?12:47
wikingi've changed another timeout number in the generator script12:47
wikingmaaaybe it'll fix it12:47
wikingi'm not 100%12:47
@iglesiasgwiking, ok12:48
@iglesiasgso I wait then :)12:48
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]13:17
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun13:17
-!- new_lido [~walid@41.218.173.134] has quit [Ping timeout: 256 seconds]13:27
-!- new_lido [~walid@41.218.173.134] has joined #shogun13:34
@iglesiasgwiking, do we have to wait for nightly to get results about this?13:38
shogun-buildbotbuild #44 of clang34 - undefined behaviour analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/44  blamelist: lambday <heavensdevil6909@gmail.com>, Soeren Sonnenburg <sonne@debian.org>13:41
@iglesiasgwiking, I have just made some tests, and using 500 features training takes about 40 seconds in my machine and the feature selection is still good13:43
@iglesiasgso I can easily update the notebook to do it this way13:43
@iglesiasgin case problems with the time out persist13:43
@iglesiasgall right, I will be back later. See you!13:46
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has quit [Quit: Ex-Chat]13:46
-!- lambday [67157c4c@gateway/web/freenode/ip.103.21.124.76] has joined #shogun13:53
lambdaywiking: hi13:53
lambdaysonne|osx: wiking: the failing notebook cells are because of a dependency on colpack graph coloring library13:53
-!- new_lido [~walid@41.218.173.134] has quit [Ping timeout: 240 seconds]13:56
-!- new_lido [~walid@41.218.173.134] has joined #shogun13:57
shogun-buildbotbuild #47 of clang34 - thread analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/47  blamelist: lambday <heavensdevil6909@gmail.com>, Soeren Sonnenburg <sonne@debian.org>14:04
shogun-buildbotbuild #1556 of cyg1 - libshogun is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/cyg1%20-%20libshogun/builds/155614:08
-!- lambday [67157c4c@gateway/web/freenode/ip.103.21.124.76] has quit [Ping timeout: 250 seconds]14:11
-!- new_lido [~walid@41.218.173.134] has quit [Ping timeout: 240 seconds]14:12
-!- new_lido [~walid@41.218.173.134] has joined #shogun14:13
-!- new_lido [~walid@41.218.173.134] has quit [Client Quit]14:16
shogun-buildbotbuild #65 of clang34 - static analysis is complete: Failure [failed analyse]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/65  blamelist: lambday <heavensdevil6909@gmail.com>, Soeren Sonnenburg <sonne@debian.org>14:48
-!- hushell [~hushell@c-98-232-178-161.hsd1.or.comcast.net] has quit [Ping timeout: 248 seconds]15:11
-!- pickle27 [~Kevin@zaq31faa991.zaq.ne.jp] has joined #shogun15:20
shogun-buildbotbuild #1914 of deb3 - modular_interfaces is complete: Failure [failed test ruby modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb3%20-%20modular_interfaces/builds/1914  blamelist: Viktor Gal <viktor.gal@maeth.com>15:23
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]15:30
-!- van51 [~van51@athedsl-409794.home.otenet.gr] has joined #shogun15:50
-!- besser82 [~besser82@fedora/besser82] has quit [Ping timeout: 245 seconds]16:03
-!- pickle27 [~Kevin@zaq31faa991.zaq.ne.jp] has quit [Quit: Leaving]16:25
-!- gsomix [~gsomix@80.234.64.47] has joined #shogun16:46
gsomixgood evening16:46
-!- gsomix [~gsomix@80.234.64.47] has quit [Ping timeout: 264 seconds]17:24
-!- lisitsyn [~lisitsyn@213.178.35.165] has quit [Quit: Leaving.]17:26
-!- gsomix [~gsomix@5850-AMTS-2-43.dialup.samtel.ru] has joined #shogun17:37
@sonney2kvan51, will you be around in the evening (in 2-3 hrs)?18:10
@sonney2kwiking, our sse2 detection is b0rken - that is why cygwin was failing18:11
@sonney2kwiking, I only did a workaround disabling sse2 on cygwin18:11
van51sonney2k: probably yeah18:11
-!- hushell [~hushell@c-98-232-178-161.hsd1.or.comcast.net] has joined #shogun19:15
@sonney2kshogun-buildbot: force build --branch=develop 'nightly_default'19:47
shogun-buildbotbuild forced [ETA 27m30s]19:47
shogun-buildbotI'll give a shout when the build finishes19:47
shogun-buildbotbuild #555 of nightly_default is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/55519:49
van51sonney2k: ping19:54
@sonney2kshogun-buildbot: force build --branch=develop 'nightly_default'19:59
shogun-buildbotbuild forced [ETA 27m30s]19:59
shogun-buildbotI'll give a shout when the build finishes19:59
@sonney2kvan51, pong19:59
van51sonney2k: hey19:59
van51sonney2k: did you see my comment on github?19:59
@sonney2kvan51, yes but what I am saying is we don't really need that array at all20:02
wikingsonney2k: bundle them20:02
@sonney2kwiking, no20:02
wikingsonney2k: why not?20:02
wikingthey have both bundle options20:02
@sonney2kI don't like the bundle approach20:02
@sonney2kit is error prone20:02
van51sonney2k: so should I try to replace it?20:02
@sonney2kwiking, I would rather say this is required - install it if you won't or go w/o20:03
wikingsystem? if it's not a package then bundle is better20:03
wikingas it's tested20:03
wikingand works20:03
wikingin several builds;)20:03
@sonney2kwiking, it is tested now20:03
wikingsonney2k: as i see with self installed lib u end up having problems (see pic)20:03
wikingsonney2k: have u installed those packages on 7nn.de as well?20:03
@sonney2kwiking, it is the wrong approach IMHO - it is the work distributions should be and are doing20:03
@sonney2kwiking, no 7nn won't build any longer20:04
@sonney2kit is just the webserver now20:04
wikingk20:04
@sonney2kvan51, yes please20:04
@sonney2kvan51, I think it would be best to use an SGVector for that task20:04
wikingsonney2k: what was the problem with sse2?20:04
wikingi mean we are using -march=native20:05
@sonney2kwiking, there is still20:05
wikingso i dont really get how's this our 'fault'20:05
@sonney2kwiking, if we have HAVE_SSE2 on cygwin - all examples using random will crash - this is what we have seen20:05
@sonney2kvan51, OK?20:05
van51sonney2k: yeah20:05
wikingsonney2k: does that machine have sse2?20:05
van51sonney2k: on it20:05
@sonney2kvan51, if you use SGVector you can just create a new one of appropriate size and assign it later to the member variable20:06
@sonney2kvan51, then call resize() to squeeze it to the correct size20:06
van51sonney2k: ok great. that's what I had in mind ;)20:07
@sonney2kwiking, well cat /proc/cpuinfo said so but no idea20:07
@sonney2kwiking, we need a real sse2 test code snippet that is run to be sure20:07
@sonney2kwiking, I couldn't find any proper sse2 detection for cmake (not even opencv has one)20:08
@sonney2kwiking, so I decided to disable it on cygwin20:08
@sonney2kwiking, but I guess we will run into trouble on older archs too20:08
@sonney2kvan51, if you can - could you check who is using set_array() (from the original code) too - I mean the code there is wrong - it should free old memory and I suspect some copy & paste bug or other stupid error20:09
@sonney2kwiking, one more thing - about shogun vs. opencv20:10
van51sonney2k: ok. right after I finish20:10
@sonney2kwiking, I think we should add an option in cmake to make it possible to use cv mat20:10
@sonney2kwiking, so we can have some fancy opencv examples later and for now just https://gist.github.com/pickle27/675172220:11
@sonney2kvan51, thanks tons!20:11
van51sonney2k: np!20:11
wikingsonney2k: afaik we should add helper function to do cv::mat <-> SGMatrix20:12
wikingwe've discussed this with sergey as well20:12
@sonney2kwiking, yes sure - would be easy to do - SGMatrix's etc are very very similar to cv mat20:12
@sonney2kwiking, and van51 could finally do the gender detection demo with opencv's face detector and shogun's lbppyr features20:13
@sonney2kwiking, but dependency is that we have cmake support for that20:13
wikingsonney2k: it's easy20:13
@sonney2kif we have we can keep the example from pickle2720:14
wikingsonney2k: there's opencv cmake detector20:14
@sonney2kwiking, just add it then20:14
wikingprovided by opencv itself20:14
@sonney2kwiking, so what is needed then?20:17
-!- lisitsyn [~lisitsyn@fb2-lo1.global63.net] has joined #shogun20:27
van51sonney2k: I've updated the PR20:47
van51going to eat now20:47
@sonney2kvan51, does it work now?20:47
@sonney2kvan51, and btw regarding memory - just drop the training data once you have the classifier and it did call init_optimization20:47
shogun-buildbotbuild #556 of nightly_default is complete: Failure [failed notebooks]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/55620:50
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun20:51
shogun-notifier-shogun: van51 :develop * 84e81cf / / (3 files): https://github.com/shogun-toolbox/shogun/commit/84e81cf49c1883f0eb7d6bbe8fdccd087b829aed20:51
shogun-notifier-shogun: Fixed seg fault and a leak in CommUlongStringKernel and added a unit test20:51
shogun-notifier-shogun: Soeren Sonnenburg :develop * d2f0062 / / (3 files): https://github.com/shogun-toolbox/shogun/commit/d2f0062064d546746cab592bf9fb9fbee6efc8ee20:51
shogun-notifier-shogun: Merge pull request #1688 from van51/develop20:51
shogun-notifier-shogun:20:51
shogun-notifier-shogun: Fixed seg fault and a leak in CommUlongStringKernel and added a unit test20:51
@sonney2know only fernando should fix his notebook and we are good20:52
hushellsonney2k: no problem with pickle now?20:54
@sonney2khushell, I removed it20:55
@sonney2khushell, http://www.shogun-toolbox.org/static/notebook/3.0/FGM.html20:55
hushellsonney2k: thanks! look great!21:09
wikinghushell: your average testing error with bmrm is always around 0.24?21:13
hushellwiking: you mean overfitted?21:24
hushellwiking: I didn't tune much the regularization, but this result is similar to the results in Patrick's paper21:25
wikinghushell: no the question is what number u usually get21:26
wikingfor testing error21:26
wikingdoes it vary a lot or it's always around 0.24?21:26
wikingsonney2k: current should be current and not a symlink to any release21:29
wikingas it's a nightly build21:29
wikingnot any release build21:29
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]21:31
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has joined #shogun21:31
@sonney2kwiking, how do you do a release build then?21:34
wikingyou just make one manually21:34
hushellwiking: yeah, it is always 0.2394, IIRC no random stuff in bmrm21:35
wikinghushell: ok cool21:35
@sonney2kwiking, then please don't name it current but 'latest'21:37
@sonney2kwiking, for the documentation we have a scheme that takes the version number21:37
@sonney2kwiking, and installs under this version number the doc21:38
@sonney2kwiking, then we have two symlinks21:38
@sonney2kwiking, current == currrent stable release21:38
@sonney2kwiking, and latest == latest developer build21:38
wikingsonney2k: eh why?21:38
wikingcurrent is current21:38
wikingstable is stable21:38
@sonney2kwiking, then you have to change this in doc too and update all links everywhere21:39
wikingthat's kind of defacto rule21:39
wikingfor all sw releasing21:39
-!- new_lido [~walid@41.218.177.204] has joined #shogun21:45
shogun-buildbot_build #1915 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb3%20-%20modular_interfaces/builds/191521:56
@sonney2kwiking, http://docs.buildbot.net/current/index.html http://docs.buildbot.net/latest/index.html etc21:59
wikingyey so there's one more opensource library :)22:05
wikingthis current vs latest even semantically does not have any sense22:06
wikingi'm sorry but this is very misleading22:06
shogun-buildbot_build #45 of clang34 - undefined behaviour analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/45  blamelist: van51 <vangelis_51@hotmail.com>22:10
shogun-buildbot_build #48 of clang34 - thread analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/48  blamelist: van51 <vangelis_51@hotmail.com>22:26
shogun-buildbot_build #66 of clang34 - static analysis is complete: Failure [failed analyse]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/66  blamelist: van51 <vangelis_51@hotmail.com>23:11
shogun-buildbot_build #46 of clang34 - undefined behaviour analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/46  blamelist: Soeren Sonnenburg <sonne@debian.org>23:26
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has joined #shogun23:28
-!- mode/#shogun [+o iglesiasg] by ChanServ23:28
shogun-notifier-shogun: hushell :develop * 0ab27a9 / / (14 files): https://github.com/shogun-toolbox/shogun/commit/0ab27a98007f214ab42439094e6b89973045edff23:30
shogun-notifier-shogun: SOSVM SGD solver23:30
shogun-notifier-shogun: Fernando Iglesias :develop * 6c6213c / / (14 files): https://github.com/shogun-toolbox/shogun/commit/6c6213cf2e0f3c41d0047e775a9368e6219b6f6823:30
shogun-notifier-shogun: Merge pull request #1669 from hushell/develop23:30
shogun-notifier-shogun:23:30
shogun-notifier-shogun: SOSVM SGD solver23:30
shogun-buildbot_build #49 of clang34 - thread analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/49  blamelist: Soeren Sonnenburg <sonne@debian.org>23:46
-!- gsomix [~gsomix@5850-AMTS-2-43.dialup.samtel.ru] has quit [Ping timeout: 240 seconds]23:51
shogun-notifier-shogun: Fernando Iglesias :develop * 6225623 / doc/ipython-notebooks/metric/LMNN.ipynb: https://github.com/shogun-toolbox/shogun/commit/6225623be96e42e84c784aec4d40f86e5e103d8223:54
shogun-notifier-shogun: Update LMNN notebook using far less number of features in the metagenomics example23:54
shogun-notifier-shogun: Fernando Iglesias :develop * 6b307c3 / doc/ipython-notebooks/metric/LMNN.ipynb: https://github.com/shogun-toolbox/shogun/commit/6b307c38d667da7832eb7646df0b07413a7b5bfb23:54
shogun-notifier-shogun: Merge pull request #1698 from iglesias/feature/lmnn23:54
shogun-notifier-shogun:23:54
shogun-notifier-shogun: Update LMNN notebook using far less number of features in the metagenomi...23:54
--- Log closed Mon Sep 30 00:00:20 2013

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!