IRC logs of #shogun for Wednesday, 2011-08-31

--- Log opened Wed Aug 31 00:00:06 2011
--- Day changed Wed Aug 31 2011
shogun-buildbotbuild #164 of python_modular is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org:5347/builders/python_modular/builds/16400:00
serialhexblackburn & sonney2k... i think there was a mistake with some of my programs and accidentally changed a few python examples, but i changed them back so there should be nothing wrong...00:13
blackburnserialhex: np, I already restored python examples00:13
serialhexoh, ok :)00:13
serialhexthanks blackburn00:13
blackburnhope we will manage to release today(for me)/tomorrow(for you)00:14
blackburn:)00:14
serialhexsweet!!!00:15
blackburnserialhex: I'm currently postponing all the trac tickets :D00:16
serialhex??? whats that mean?  we're just doing bugfixes & patches now??00:17
blackburnserialhex: sure00:20
blackburnserialhex: well we do that at least during the last week00:20
blackburnor more00:20
serialhex...also, it seems that the modshogun.rb file in the interfaces/ruby_modular dir i've made is not being copied to the ruby load dir, which is causing the tests to fail :(00:21
blackburnserialhex: hmm why?00:21
blackburnserialhex: what is the ruby dir?00:22
blackburnerr load dir00:22
blackburnserialhex: ah! forgot, what's up with our strings problem?00:22
serialhexwell, i checked to make sure, but if you look here: http://www.shogun-toolbox.org:5347/builders/ruby_modular/builds/157/steps/compile/logs/stdio00:22
serialhexthere is no modshogun.rb file. but the modshogun.so file gets copied...00:23
serialhexstings problem??? the thing i e-mailed soeren & baozeng last nightabout?00:23
blackburnserialhex: ain't it sufficient to have modshogun.rb in the examples dir?00:23
blackburnserialhex: yeah that nightly shit00:24
serialhexwell, the modshogun.rb file i've been building so that it's easier to use shogun with ruby... making it more ruby-like in essence00:24
serialhexerm... lemme forward you the e-mail00:25
serialhexOOOHHHH!!!!!  the last nite thing was solved by soeren because one needs to call f.close() or you get errors...  and that is something i can make more ruby-ish (using blocks)00:26
serialhex...or is there something else???? i think it's all been solved...00:27
blackburnserialhex: it was about histogram (not enough bits)00:28
blackburnis it solved?00:28
serialhexOH! what we talked about at like 4am your time :D00:28
blackburnyeah00:28
serialhexyes it is!!!  soeren solved it, and i guess your estimation of the problem was right!00:29
blackburnah I see00:30
blackburnfuck yeah! killed a mosquito00:31
serialhexAWESOME1!!!!00:32
serialhexhmm.....00:33
blackburnserialhex: so lets resolve modshogun issue00:34
blackburnserialhex: won't it work with modshogun.rb in the examples folder?00:34
blackburnit is the way we do it in python/java/etc00:34
serialhexyeah, i'm about to look in the configure file & see where the 'make install' command for ruby is and include that file to be copied00:35
serialhexit will work...  but if people want to use code like those examples then it won't... it'll throw the same errors00:36
blackburnserialhex: it is ok I think00:36
blackburnserialhex: I would suggest you to put modshogun.rb right in the ruby_modular examples folder00:37
blackburnpython_modular won't work without some load.py too00:37
blackburnand java_modular without Load.java00:37
serialhexhmm, well then moving it to the examples dir & changing "require 'modshogun'" to "require './modshogun'" will fix the problem...00:37
blackburnserialhex: wait but why ./modshogun.so?00:39
blackburnisn't in in some ruby path?00:39
blackburnglobally available I mean00:39
serialhexhmm... maybe i ought to just rename it to 'shogun_helpers.rb or something, and require that...00:40
serialhex'00:40
blackburnserialhex: it is even more convenient - if you want a standalone shogun using .rb - you have to find modshogun.rb somewhere00:41
blackburnand when it is in examples dir - you could just copy that and nothing more00:41
serialhexwell, that was the idea... to make a modshogun.rb file with all the ruby-ish additions, and have it in the same place as modshogun.so, and have the first require the second00:42
blackburnserialhex: what is the + of this way?00:46
serialhexthe end-user dosn't have to do anything extra to get shogun to work like it is in the files00:49
blackburnserialhex: so is it ~ to store this file in ruby_modular examples dir?00:50
serialhexand as i change things a little here & there on the ruby-side of things, i only have to edit one file, and that will automagically update their ruby configuration when i update ti00:51
serialhexit's ok to do that, it's not going to break anything00:51
blackburnserialhex: so lets do that? ;)00:52
serialhexok00:52
serialhexyeah, i just tried that - i'd have to rename the ruby-ish file to something else and require that seperately to get it to work right...01:02
blackburnserialhex: will you make a pull request?01:03
serialhex?? what for?01:03
serialhexyou want me to do that?  i will & do the pull req, but it's gonna take a bit (there are a handful of files to edit)01:04
blackburnserialhex: I don't know - I could do that :)01:05
blackburnuse sed luke01:05
blackburn:D01:05
serialhexsed??  hmm... another *nix util i do not know how to use :'(01:06
blackburnserialhex: wait but there is already shogun_helpers.rb01:06
serialhexduh!  i think that's 9/10'ths of the modshogun.rb file :P01:07
blackburnand load.rb01:07
blackburnpretty messy01:07
serialhexyes, shogun_helpers.rb is *really* messy... :'(01:08
serialhexi need to clean it01:08
blackburnserialhex: so the plan is01:09
blackburnreplace shogun_helpers with01:09
blackburnmodshogun.rb01:09
blackburnthen remove load.rb, modshogun.rb01:09
blackburnand add to every test require of modshogun.so and shogun_helpers.rb01:09
blackburnis it ok?01:11
serialhexyes01:11
serialhexand i'm in the process of doing that right now :)01:11
serialhexok... how would i use sed to edit all these files?01:12
serialhex^ blackburn?01:12
@sonney2kwhy is modshogun.rb needed?01:12
blackburnserialhex: e.g sed -i 's/something/anything' file.rb01:13
blackburnoh sorry01:13
blackburnsed -i 's/something/anything/g' file.rb01:13
blackburnsonney2k: surprise to see you :D01:13
@sonney2kblackburn, I didn't manage to fix any of the bugs01:14
blackburnsonney2k: I have fixed crash in generator.py01:14
@sonney2kblackburn, python examples throwing valgrind errors I cannot make any sense of01:14
blackburneh? all ok now01:14
serialhex...so i could do `sed -i "s/require 'modshogun'/require 'modshogun'\nrequire'shogun_helpers'/g *.rb` ??01:14
@sonney2kblackburn, ?!01:14
blackburnserialhex: yeah but I guess you should protect ' with \' or so01:15
serialhexok01:15
blackburnsonney2k: what is crashing??01:15
@sonney2kblackburn, running python generator.py works for you?01:15
@sonney2kI have valgrind errors all over the place + crashes01:15
blackburnsonney2k: have you updated?01:16
@sonney2kyes01:16
blackburnehm01:16
blackburnwhat is the errors you get?01:16
blackburnare*01:16
@sonney2ktons01:16
blackburnTParameter?01:16
@sonney2kI no01:16
@sonney2kno01:16
@sonney2kclassifier_averaged_perceptron_modular.py01:17
@sonney2ktry to run that w/ valgrind01:17
blackburnUnicodeEncodeError: 'ascii' codec can't encode character u'\xf6' in position 323369: ordinal not in range(128)01:17
blackburnI have that error sometimes01:17
blackburnno idea how to get there it is01:17
@sonney2kI don't have that01:18
blackburnsonney2k: any idea how to find that unicode char?01:18
@sonney2kis that becaause of you pixel dot again01:18
blackburn:D01:18
blackburnI don't know I have removed that feature in my vim01:18
blackburnit was trailing spaces01:18
@sonney2kblackburn, search for ö01:19
blackburnu'\xf6'01:19
@sonney2kyeah, search for 'ö'01:19
blackburnis u ' \xf 6' = ?01:19
@sonney2kthat is not the problem though...01:19
blackburnit crashes compilation on my machine01:20
@sonney2kblackburn, which $LANG?01:20
blackburnpython_modular01:20
blackburnsonney2k: I have only python errors when running valgrind01:20
blackburnwith averaged perceptron01:20
CIA-3shogun: Soeren Sonnenburg master * raff7c0d / src/shogun/preprocessor/KernelPCA.h : remove o umlaut - http://git.io/iRPcZg01:21
blackburnoh01:21
blackburnumlaut01:21
@sonney2kwhy am I having 'real errors'01:21
blackburn:D01:21
blackburnsonney2k: e.g.?01:21
@sonney2kbernhard's last name01:21
blackburnyes I see01:21
@sonney2kand btw my boss's name is Müller not Muller ;)01:22
blackburnsonney2k: I just copied that from mendeley01:22
blackburnsonney2k: so what is the example of 'real error'?01:22
@sonney2kuninitialized memory reads01:23
blackburnat line?01:23
serialhexu / ? whats the difference??  :P01:23
@sonney2kserialhex, one sounds like 'you' the other more like the sound of a cow ;-)01:24
blackburnserialhex: ? sounds different01:24
blackburn:D01:24
serialhexi know, i was being facetious  (though i didn't know what they sounded like, thanks sonney2k!)01:24
blackburnsonney2k: soooo?01:25
@sonney2kblackburn, I am compiling01:25
blackburnsonney2k: and why the f. you are not sleeping? :D01:25
@sonney2kbecause I am stupid01:25
blackburnlie and bad excuse01:26
blackburnsonney2k: I have no leaks!01:27
blackburnsonney2k: generator works bad but with no segfaults01:28
blackburnserialhex: works?01:29
serialhexthrough some cajoling, yes :)  there are a couple examples with errors though, fixing them then i'll push01:29
blackburnserialhex: okay thanks01:30
@sonney2kblackburn, I have these errors01:30
@sonney2kAveragedPerceptron01:30
@sonney2k==24399== Conditional jump or move depends on uninitialised value(s)01:30
@sonney2k==24399==    at 0xE296750: shogun::DynArray<double>::find_element(double) const (DynArray.h:245)01:30
@sonney2k==24399==    by 0xEC2FD39: shogun::CSet<double>::contains(double) (Set.h:68)01:30
@sonney2k==24399==    by 0xEC2FC1F: shogun::CSet<double>::add(double) (Set.h:47)01:30
@sonney2k==24399==    by 0xEC2F4A9: shogun::CLabels::get_num_classes() (Labels.cpp:122)01:30
@sonney2k==24399==    by 0xEC2ECFC: shogun::CLabels::CLabels(shogun::SGVector<double>) (Labels.cpp:42)01:30
@sonney2k==24399==    by 0xEE7CF7A: shogun::CLinearMachine::apply() (LinearMachine.cpp:58)01:30
@sonney2kI tried to find a bug in there for hours01:31
@sonney2kno idea01:31
blackburnsonney2k: is it related only to the averaged perceptron?01:31
@sonney2kthe uninited memory read is in find_element01:31
@sonney2kbut in the element that is to be found!01:31
@sonney2kwait01:31
@sonney2kI get an idea01:31
@sonney2kI now understaand01:32
@sonney2kblackburn, why don't you get this error?!?!01:33
@sonney2kyou should too01:33
blackburnsonney2k: why it appears?01:33
@sonney2kit appears in the apply function01:33
blackburnof linear machine?01:33
@sonney2kwhere a label vector is allocated01:33
@sonney2kyes01:33
@sonney2kthat label vector is assigned an nr of classes computed01:34
@sonney2kby using a set01:34
blackburncan't see what is wrong01:34
@sonney2k(all labels are put into the set and so one knows how many there are == nr elements in set)01:34
@sonney2ksome label(s) must not have been assigned proper values01:35
@sonney2kthat is the only way this can happen01:35
blackburnsonney2k: may be it is too late or I am too lame or I am too lamb but I did'n understand01:35
blackburnbut nevermind just fix it01:35
@sonney2kI am too tired01:36
@sonney2ktomorrow...01:36
blackburnsonney2k: so just let me know what to fix01:36
blackburnor fix it tomorrow, no difference01:37
blackburnsonney2k: I've cleaned shogun 1.0.0 milestone in trac01:37
@sonney2kdoes all of generator run through for you?01:37
@sonney2klibrary_fisher2x3_modular                                    ERROR generating '../../../testsuite/tests/library_fisher2x3_modular1.txt' using 'library_fisher2x3_modular.py'01:37
@sonney2k?01:37
blackburnsonney2k: yes I get these errors01:38
blackburnbut no segfaults01:38
@sonney2kI no longer have segfaults either...01:39
@sonney2kweird01:39
blackburnsonney2k: most of them run smoothly01:39
blackburnsonney2k: heiko's examples are wrong with no parameter list01:40
blackburnfisher2x3 have wrong array on input01:40
blackburnetc01:40
serialhexblackburn, sonney2k: how do i get Modshogun::HDF5File to work?  what do i need?01:44
blackburnserialhex: I didn't :D01:44
* serialhex rolls his eyes01:44
blackburnserialhex: python-h5py01:45
blackburnI guess01:45
serialhexhmm, ok01:46
blackburnnoonon01:46
blackburnserialhex: wrong01:46
blackburnI don't know :)01:47
serialhexya know.. your useless blackburn!!  :P01:47
blackburnsure01:47
blackburnokay sleeptime01:49
serialhexnite01:49
CIA-3shogun: Sergey Lisitsyn master * r9305ba3 / (3 files): Removed output from python modular examples - http://git.io/v6QpOQ01:49
blackburnserialhex good night sonney2k gute nacht01:50
-!- blackburn [~blackburn@188.168.3.23] has quit [Quit: Leaving.]01:50
CIA-3shogun: Soeren Sonnenburg master * rffb7c54 / (4 files): fix examples - http://git.io/P34tiA01:51
@sonney2kserialhex, libhdf5-serial-dev01:51
serialhexawesome!  thanks sonney2k, will get that in a min01:52
@sonney2knite hex01:53
-!- Netsplit *.net <-> *.split quits: @sonney2k02:16
-!- Netsplit over, joins: sonney2k02:18
shogun-buildbotbuild #168 of python_modular is complete: Failure [failed test_1]  Build details are at http://www.shogun-toolbox.org:5347/builders/python_modular/builds/168  blamelist: sonne@debian.org03:03
-!- serialhex [~quassel@99-101-148-183.lightspeed.wepbfl.sbcglobal.net] has quit [Read error: Connection reset by peer]09:52
CIA-3shogun: Soeren Sonnenburg master * rb17aeae / (3 files in 2 dirs): fix remaining examples - http://git.io/KciTbA10:07
-!- mode/#shogun [+o sonney2k] by ChanServ10:21
CIA-3shogun: Soeren Sonnenburg master * r3deadd2 / (5 files in 2 dirs): all generated tests work upon generator.py/tester.py now - http://git.io/84XWUw10:47
-!- blackburn [~blackburn@188.168.4.101] has joined #shogun10:47
CIA-3shogun: Soeren Sonnenburg master * re3c14a4 / data : require new test data - http://git.io/Ao2U3w10:49
blackburnsonney2k: what's up?10:51
@sonney2kall tests run now on my machine10:51
@sonney2kwe still might have valgrind errors though10:51
@sonney2kblackburn, err how did you git push the data stuff to github ?10:52
blackburnsonney2k: git added it in data dir..?10:52
@sonney2kI have committed a number of files in data/10:53
blackburnand?10:53
@sonney2kgit push says everything up to date !?10:54
shogun-buildbotbuild #206 of libshogun is complete: Failure [failed git]  Build details are at http://www.shogun-toolbox.org:5347/builders/libshogun/builds/206  blamelist: sonne@debian.org10:54
@sonney2kI mean you don't have commit 0d3c492e6daf9ed8992b6f4a778260163ff50423 in data right?10:55
@sonney2kblackburn, why do ruby examples fail?10:57
blackburnsonney2k: cause modshogun.rb with helpers isn't being copied during installation10:58
@sonney2kcan't we get rid of modshogun.rb?10:58
@sonney2kwhat is this file for?10:58
@sonney2kbtw10:58
blackburnsonney2k: it almost the same as load.py10:58
blackburnsonney2k: yeah we could rename it to load.rb or so10:59
blackburnand when require in every example10:59
@sonney2kblackburn, so it can stay in examples as load.rb10:59
blackburnyes10:59
@sonney2kI mean the loading helper is not really 'nice/fast' code10:59
@sonney2kit is only to illustrate how to set matrices etc from $LANG into sg11:00
blackburnsonney2k: yeah but what else can we do?11:00
@sonney2kkeep the load.rb around11:00
@sonney2kin examples11:00
blackburnyes sure11:00
blackburnit is better11:00
@sonney2kblackburn, any idea about the data repo?11:01
blackburnsonney2k: I have outdated data now11:01
blackburnyou haven't pushed to shogun-data11:02
blackburnsonney2k: https://github.com/shogun-toolbox/shogun-data my commit is the last one11:02
@sonney2kblackburn, what is your git remote -v ?11:03
blackburnsonney2k: in data?11:03
@sonney2kgit remote -v11:03
@sonney2kgithubgit@github.com:shogun-toolbox/shogun-data.git (fetch)11:03
@sonney2kgithubgit@github.com:shogun-toolbox/shogun-data.git (push)11:03
@sonney2kof course11:03
blackburnorigingit://github.com/shogun-toolbox/shogun-data.git (fetch)11:03
blackburnorigingit://github.com/shogun-toolbox/shogun-data.git (push)11:03
blackburnwell the same11:03
@sonney2kthat's all?11:03
blackburnyeah11:03
@sonney2kno not the same11:03
@sonney2kyou cannot push under this url11:04
blackburnah11:04
blackburnyes11:04
blackburnreadonly url11:04
@sonney2kblackburn, so how did you ever add data?11:04
blackburnsonney2k: let me try now11:04
blackburnsonney2k: ohhh I see11:06
blackburnsonney2k: checkout to master branch!11:07
blackburnyou are (as me) on the master branch11:08
blackburnerrrrrnot on the master branch11:08
@sonney2khmmhh now the new data is gone11:10
@sonney2kbut you are right11:10
@sonney2kwill fix the ruby stuff first and then11:10
@sonney2kblackburn, did you document all the classes with some @brief stuff?11:11
blackburnsonney2k: not yet11:11
@sonney2kthen please...11:11
blackburnokay11:11
blackburnbut after breakfast :D11:11
blackburnbrb11:12
shogun-buildbotbuild #170 of python_modular is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org:5347/builders/python_modular/builds/17011:15
CIA-3shogun: Soeren Sonnenburg master * r52fb28d / (18 files in 3 dirs): fixed a number of .rb scripts and removed broken non-trivial to fix ones - http://git.io/fKEtqw11:25
shogun-buildbotbuild #207 of libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org:5347/builders/libshogun/builds/20711:29
blackburnhere11:29
CIA-3shogun: Soeren Sonnenburg master * rb23e6ba / data : require new test data - http://git.io/UiXSbg11:31
blackburnsonney2k: could you remind me how to get list of non-@briefed classes?11:31
@sonney2kcd examples11:31
@sonney2kmake11:31
@sonney2kblackburn, alright new data should be in11:32
@sonney2kpython / ruby stuff now works11:32
@sonney2k(I fixed what I could and removed the rest)11:32
blackburnsonney2k: ehh not examples missing doc, @brief11:32
@sonney2kblackburn, doc11:32
@sonney2kcd examples11:32
@sonney2kmake doc11:32
blackburnblackburn@blackburn-laptop:~/shogun/shogun/examples$ make doc11:33
blackburnmake: *** No rule to make target `doc'.  Stop.11:33
blackburnsonney2k: ^?11:33
@sonney2kexamples?11:33
@sonney2kcd doc11:33
@sonney2kmake11:33
@sonney2kbtw what happened to the russian docu? did you cancel it?11:34
blackburnsonney2k: yes, I told you?!11:34
@sonney2khmmhh maybe you got disconnect when I replied that it is nice to attract new-comers11:34
blackburnsonney2k: I have another idea how to attract11:35
@sonney2kanyway better do doc now11:36
blackburnsonney2k: corrcoef between 'average english' and 'machine learning interested' = 1.0 ;)11:36
blackburnfor russian folks I mean11:36
blackburnsonney2k: did make doc but where to get un@briefed classes list?11:38
shogun-buildbotbuild #168 of ruby_modular is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org:5347/builders/ruby_modular/builds/16811:55
@sonney2kblackburn, open doc12:01
blackburnsonney2k: yeah yeah in progress already12:01
@sonney2kplease continue in brain on mode :)12:01
blackburnsonney2k: done12:22
blackburnsonney2k: ?? ???????12:23
CIA-3shogun: Sergey Lisitsyn master * rceee77a / (43 files in 9 dirs): Doc improvements - http://git.io/BkiXIg12:34
-!- heiko [~heiko@134.91.53.213] has joined #shogun13:16
blackburnheiko: hi how are you?13:20
heikoblackburn, hi! I am fine, a bit tired, packing stuff all night, and you?13:21
blackburnI am fine, already packed-unpacked :)13:21
blackburnbut I was moving ~100km, not that much as you :D13:21
heikook, but a lot of work also :)13:21
heikoWe will do it on friday13:21
heikoand still much stuff to do in the appartment13:22
heikobut I want to do some hacking now, perhaps I can finish the migration today, if there do not appear more errors13:22
blackburn???13:22
blackburnwow13:22
blackburnthought we postponed that13:23
heikoyes we did13:23
heikobut I want to try if it works after this last error13:23
heikoWe will see13:23
heikoprobably not, experience tells that :)13:23
heikoThis feature is like a nest of bees you have to dig into13:24
blackburncan I help you somehow?13:24
heikoI dont know, I think not really unless you want to dig into all the stuff13:24
heikoIts nearly working ... but only nearly13:24
blackburnI see13:24
heikoWell I will try now for two hours and if it does not work then I will continue moving :)13:25
-!- serialhex [~quassel@99-101-148-183.lightspeed.wepbfl.sbcglobal.net] has joined #shogun13:29
@sonney2kblackburn, ok13:31
@sonney2kblackburn, what else do we need?13:31
blackburnsonney2k: I don't know13:31
@sonney2kblackburn, from my side examples /tests/doc etc work13:32
@sonney2kso only thing now is to fix links on website13:32
@sonney2kand make release script13:32
@sonney2kblackburn, did you check the remaining python tests/examples?13:38
serialhexsonney2k: i'm getting thr ruby examples ready, and doing the libsvm minimal example i get this wile training the svm:13:40
serialhex[ERROR] assertion kernel->get_num_vec_lhs()==problem.l failed in file classifier/svm/LibSVM.cpp line 8513:40
serialhexclassifier_libsvm_minimal_modular.rb:32:in `train': [ERROR] assertion kernel->get_num_vec_lhs()==problem.l failed in file classifier/svm/LibSVM.cpp line 85 (fatal)13:40
serialhex        from classifier_libsvm_minimal_modular.rb:3213:40
serialhexwant me to gist my code and see whats up?13:41
@sonney2kI think the number of examples doesn't match the number of labels13:41
serialhexok...13:41
@sonney2kI guess matrix has not the rihgt number of columns13:41
blackburnsonney2k: not, tested only distance and kernel13:42
blackburnone from both13:42
@sonney2kthen please continue with more complex stuff13:42
blackburnsonney2k: did you rewrite serialized tests?13:43
@sonney2k?13:43
blackburnsonney2k: testsuite/tests13:43
blackburnsonney2k: are they old now?13:44
@sonney2kno13:44
@sonney2kit would make sense to get them working again13:44
@sonney2kthese things are independent of our SGVector/subset whatever transition13:44
@sonney2kand should all still work13:44
@sonney2knot much work either13:44
blackburnsonney2k: so may be I could compare outputs?13:44
@sonney2kblackburn, you could get make run-testsuite to work13:45
@sonney2kthese tests compare outputs already13:45
blackburnbut I thought we compare to old shogun tests?13:45
@sonney2kblackburn, we even have another 'old' testsuite in shogun13:45
@sonney2kthat one just needs adjustments like classify -> apply renames13:46
@sonney2kthen it will run for all (old) interfaces13:46
@sonney2kwould be good to get these to work13:46
blackburnokay13:46
blackburnbut a bit later, gtg13:46
CIA-3shogun: Soeren Sonnenburg master * r49d04a5 / (76 files in 9 dirs): rename r -> r_static etc - http://git.io/l_uu1g14:20
shogun-buildbotbuild #210 of libshogun is complete: Failure [failed compile]  Build details are at http://www.shogun-toolbox.org:5347/builders/libshogun/builds/210  blamelist: sonne@debian.org14:23
-!- f-x [75c0d29e@gateway/web/freenode/ip.117.192.210.158] has joined #shogun14:33
@sonney2kserialhex, I would prefer if you keep the helper functions in load.rb or utils.rb in the examples directory14:47
serialhexok, i can change that later on today sonney2k15:09
-!- heiko [~heiko@134.91.53.213] has quit [Ping timeout: 258 seconds]15:47
-!- f-x [75c0d29e@gateway/web/freenode/ip.117.192.210.158] has quit [Ping timeout: 252 seconds]16:19
blackburnsonney2k: how to fix the testsuite? :/16:30
CIA-3shogun: Sergey Lisitsyn master * rbe81d77 / src/README : Updated interfaces in readme - http://git.io/BYxVqg16:51
blackburnsonney2k: make[1]: *** No rule to make target `.depend', needed by `libshogun.so.10.0'.  Stop.16:53
-!- f-x [75c0d29e@gateway/web/freenode/ip.117.192.210.158] has joined #shogun17:14
-!- f-x is now known as Guest3430717:14
-!- Guest34307 is now known as f-x_17:15
@sonney2kblackburn, cd shogun/src17:36
@sonney2kmake run-testsuite17:36
blackburnsonney2k: yeah a lot of errors17:36
@sonney2kto the contrary17:36
@sonney2kmost stuff works still17:37
blackburnsonney2k: currently fixing easysvm17:45
blackburnsonney2k: so will we release today?17:52
CIA-3shogun: Sergey Lisitsyn master * r2e4b2b5 / (2 files): Fixed esvm at easysvm - http://git.io/dh7yyA17:54
@sonney2kblackburn, sure17:57
blackburnsonney2k: any urgent thing to do now?17:57
@sonney2kblackburn, fix the old test suite17:58
blackburnsonney2k: how? what is wrong with it?17:58
@sonney2kblackburn, everything that does not print OK needs to be looked at17:58
@sonney2kblackburn, if we can show that the old tests work we know that we didn't break anything17:59
blackburnsonney2k: what you mean old tests?18:07
@sonney2ktestsuite/*18:07
@sonney2kwhen you run test_all.sh there18:07
@sonney2kerr18:10
@sonney2kyou also have that make[1]: *** No rule to make target `.depend', needed by `libshogun.so.10.0'.  Stop. error?18:10
@sonney2khmmhh18:10
@sonney2kwhat happened?!18:10
blackburnsonney2k: I don't18:10
@sonney2kyou don't have that error?18:10
@sonney2kor you do have it?18:10
blackburnsonney2k: no error there18:10
blackburnonly on buildbot18:11
CIA-3shogun: Soeren Sonnenburg master * r8e2b540 / testsuite/matlab_and_octave/test_all.sh : ignore tests - http://git.io/oh8SjA18:21
CIA-3shogun: Soeren Sonnenburg master * r6823fdb / (4 files in 3 dirs): SGVectorize dynprog function - http://git.io/V65vPg18:21
@sonney2kthere was  a bug18:21
@sonney2ksome ../ thing18:22
@sonney2know it should work again18:22
blackburnsonney2k: what should work?18:23
@sonney2kthe Makefile18:23
shogun-buildbotbuild #214 of libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org:5347/builders/libshogun/builds/21418:24
blackburnsonney2k: my preprocessors can't pass this tests18:25
blackburneigenproblems -> slightly different vectors18:26
blackburnI have absolutely no idea how to fix *all* these shitty examples18:26
blackburnand what is wrong18:26
@sonney2kblackburn, come on try hard18:37
@sonney2kwhen sth doesn't work easily skip it and go on18:37
blackburnI have no idea where to start18:37
blackburnsonney2k: when I run generator/tester all is OK18:40
@sonney2kblackburn, ? take an example - if it doesn't work have a look at the src code18:40
@sonney2kdon't look at generator/tester18:40
blackburnwhere to look?!18:40
@sonney2kas I said18:40
@sonney2ktestsuite/*/test_all.sh18:41
-!- f-x_ [75c0d29e@gateway/web/freenode/ip.117.192.210.158] has quit [Ping timeout: 252 seconds]18:41
@sonney2kgenerator/tester work but this is the 'new' testsuite18:41
@sonney2kso we cannot rely on it yet18:41
blackburnsonney2k: what it runs?18:42
@sonney2kthe old testsuite18:42
blackburnsonney2k: okay and when I got18:43
blackburn../data/kernel/OligoString_DNA_10_3_60_12.mERROR18:43
blackburnwhat should I do?18:43
@sonney2kthen debug the testsuite18:44
blackburndebug what?18:44
@sonney2kthe test suite18:44
CIA-3shogun: Soeren Sonnenburg master * rfc4625c / (3 files in 2 dirs): further SGVectorization of dynprog - http://git.io/iUaRYA18:46
@sonney2kblackburn, clear now?18:46
blackburnsonney2k: very, debug the testsuite through debugging the testsuite18:48
blackburnno idea what you want18:56
@sonney2kblackburn, which interface are you currently testing?19:11
blackburnpython modular19:12
blackburnand most of them have error19:12
blackburn?!19:12
blackburnsonney2k: so that implies we broke so much?19:19
@sonney2kyes19:19
CIA-3shogun: Soeren Sonnenburg master * r419a67b / (3 files): fix a few regressions - http://git.io/HkOChQ19:20
@sonney2kblackburn, well there is no way other than debug the *.py files in the testsuite/python_modular and check what is different19:22
@sonney2kblackburn, I will work on the static interfaces for that now19:22
@sonney2kbut first I have to get home19:22
blackburnhuh19:23
blackburnokay I'll try to fix something19:23
@sonney2kso try hard - good luck and cu in ~1 hr19:23
blackburnokay..19:23
CIA-3shogun: Sergey Lisitsyn master * rb5f27b9 / (2 files in 2 dirs): Transitioned copy feature matrix routine to SGMatrix - http://git.io/elTjEw19:53
@sonney2kblackburn, back21:13
@sonney2know lets get the work done21:13
blackburnsonney2k: yeah ok21:20
@sonney2kblackburn, did you manage to reduce the number of issues at all?21:22
blackburnsonney2k: not yet but now I know how to work with it21:22
blackburnsonney2k: do the release work, I'll ask you if being stucked21:22
@sonney2kblackburn, I am currently fixing broken links on the website21:22
blackburnokay21:23
blackburnsonney2k: ah one issue was fixed21:23
@sonney2kI will write some blurb like thanks to google for gsoc etc21:23
blackburnyeah you may do this better than me :D21:23
CIA-3shogun: Soeren Sonnenburg master * ra8f57f0 / (4 files in 4 dirs): exclude tests directory form old-tests - http://git.io/AD2v_g21:27
shogun-buildbotbuild #3 of nightly_default is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org:5347/builders/nightly_default/builds/321:47
blackburnsonney2k: if it says 'accuracy: ..'21:50
blackburnwhat does it mean?21:50
@sonney2kthen it says sth like there is a deviation above max tolerance21:52
blackburnsonney2k: looks like LogPlusOne is broken hah21:54
blackburnno idea how it is possible21:54
@sonney2kme neither21:54
blackburnsonney2k: how much work you have to done now?21:55
@sonney2k?21:55
@sonney2kwhat?21:55
blackburnwhat are the things you have to done now as release process?21:55
@sonney2kto do you mean?21:56
@sonney2kthe make release script21:56
@sonney2kI could immediately do a release if I do it manually21:56
@sonney2kbut it is tedious21:56
blackburnfuck21:56
blackburnyes21:56
blackburnto do21:56
CIA-3shogun: Sergey Lisitsyn master * r16227f5 / testsuite/python_modular/preprocessor.py : Fixed preprocessor testsuite - http://git.io/iw_VmQ22:08
CIA-3shogun: Sergey Lisitsyn master * r7f13b81 / data : Updated data - http://git.io/__h5ew22:08
blackburnsonney2k: I'm pretty slow, will you have time to join?22:23
@sonney2kI am very slow too (tired ...)22:23
@sonney2kso please continue22:23
@sonney2kI just wrote some stuff for the webpage / updated / fixed it22:23
@sonney2know 'all' that is missing is the tagging/branching/release magic22:24
blackburnsonney2k: I'm not going to stop, but afraid of not manage to complete this work22:24
@sonney2kblackburn, I think this will mean we release at 1 or 2am on the day of world peace, i.e. september 122:26
@sonney2kblackburn, I think we should release with what we have22:26
@sonney2kby then22:26
blackburnsonney2k: heiko broke kmeans very strange way22:26
blackburnnow cluster centers is wrong for sure22:27
@sonney2kok22:27
@sonney2kthen please fix ;)22:27
blackburnsonney2k: I think there are a lot of this kind of errors22:27
* sonney2k continues the release script22:27
blackburnsonney2k: yeah trying to investigate why he did it this way22:27
blackburnautumn22:33
blackburnheh22:33
@sonney2kthe autumn of code22:51
@sonney2kor better the autumn of release22:51
blackburnsonney2k: still stucked with KMeans22:53
@sonney2kblackburn, have a look at git log src/shogun/clustering/KMeans.cpp23:00
@sonney2kI remember that heiko transitioned distance machines to have vectors to compare with on the lhs23:01
blackburnsonney2k: yes but lhs contains full features23:01
@sonney2kthese are compared against all rhs ones23:01
blackburnno idea why23:01
@sonney2knot only mu's  ?23:01
blackburnno, all 33 feature vectors23:01
@sonney2kI mean before training it contains traingingdata23:01
@sonney2kbut afterwards only means or?23:02
blackburnand after too23:02
@sonney2khmmmh23:02
blackburnsonney2k: hmm in python example all ok23:05
@sonney2kgreat23:06
blackburnsonney2k: but in testsuite it goes wrong23:06
blackburnso I guess clustering.py issue23:06
@sonney2kyou mean python test suite?23:06
@sonney2kor python_modular one?23:06
blackburnpython_modular sure23:07
blackburnsonney2k: got it23:08
@sonney2kI don't understand a thing23:09
blackburnsonney2k: distance is being reinited after training23:09
@sonney2kahh23:09
@sonney2ktrue23:09
@sonney2kbug23:09
@sonney2khope we don't do it in regular examples23:10
blackburnsonney2k: mus thing was better I would say23:10
@sonney2kblackburn, no23:10
@sonney2kThe way it is now mus are on lhs23:10
@sonney2kand that way the trained method can just be applied/serialized23:11
@sonney2kthat wasn't possible before23:11
CIA-3shogun: Soeren Sonnenburg master * rea275ed / data : update data - http://git.io/Vm4E9A23:24
CIA-3shogun: Soeren Sonnenburg master * r4240e55 / Makefile : improved release script for work with git - http://git.io/mksANw23:24
@sonney2kblackburn, did you commit?23:34
@sonney2kwhat things are open?23:34
blackburnsonney2k: in a min23:34
@sonney2kI can hardly continue now23:34
@sonney2kI can write some release email in the meantime23:34
blackburnsonney2k: yeah write23:35
blackburnsonney2k: update your data23:36
@sonney2khow?23:36
@sonney2kgit submodule update ?23:36
blackburnI just do git pull in data dir23:36
blackburndon't know if it is possible with submodule23:37
blackburnyou just commited old data23:37
blackburnsonney2k: I have moved preproc to preprocessor23:37
CIA-3shogun: Sergey Lisitsyn master * rf6512c7 / testsuite/python_modular/clustering.py : Fixes for clustering tester - http://git.io/AGK6gA23:38
CIA-3shogun: Sergey Lisitsyn master * r67b6b84 / data : Updated data - http://git.io/lgvrpA23:38
@sonney2kI didn't do any further commits in data23:38
blackburn(01:24:49 AM) CIA-3: shogun: Soeren Sonnenburg master * rea275ed / data : update data - http://git.io/Vm4E9A23:38
blackburnsonney2k: ^?23:38
@sonney2kblackburn, https://github.com/shogun-toolbox/shogun/commit/ea275ed63d9b654b8a5c709a1ef01a0955d428a523:39
@sonney2kthat's only saying we need new data23:39
@sonney2kI think you should do that too23:39
@sonney2kgit add data23:39
@sonney2kgit commit data23:39
blackburnsonney2k: f4e493... was new data23:39
@sonney2kblackburn, you didn't git commit it23:40
@sonney2kso no chance I could recognize23:40
blackburnsonney2k: https://github.com/shogun-toolbox/shogun/commit/7f13b81348bdee075f0f5b6c7685541790f1b71c23:40
blackburnsonney2k: you just did my commit reversed ;)23:40
@sonney2khmmhh why oh why?23:41
blackburncause if you have old data git says that data is possible to commit23:41
@sonney2kblackburn, but a git submodule update should fix it23:42
@sonney2kbut it doesn't here23:42
blackburnsonney2k: SVMSGD and SubgradientSVM fail totally23:42
@sonney2kblackburn, that's ok23:42
blackburnsonney2k: clustering, distances, distributions are ok23:42
@sonney2kwe changed default loss for svmsgd23:43
blackburnsonney2k: some kernels fail (like Oligo)23:43
@sonney2kthese shouldn't23:43
blackburnsonney2k: prunevarsubmean and logplusone too23:43
@sonney2kthere was no change23:43
blackburnregression is ok23:43
@sonney2kblackburn, logplusone?!23:44
@sonney2kbecause of preproc rename?23:44
blackburnsonney2k: no idea23:44
blackburnsonney2k: have you any 'power' to check Oligo and Poly kernel?23:45
blackburn../data/kernel/OligoString_DNA_10_3_60_12.mERROR23:47
blackburnkm_test: 1.648674e-02, km_train: 1.430996e-02 <--- accuracy: 1.000000e-0923:47
blackburn../data/kernel/OligoString_DNA_10_4_60_17.mERROR23:47
blackburnkm_test: 1.691602e-02, km_train: 6.647181e-04 <--- accuracy: 1.000000e-0923:47
blackburn../data/kernel/Poly_1_0_10_3_6_01_False_False_CUBE_1_FK.mERROR23:47
blackburnkm_test: 1.489201e-01, km_train: 1.502606e-01 <--- accuracy: 1.000000e-0623:47
blackburn../data/kernel/Poly_1_0_10_3_6_01_False_False_CUBE_1_TOP.mERROR23:47
blackburnkm_test: 1.725301e-01, km_train: 1.051410e-01 <--- accuracy: 1.000000e-0623:47
blackburnI'm trying to check logplusone23:47
@sonney2kcompletely broken23:48
CIA-3shogun: Soeren Sonnenburg master * r99966f1 / Makefile : improve release script again - http://git.io/M_M3zQ23:58
--- Log closed Thu Sep 01 00:00:44 2011

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!