IRC logs of #shogun for Monday, 2014-02-10

--- Log opened Mon Feb 10 00:00:52 2014
shogun-buildbotbuild #195 of clang34 - static analysis is complete: Failure [failed analyse]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/195  blamelist: Soeren Sonnenburg <sonne@debian.org>00:08
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]00:32
shogun-buildbotbuild #190 of debian wheezy - memcheck is complete: Failure [failed memory check generate html]  Build details are at http://buildbot.shogun-toolbox.org/builders/debian%20wheezy%20-%20memcheck/builds/190  blamelist: Soeren Sonnenburg <sonne@debian.org>00:37
-!- pranet [73f91219@gateway/web/freenode/ip.115.249.18.25] has joined #shogun02:46
-!- Saurabh7 [~Saurabh7@115.248.130.148] has quit [Read error: Connection reset by peer]03:00
-!- Saurabh7 [~Saurabh7@115.248.130.148] has joined #shogun03:17
-!- lisitsyn [~lisitsyn@109-226-71-150.clients.tlt.100megabit.ru] has quit [Read error: Operation timed out]03:26
shogun-buildbotbuild #610 of nightly_all is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_all/builds/61003:34
-!- sonne|osx_ [~sonne@e179071173.adsl.alicedsl.de] has joined #shogun03:47
-!- sonne|osx [~sonne@f052204221.adsl.alicedsl.de] has quit [Ping timeout: 246 seconds]03:48
-!- sonne|osx_ is now known as sonne|osx03:48
pranetHi. How do I set  LD_LIBRARY_PATH ? Getting missing  libshogun.so.15 error during runtime.04:17
shogun-buildbotbuild #708 of nightly_default is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/70804:25
-!- Saurabh7 [~Saurabh7@115.248.130.148] has quit [Quit: Leaving]05:43
-!- pranet [73f91219@gateway/web/freenode/ip.115.249.18.25] has quit [Ping timeout: 245 seconds]05:45
@sonney2kshogun-buildbot, force build --branch=develop nightly_all06:23
shogun-buildbotbuild forced [ETA 9m48s]06:23
shogun-buildbotI'll give a shout when the build finishes06:23
@sonney2kshogun-buildbot, force build --branch=develop 'osx2 - python'06:23
shogun-buildbotbuild forced [ETA 27m36s]06:23
shogun-buildbotI'll give a shout when the build finishes06:23
shogun-buildbotbuild #611 of nightly_all is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_all/builds/61106:28
shogun-buildbotbuild #52 of osx2 - python is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python/builds/5206:39
-!- sonne|osx [~sonne@e179071173.adsl.alicedsl.de] has quit [Quit: sonne|osx]07:12
-!- sonne|osx [~sonne@82.113.121.2] has joined #shogun08:19
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun08:35
shogun-notifier-shogun: Soeren Sonnenburg :develop * 9dabfca / / (9 files): https://github.com/shogun-toolbox/shogun/commit/9dabfca2c9c14800a63ee7711c5d1164eaed46f108:35
shogun-notifier-shogun: Add tmp directory inside python modular examples and direct all temporary08:35
shogun-notifier-shogun: output to that dir. This fixes tests running concurrently that read the08:35
shogun-notifier-shogun: files in the examples directory.08:35
-!- sonne|osx [~sonne@82.113.121.2] has quit [Quit: sonne|osx]08:35
shogun-buildbotbuild #1829 of cyg1 - libshogun is complete: Failure [failed compile test]  Build details are at http://buildbot.shogun-toolbox.org/builders/cyg1%20-%20libshogun/builds/1829  blamelist: Soeren Sonnenburg <sonne@debian.org>09:00
@wikingfyi: There was quite a lot of interest in a 2.0.12 release, so I've spent the weekend creating, testing and releasing it. It should contain the fixes you need.09:25
@wikingI'll do a tag in a day or two for 3.0.009:25
@wiking(libc++ fix)09:25
-!- sonne|work [~sonnenbu@24-134-74-216-dynip.superkabel.de] has joined #shogun09:34
sonne|workwiking: http://buildbot.shogun-toolbox.org/builders/debian%20wheezy%20-%20memcheck/builds/190/steps/generate%20html/logs/stdio09:34
sonne|workwiking: no more memory logs09:34
-!- travis-ci [~travis-ci@ec2-107-20-126-221.compute-1.amazonaws.com] has joined #shogun09:35
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/1856395309:35
-!- travis-ci [~travis-ci@ec2-107-20-126-221.compute-1.amazonaws.com] has left #shogun []09:35
sonne|workwiking: any idea why travis claiming some massacre ^^^ ? It built just fine https://travis-ci.org/shogun-toolbox/shogun/builds/1856395309:45
shogun-buildbotbuild #186 of clang34 - undefined behaviour analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/186  blamelist: Soeren Sonnenburg <sonne@debian.org>09:58
shogun-buildbotbuild #181 of clang34 - thread analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/181  blamelist: Soeren Sonnenburg <sonne@debian.org>10:14
shogun-buildbotbuild #196 of clang34 - static analysis is complete: Failure [failed analyse]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/196  blamelist: Soeren Sonnenburg <sonne@debian.org>10:55
-!- lambday [67157d4f@gateway/web/freenode/ip.103.21.125.79] has joined #shogun11:11
-!- zxtx [~zv@c-98-223-196-32.hsd1.in.comcast.net] has quit [Read error: Connection timed out]11:15
-!- zxtx [~zv@c-98-223-196-32.hsd1.in.comcast.net] has joined #shogun11:16
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]11:35
shogun-buildbotbuild #191 of debian wheezy - memcheck is complete: Failure [failed memory check]  Build details are at http://buildbot.shogun-toolbox.org/builders/debian%20wheezy%20-%20memcheck/builds/191  blamelist: Soeren Sonnenburg <sonne@debian.org>11:39
-!- lisitsyn [~lisitsin@mxs.kg.ru] has joined #shogun11:54
lambdaysonne|work: lisitsyn: fixed the bug that roman reported - regarding clone()... sending PR12:53
lambdayan uninitialized memory was causing this - in copy_ptype..12:54
lisitsynlambday: cool, although no idea what is it :D12:54
lambdaylisitsyn: replacing SG_MALLOC with SG_CALLOC in one place fixed this :) have a look.. attaching valgrind report as well12:55
lisitsynlambday: could you please send me a link when it is here12:56
lambdaylisitsyn: yeah just a sec12:56
lambdayhttps://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/base/Parameter.cpp#L4019 here we are initializing the memory - and here we're trying to dereference - https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/base/Parameter.cpp#L364612:58
lambdayvalgrind was complaining regarding conditional jump base don uninitialized memory12:58
lambdaylisitsyn: log before fix - https://gist.github.com/votjakovr/883406413:03
lambdaylisitsyn: I gotta go.. will be back in an hour! please have a look and let me know!13:08
-!- lambday [67157d4f@gateway/web/freenode/ip.103.21.125.79] has quit []13:08
sonne|worklisitsyn: not sure if this was really intended...13:43
lisitsynsonne|work: what?13:43
sonne|workthe memory access there - I don't know if an init with NULL is what we want...13:44
-!- lambday [67157f4f@gateway/web/freenode/ip.103.21.127.79] has joined #shogun14:01
lambdaysonne|work: hi14:03
sonne|worklambday: hi14:03
sonne|workabout your patch - I am not sure if the bug is not sth else... you sure that the comparison at this stage there is intended?14:04
sonne|worklambday: ^14:04
sonne|worklambday: I mean sure it fixes the valgrind error but will there be just some other bug?14:04
lambdaysonne|work: well... I need to ask Heiko regarding what its meant to be... do we need to check both here? I mean, if source is NULL, we practically have nothing to do, right?14:06
lambdayso, wonder if we can replace if (!casted1 & !casted2) with just if (!casted1)14:06
lambdayin that case, it would also serve the purpose14:07
lambdaysonne|work: will there be problems if we use calloc?14:09
sonne|worklambday: no it is just malloc + memset with 0 value14:10
sonne|worklambday: question is just if that was the bug or not14:10
lambdaysonne|work: well, I can't think of a scenario when both casted1 and casted2 checks are required - https://github.com/lambday/shogun/blob/develop/src/shogun/base/Parameter.cpp#L364614:11
lambdayif we don't need to check casted2 here at all, then that is the bug14:12
lambdaywe should just check casted1 instead14:12
lisitsynsonne|work: https://twitter.com/ChengSoonOng/status/43286370050076262414:13
sonne|worklambday: how can any of them be null?14:16
sonne|worklambday: I mean that should never happen or?14:16
sonne|worklisitsyn: ohh sh....14:17
lambdaychecking...14:18
lisitsynsonne|work: this sucks I guess?14:22
lambdaysonne|work: you're right - the error is something else.. didn't find it yet14:44
lambdaysonne|work: regarding being null, casted2 can be null.. casted1 shouldn't be as per I think14:49
sonne|worklambday: I am not even sure where this code is in - some procedure where we do b=a.clone() or what?14:53
sonne|worklambday: if yes then of course things in b can be NULL14:53
lambdaysonne|work: yeah... while copying all parameters hierarchically, we do this clone... and things in b can be null..14:55
lambdaybut I just checked that b was null before in another level of this hierarchy, there it didn't give this error...14:55
sonne|worklambday: so it should do depth first wise copy14:55
lambdayyep.. that's what it does14:56
sonne|worklambday: but then the check for casted2 != doesn't make sense to me14:58
lambdayfor this particular example that roman gave, DenseFeatures (b was 0) --> DynamicObjectArray --> PruneVarSubMean (b is 0 - here it gives error upon unref-ing)14:58
lambdaysonne|work: yeah I too am confused if its at all needed14:59
sonne|workahh he is returning true when both are null14:59
sonne|workhmmhh but that would be done anyways14:59
lambdaysonne|work: is there any probably scenario when casted1 is null and casted2 is not? shouldn't be!15:00
lambdayits all newly allocated memory15:00
sonne|worklambday: yeah it should just be set to null there15:01
lambdayyep!15:01
sonne|worklambday: I mean if (!casted1) {  *((CSGObject**)target) = null; )15:01
sonne|workand all good15:01
lambdayyeah15:01
lambdaylet me try this but I still think the error persists15:02
sonne|worklambday: or is it possible to clone into some *existing* object15:02
lambdaychecking15:02
lambdayoh!15:02
sonne|workyeah look15:02
sonne|workhe does an SG_UNREF there15:02
lambdayyeah!15:02
sonne|workso maybe that is why15:02
sonne|worklambday: so indeed the newly allocated memory should be NULL by default15:03
-!- lambday [67157f4f@gateway/web/freenode/ip.103.21.127.79] has quit [Ping timeout: 245 seconds]15:19
-!- lambday [67157f4f@gateway/web/freenode/ip.103.21.127.79] has joined #shogun15:55
lambdaysonne|work: even when we keep only one check for if (!casted1) and remote the check for casted2, its checking again in the SG_UNREF(...)... if(x) thing...15:58
lambdayremove*15:58
lambdaysonne|work: so getting the same error again... conditional jump or move depends on uninitialized value...15:59
-!- lambday [67157f4f@gateway/web/freenode/ip.103.21.127.79] has quit [Quit: Page closed]16:26
-!- iglesiasg [~iglesiasg@524AE0A7.cm-4-3d.dynamic.ziggo.nl] has joined #shogun17:56
-!- mode/#shogun [+o iglesiasg] by ChanServ17:56
-!- lambday [67157f4f@gateway/web/freenode/ip.103.21.127.79] has joined #shogun18:29
-!- pranet [ca4eafc7@gateway/web/freenode/ip.202.78.175.199] has joined #shogun18:40
-!- iglesiasg [~iglesiasg@524AE0A7.cm-4-3d.dynamic.ziggo.nl] has quit [Quit: Leaving]18:55
-!- lisitsyn1 [~lisitsyn@80.252.20.67] has joined #shogun18:56
@sonney2klambday, yes of course we need to init things with NULL - I guess your CALLOC patch would do it19:24
lambdaysonney2k: this is just one possible scenario then - we *have to* test the parameter framework and write testcases carefully19:25
@sonney2klambday, yeah ... it might need some split up into smaller functions19:26
lambdaysonney2k: heiko must have some ideas regarding this - I am always up for manpower wise :)19:29
lambdaysonney2k: I think I will be applying for gsoc as a student this year - this will be my last year as a student19:29
-!- pickle27 [d8bfe7da@gateway/web/freenode/ip.216.191.231.218] has joined #shogun19:40
@sonney2kpickle27, hey publicity chair ;)19:42
pickle27hey!19:43
-!- gsomix [~gsomix@188.168.2.19] has joined #shogun19:43
pickle27btw sorry I didn't have a chance to setup the screen session before I left for work today19:43
pickle27I'll get it up this week then we can discuss next stammtisch19:44
-!- votjakovr [~votjakovr@188.134.46.30] has joined #shogun19:55
@sonney2kpickle27, can't you just do it now?20:07
@sonney2kpickle27, I mean it takes like 20 seconds...20:08
pickle27sonney2k: the ssh key isn't on my work pc20:08
pickle27so if wiking can add another key for me then I can make one here20:09
pickle27and then do it20:09
@sonney2kpickle27, did you twitter btw?20:16
pickle27I tweeted about the debian package and  python320:16
pickle27Im waiting on the workshop til we have the dats20:16
pickle27and I'll tweet about gsoc soon too20:16
@sonney2kpickle27, we have sth else now too20:19
pickle27yeah?20:19
@sonney2kwe got the osx buildbot to work with no tests failing http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python20:20
@sonney2kso python etc20:20
@sonney2kmaybe that one http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python/builds/5220:20
@sonney2kit is even creating a .dmg20:20
@sonney2klisitsyn, lisitsyn1 did you fix the uninited memory reads?20:25
@sonney2klisitsyn, yandex is coming to germany - they open up sth in berlin20:26
-!- pradeepkr [0e8b7bb4@gateway/web/freenode/ip.14.139.123.180] has joined #shogun20:27
pickle27sonney2k: so that builds a mgd file for osx drag and drop install for python interface?20:28
lisitsyn1sonney2k: yeah heard about it20:28
pickle27awesome!20:28
@sonney2kpickle27, and we got a google cloud grant worth 2k$20:29
pickle27awesome20:29
pickle27what are we using that for?20:29
lisitsyn1sonney2k: I am not sure about uninited stuff20:29
pickle27I can tweet thanking them20:29
lisitsyn1sonney2k: can I check somewhere?20:29
lisitsyn1sonney2k: would you apply? ;)20:34
@sonney2klisitsyn, http://buildbot.shogun-toolbox.org/memcheck/20140210-0855.html20:37
@sonney2kpickle27, wiking and besser and lamday want to do cloud stuff with shogun, i.e. parallel comp. framework like for x-val etc20:38
pickle27very cool20:39
pickle27I'll just tweet something genric about excting cloud r & d20:39
-!- pradeepkr [0e8b7bb4@gateway/web/freenode/ip.14.139.123.180] has quit [Quit: Page closed]20:41
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]20:48
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun20:48
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Client Quit]20:50
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has joined #shogun20:50
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has quit [Client Quit]20:53
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun20:53
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Remote host closed the connection]20:53
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun20:53
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Remote host closed the connection]20:53
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun20:57
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Remote host closed the connection]20:58
lisitsyn1sonney2k: thanks20:59
-!- iglesiasg [~iglesiasg@524AE0A7.cm-4-3d.dynamic.ziggo.nl] has joined #shogun20:59
-!- mode/#shogun [+o iglesiasg] by ChanServ21:00
@iglesiasghey people!21:00
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun21:00
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Remote host closed the connection]21:00
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun21:00
-!- Netsplit *.net <-> *.split quits: besser82, tricksy___21:02
@sonney2klisitsyn, and ? any insights?21:02
-!- sonne|osx [~sonne@e179071173.adsl.alicedsl.de] has joined #shogun21:02
@sonney2kshogun-buildbot, force build --branch=develop 'osx2 - python'21:02
shogun-buildbotThe build has been queued, I'll give a shout when it starts21:02
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Client Quit]21:03
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has joined #shogun21:03
-!- tricksy___ [uid12458@gateway/web/irccloud.com/x-bnbwjtszpxgvbgbc] has joined #shogun21:04
-!- Netsplit over, joins: besser8221:05
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun21:08
shogun-notifier-shogun: Soeren Sonnenburg :develop * 332be4b / src/shogun/mathematics/Math.cpp: https://github.com/shogun-toolbox/shogun/commit/332be4b5751978760c5e1be4c4c09db803031a6a21:08
shogun-notifier-shogun: attempt to fix cygwin build21:08
@sonney2kiglesiasg, hey welcome!21:09
@sonney2kiglesiasg, could you start polishing ideas - I mean bring them in gsoc 2013 shape?21:09
@iglesiasgsonney2k, sure21:09
@iglesiasglet me see..21:10
@iglesiasgsonney2k, what about the other document we have to send for the application?21:11
@iglesiasgI remember another one from last year we had in drive too21:11
-!- HeikoS [~heiko@nat-240-55.internal.eduroam.ucl.ac.uk] has joined #shogun21:14
-!- mode/#shogun [+o HeikoS] by ChanServ21:14
@HeikoSheya21:14
@sonney2kHeikoS, hey...21:14
@HeikoSsonney2k: hi! how are things?21:15
@sonney2kHeikoS, can you take care of writing the gsoc applicaton?21:15
@iglesiasghey man21:15
@HeikoSsonney2k: yep can do, deadline is 14th right?21:15
@sonney2kHeikoS, we finally have python3 tests running21:15
@HeikoSiglesiasg: hi!21:15
@HeikoSsonney2k: nice!21:16
@sonney2kHeikoS, yes but lets finish of the document now and then fully focus on the ideas list21:16
@HeikoSsonney2k: I have to redo one of my exams until the end of the week, thats why it has been quiet from my side, but at least two project descriptions are already in21:16
@HeikoSsonney2k: EMT khan will write his tomorrow (I pushed him to that at least)21:16
@sonney2kHeikoS, well the proposal is most important21:17
@sonney2kHeikoS, I think we have enough ideas that we can also polish on the weekend21:17
@HeikoSsonney2k: ok, cool21:17
@sonney2kHeikoS, ahh and we finally got the google cloud grant21:17
@HeikoSso application now21:17
@sonney2kHeikoS, and I guess we will get some amazon one too21:17
@HeikoSsonney2k: ah thats cool, whats that for?21:18
@HeikoSsonney2k: what about templates from last years application21:19
@sonney2kHeikoS, well we can use it a) for shogun cloud (notebooks) and b) for demos and c) for gsoc trying to run stuff in the cloud21:19
@sonney2kHeikoS, all in publicity21:19
@HeikoSsonney2k: ok great21:20
shogun-notifier-shogun: Roman Votyakov :develop * 9fae7d7 / src/shogun/distributions/classical/GaussianDistribution.cpp: https://github.com/shogun-toolbox/shogun/commit/9fae7d733fda68043f9901e928a41add7130568221:23
shogun-notifier-shogun: fix check of the dimensions in log_pdf_multiple() method of the CGaussianDistribution class21:23
shogun-notifier-shogun: Heiko Strathmann :develop * 44ba9aa / src/shogun/distributions/classical/GaussianDistribution.cpp: https://github.com/shogun-toolbox/shogun/commit/44ba9aa6474e975624de357dbaa2d17a19d77d7221:23
shogun-notifier-shogun: Merge pull request #1859 from votjakovr/develop21:23
shogun-notifier-shogun:21:23
shogun-notifier-shogun: fix check of the dimensions in log_pdf_multiple() method of the CGaussianDistribution class21:23
@sonney2kHeikoS, so just to summarize what is left to do for gsoc21:25
@sonney2kHeikoS, a) we need the application in (please go to the melange page and register again)21:26
@sonney2kHeikoS, b) we need the ideas list and done21:26
@sonney2ka) is urgent21:26
@sonney2kb) is sth that we should already now start to make public in some polished form but I hope iglesiasg you can help here!21:27
@sonney2kat the same time we should do one more release with python3 etc support21:27
@iglesiasgsonney2k, I am working on the fundamental ML algorithms proposal now, and during the next days I will put the ideas on the website21:27
@sonney2kand there are a couple of buildbot fixes necessary21:27
lisitsyn1sonney2k: need advice on possible idea21:28
@sonney2kHeikoS, and e.g. the doc page is still obsolete21:28
@sonney2kso the buildbot needs fixing21:28
lisitsyn1sonney2k: I'd like to see dictionary learning here in shogun but you know I am not a dictionary learning guy21:28
lisitsyn1want to know what you think21:28
@sonney2kHeikoS, not sure if you have seen but we also now have this nice valgrind page http://buildbot.shogun-toolbox.org/memcheck/20140210-0855.html21:29
@HeikoSsonney2k: just registered21:29
@sonney2klisitsyn, no idea what that means?21:29
-!- mattnorton [80e30340@gateway/web/freenode/ip.128.227.3.64] has joined #shogun21:29
@sonney2kHeikoS, cool thx21:29
lisitsyn1sonney2k: do you consider a project with no real expert mentor as a good idea?21:30
@sonney2klisitsyn, what is it first of all?21:30
mattnortonHi. I am using Enthought Canopy on Mac. Does anyone know how install shogun so it works with Canopy?21:30
@HeikoSmattnorton: yes21:31
@sonney2kmattnorton, no idea what canopy is...21:31
@HeikoSjust normally and add it to the python path21:31
@HeikoSsonney2k: its just another python packaging system21:31
@HeikoSmattnorton: just compile/install or install binary package (if available, like in linux) then add the python files to your pythonpath21:32
@HeikoSsonney2k: ok, application is next, I will do that tomorrow and put it to discussion then21:32
lisitsyn1sonney2k: e.g. learning patches of images to represent image as a sparse vector21:33
lisitsyn1sonney2k: http://scikit-learn.org/stable/modules/decomposition.html21:33
mattnortonok. I used the macports method that it talks about on the website. where did it install the python files? i cannot find them?21:33
@HeikoSmattnorton: did you compile?21:34
@HeikoSthen its in the source folder under lib/python or something21:34
-!- pranet [ca4eafc7@gateway/web/freenode/ip.202.78.175.199] has quit [Quit: Page closed]21:36
mattnortonSorry. I'm a math major who is very new to programming.21:36
mattnortoni thought that you did not need to compile if you used mac ports?21:36
mattnortondo I type the suggested compile commands from the terminal?21:37
@HeikoSmattnorton: dont worry, I actually am the wrong person to ask because I never used a mac ;) sonney2k maybe?21:37
mattnortonI think it might be a better idea to email my question haha. I need specific instructions like you are directing a child haha21:38
@sonney2kmattnorton, I am no longer using macports but brew so I cannot give 100% instructions either21:39
@sonney2kmattnorton, just to understand - if you open up a terminal and type python21:39
@sonney2kmattnorton, then import modshogun21:39
@sonney2kwill that work21:39
@sonney2k?21:39
mattnorton"no module named modshogun"21:40
mattnortoni downloaded the .tar file. How do you compile it? maybe that would solve the problem21:41
@HeikoSsonney2k: its just a set of python files just like the packages under debian21:41
@HeikoSjust need to put the shogun python files in the path21:41
shogun-buildbot_build #53 of osx2 - python is complete: Failure [failed]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python/builds/5321:41
@iglesiasgsonney2k, wiking, lisitsyn, HeikoS, who had the idea of this fundamental  ML algorithms project originally ?21:41
@iglesiasgThere are some things I need to know more in particular21:42
@iglesiasglike what is it to do with kNN, PCA, and some others21:42
@HeikoSiglesiasg: me and sonney in the desert21:43
-!- mattnorton [80e30340@gateway/web/freenode/ip.128.227.3.64] has quit [Quit: Page closed]21:44
@HeikoSpolish all of those implementations, make them work (some dont), make them flexible, and most important, write nice examples and notebooks21:44
@HeikoSshould be fun since one learns a lot about all this fundamental stuff21:44
@iglesiasgyeah, I agree with the fun part21:44
@iglesiasgI think it can be a nice project21:44
@iglesiasglet me try to get a proposal in shape21:45
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]21:45
@HeikoSiglesiasg: would be great if you pushed that, I think it would be one of the most important projects for us21:45
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun21:45
@HeikoSsince it attracts people21:45
@sonney2kHeikoS, yeah it might be that we have to split this project into multiple21:50
@HeikoSlambday: sorry about the PR, but that might be a bit dangerous to do since its not really solving the problem21:50
@HeikoSsonney2k: yeah why not21:50
@HeikoSsonney2k: I am quite excited about the projects that I added btw, good stuff21:50
@sonney2kshogun-buildbot, force build --branch=develop 'osx2 - python'21:50
shogun-buildbotThe build has been queued, I'll give a shout when it starts21:50
@HeikoSand the other mentors are excited/motivated too21:50
@sonney2klisitsyn, you sure could do the project 'just' converting what is in scikits right?21:51
@sonney2kHeikoS, lisitsyn can we remove the shogun-tutorial folder?21:52
@HeikoSsonney2k: I dont know whether sergey translated all his stuff to notebvooks yet,    lisitsyn?21:54
@sonney2klisitsyn, did you at least copy all text over? I want to get rid of that legacy repository21:56
-!- gxr [8ca3fe9e@gateway/web/freenode/ip.140.163.254.158] has joined #shogun21:57
@HeikoSleaving now guys, see you tomorrow! :)21:58
-!- HeikoS [~heiko@nat-240-55.internal.eduroam.ucl.ac.uk] has quit [Quit: Leaving.]21:58
@sonney2kgxr, hey gunnar!21:59
shogun-buildbotbuild #1830 of cyg1 - libshogun is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/cyg1%20-%20libshogun/builds/183021:59
lisitsyn1sonney2k: yeah sure remove it21:59
@sonney2klisitsyn, then please upload the notebook22:02
gxrHi shogun-team!22:03
gxr(somebody came to my office and distracted me from my IRC experience...)22:04
gxrLooks like I just missed Heiko.22:04
gxrWell, I'm new here and I'm late as well. But I have a few questions.22:06
@iglesiasgshoot22:06
gxrMaybe you covered them before...22:06
shogun-buildbotbuild #2190 of deb3 - modular_interfaces is complete: Failure [failed test ruby modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb3%20-%20modular_interfaces/builds/2190  blamelist: Soeren Sonnenburg <sonne@debian.org>22:06
gxr1. I suggested to have the project on "easy-install shogun". Thanks for all your suggestions and comments. I wanted to have something even more dummy proof.22:07
gxrI think what's needed is a downloadable package that one can "activate" without any root access or extended linux knowledge.22:08
gxrAt least one suggestion included installing a specific package. This implies that one has rights to do so. Most users don't have these rights. We miss out on those.22:08
@sonney2kgxr, yes sure halfway done already though22:09
gxrSo, can we have a tar.gz file that contains binaries including all dependencies to run shogun on a) linux (multiple distributions) b) mac (without macports & developer tools) and c) windows.22:10
@sonney2kgxr, so the real gsoc project would be to get shogun working on windows22:10
gxrI understood that all the solutions implied that you need to be able to install specific packages.22:10
pickle27bah windows22:10
pickle27not worth the effort22:11
gxrAlso, for mac, it would be required to have macports and developer tools.22:11
@sonney2kgxr, well a .dmg for osx right http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python/builds/5422:11
pickle27just link a tutorial on running a linux vm or something22:11
@sonney2kgxr, we create the .dmg already but I am just fighting with getting it uploaded to the right directory22:11
gxr(I'm fine if Windows is not supported, but linux and mac would be great, and I mean not only on Debian, but also on Centos and other distributions that are used a lot in the US).22:12
@sonney2kgxr, also we do a nightly build on linux - we can just tar up the install and fine22:12
@sonney2kgxr, same with fedora22:12
@sonney2kgxr, finally I am doing real debian packages again and besser82 does rpms22:12
@sonney2kso we can create them in the very same way too22:13
@sonney2kbut windows really is tough22:13
gxrCan you install the rpms without root rights? What about dependencies?22:13
gxrre vm: this won't be used if people can use other tools (that are worse, but easier to install).22:14
@sonney2kgxr, you can extract rpms w/o root rights22:14
gxrsonney2k, What about dependencies?22:15
@sonney2kno chance22:15
@sonney2kyou would need to have them installed22:15
gxrThe guys in a neighboring group needed two months and lots of help to get shogun compiled on centos.22:15
gxrMostly because of the dependencies.22:15
@sonney2kgxr, well it is a lot easier now with besser82's work - he packaged a couple of deps22:16
gxrWhat I did a while back is to create a package that includes shogun and the dependencies. Maybe that's what besser82 did?22:17
gxrIn my case we had a build script that builds all the software including the specific atlas options that are needed etc22:18
@sonney2kgxr, I am afraid there are very few students that can handle osx/windows/linux well enough for this task...22:18
pickle27Im a big fan of what our readme says currently22:18
@sonney2kgxr, no it is a clean package now in fedora core22:18
@sonney2kpickle27, what does it say?22:18
pickle27something along the lines of if you are doing any serious scientific computing you should be using linux22:18
@sonney2kpickle27, heros of the universe?22:18
@sonney2kpickle27, ahh that yeah that was me :)22:18
pickle27its great we should keep it that way22:19
pickle27fun fact22:19
@sonney2kgxr, but it is easy to hack sth (not so elegant) up22:19
pickle27opencv dropped about half their windows pre-built binaries in their latest releases22:19
@sonney2kpickle27, hehe22:19
gxrI'm fine if we only support linux, but from my experience it isn't much harder to do the same on a mac.22:20
gxr(if you have a operating system specific binary release.)22:20
pickle27we have mac though don't we22:21
pickle27I thought sonney2k announced earlier that our build is fixed22:21
gxrSomebody with serious scripting abilities and good linux knowledge to should be able to do this.22:21
gxrwhere do I find the dmg?22:22
pickle27ask sonney2k about it22:22
pickle27I think he just got it working22:22
pickle27I'd like to know where too cause I was gonna tweet about it22:22
@sonney2kgxr, http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python/builds/5422:23
@sonney2kgxr, no idea why the upload takes so long...22:23
gxrsonney2k, can you please send me a dmg, such I can test it on a vanilla machine?22:23
@sonney2kgxr, but please test the dmg22:23
gxrThe link does not seem to contain a page that links to a dmg.22:23
@sonney2kgxr, see the yellow uploading dmg thing?22:23
@sonney2kit contains a link22:24
shogun-buildbotbuild #54 of osx2 - python is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python/builds/5422:24
shogun-buildbotbuild forced [ETA 26m37s]22:24
shogun-buildbotI'll give a shout when the build finishes22:24
gxrsonney2k, I'll test the dmg when I have it.22:24
@sonney2kclick it22:24
@sonney2kshogun-buildbot, is just done uploading ^22:24
gxrNo such file 'shogun-3.1.2-Darwin.dmg'.22:24
@sonney2kgxr, try again22:25
gxrsonney2k, works22:25
pickle27awesome!22:26
gxrlooks great. But, I need admin rights to install the package...22:26
gxrreduces the number of users by a large factor.22:26
gxrsonney2k, it is still much better than having to install developer tools and macports first. Hence, this is a huge improvement.22:27
gxrgreat work!22:27
pickle27sonney2k: I'll look into adding builds to the website when Im done with other things22:28
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]22:28
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has joined #shogun22:28
gxrBtw, I have a intel mac (core duo) in a drawer unused.22:29
@sonney2kgxr, well we could also upload a .tar.gz for osx that one can extract22:29
gxrHowever, one can only update the OS to 10.6 or so.22:29
@sonney2kgxr, did the dmg install sth? I mean could you run shogun & python stuff?22:30
@sonney2kI never tried...22:30
gxrsonney2k, tar.bz ball would be a useful addition.22:30
gxrThe package installed something. Just don't know where to.22:30
gxr[MSKI1327 4] /usr/include/shogun > ls base/        distributions/  kernel/  machine/         optimization/  transfer/ classifier/  ensemble/       labels/  mathematics/     preprocessor/  ui/ clustering/  evaluation/     latent/  metric/          regression/ converter/   features/       lib/     modelselection/  statistics/ distance/    io/             loss/    multiclass/      structure/22:32
@sonney2kgxr, I guess /usr/local/*22:32
@sonney2kgxr, looks good and does sth like python22:32
@sonney2kgxr, import modshogun work?22:32
-!- lambday [67157f4f@gateway/web/freenode/ip.103.21.127.79] has quit [Ping timeout: 245 seconds]22:33
gxrsonney2k, no. Installed headers and libs, but I cannot find python packages22:34
@sonney2kgxr, does anything like /usr/local/Cellar* exist?22:35
gxrsonney2k, no.22:35
gxrOk, maybe this goes into too much detail here...22:35
gxrI understand there is lot's of effort already done, but that last bit to pull it all together to something that people can just "click" or run that basic script and have shogun running, that is missing and that is something that needs somebody to spend time on.22:36
gxrI've done this before and it takes time to do this right.22:36
gxrThat's the idea of the project that I had in mind.22:37
gxrThe solution for the "standard university student" with limited access and in a university determined environment.22:38
-!- votjakovr [~votjakovr@188.134.46.30] has quit [Quit: WeeChat 0.4.0]22:38
gxrAny more comments? If not, question two.22:39
shogun-buildbot_build #55 of osx2 - python is complete: Failure [failed test python modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python/builds/5522:39
@sonney2kgxr sure all clear22:39
gxrI got somebody from my group to commit to supervise clustering algorithms.22:40
gxrBut this needs a person to co-supervise who knows shogun better.22:41
gxr(sorry, this is about GSoC).22:41
gxrAre there any takers?22:41
@sonney2kgxr, depends on how involved these are...22:42
@sonney2kgxr, and that person certainly needs to be able to run shogun and check if some example does what is intended22:43
shogun-buildbot_build #2191 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb3%20-%20modular_interfaces/builds/219122:44
gxrsonney2k, well, they have a c++ reference implementation, they can learn how to run shogun, they can supervise the ML side and how to check whether the implementation works and they can work with the gsoc student to get the algorithm worked out better.22:44
@iglesiasgI would not mind being the "Shogun mentor" for a project like that one if we don't get anyone for the project I am proposing to mentor22:44
gxrsonney2k, that's not the case now, but the person can easily learn that.22:44
@sonney2kgxr, then sure22:46
gxriglesiasg, ok, great. This is what's needed here. (Assuming it is ok to offer more projects that we can do in parallel at the same time).22:46
@sonney2kgxr, what we did last year is always have a domain expert and a shogun mentor22:46
gxrsonney2k, yes, I think that's a good idea.22:46
@sonney2kin the end result one made sure the algorithm does what it is supposed to do and came up with some nice examples the student could describe in a ipython notebook22:46
@sonney2kand the other did ensure that it fit into the framework coding style, basic unit tests etc22:47
gxrsonney2k, just wasn't sure how to proceed if there are no takers for the proposed project (I did not get a response to two of the three projects that I have ML mentors for).22:47
@sonney2kwell everyone is busy....22:47
gxrsonney2k, ok, understand. When is the proposal due?22:48
gxrsonney2k, can we then agree to add two of the three projects to the GSoC idea list?22:49
gxr(actually, I got responses for two out of the four projects I proposed).22:49
-!- besser82 [quassel@fedora/besser82] has quit [Remote host closed the connection]22:50
@sonney2kgxr, well the proposal is due friday22:51
@sonney2kgxr, the ideas list is sth we can still polish but we should have some version already even then22:51
@iglesiasggxr, it feels like this year we have many proposals supported by domain expert mentors, but not that many mentors that know a little bit about Shogun22:51
@iglesiasggxr, but in my opinion we can add all those proposals, and then see what students are more interested in and decide which projects should be preferred/are feasible to do taking into account mentor power22:52
gxriglesiasg, sounds like a good plan.22:54
@sonney2kiglesiasg, indeed... simply because lisitsyn is no longer a student and wiking is finishing is phd etc etc22:55
gxriglesiasg, I'd think that if the student isn't adding new infrastructure to shogun, but just a new algorithm, then this should be doable without deep knowledge of shogun.22:55
shogun-buildbot_build #187 of clang34 - undefined behaviour analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/187  blamelist: Roman Votyakov <votjakovr@gmail.com>22:56
shogun-buildbot_build #56 of osx2 - python is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20python/builds/5622:56
gxrbtw, I'll ask for money in the NCI cloud initiative for a programmer (half a year or so).22:56
@iglesiasggxr, it would also be great to get the ideas in a format similar to the ones in http://shogun-toolbox.org/page/Events/gsoc2013_ideas22:56
@sonney2kiglesiasg, hurray http://www.shogun-toolbox.org/doc/en/latest/22:57
@sonney2kI finally fixed the doc upload - I hope it will work again at least ;)22:57
@iglesiasggreat! :)22:57
gxr:-)22:57
gxrsonney2k, what's the status regarding the BSD license stuff?22:58
-!- shogun-buildbot_ [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]22:58
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun22:58
@sonney2kgxr, wiking has some page I don't remember22:59
@iglesiasggxr, sonney2k there you go http://maeth.com/shogun_licensing_stats.php22:59
@sonney2kgxr, maybe 40% green22:59
gxr Soeren Sonnenburg (sonne@debian.org)NOT SIGNED22:59
gxrAre you in or not?22:59
@iglesiasg:DD22:59
@iglesiasgI am more worried about the rest though, we can always ping sonney2k here :)23:01
gxrIs there a way to sort by number of contributed lines?23:01
@iglesiasggxr, there is something in github for that, but there we don't have the signed/not signed thing23:01
gxriglesiasg, yes, but we have to make sure that the people who contributed most code lines do agree. The bottom 50% probably contributed only a few %.23:02
gxrthis one is also problematic: Sebastian Henschel (shogun@kodeaffe.de)NOT SIGNED23:03
@sonney2kgxr, well he did his work under contract of mpg etc so I don't see a problem with sebastian anyways23:04
@sonney2kgxr, I am more concerned about what we do with fhg23:05
gxrsonney2k, ok, good re sebastian. FhG FIRST was closed.23:05
gxrSo, nobody will care or know.23:06
shogun-buildbotbuild #188 of clang34 - undefined behaviour analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/188  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>23:07
gxrTo play safe you can ask a lawyer about it... but I would suggest not to ask the FhG lawyers.23:07
gxrWe could have released the software as BSD software in the days. Nobody would have minded then.23:08
gxrFor some reason we choose GPL. But BSD would have been a option as well.23:08
gxrOk, looks like we should talk about this aspect some more... maybe a call would be better for this.23:09
gxrfor the NCI cloud. do you think the shogun foundation can sign me a letter that there is an effort to shift the license to a non-viral one? That's what's needed to get funding for work on shogun by a programmer.23:11
@sonney2kgxr, just ask HeikoS - he is all in and we are obviously making progress towards this.23:12
gxrOk, will talk to HeikoS then.23:12
-!- besser82 [quassel@fedora/besser82] has joined #shogun23:12
gxr(sonney2k, btw, will be in Berlin around easter. Will follow-up by email re meeting on easter monday)23:13
gxrWhat's needed to get the proposal done?23:14
@sonney2kgxr, I hope there is some more incentive though like e.g. something joint with scikits23:14
gxrI have limited time, but if there is some urgencies or something specific I can do, then I'll try to help.23:14
@sonney2kgxr, well Heiko will do the proposal23:14
@sonney2khopefully send around a draft23:15
@sonney2ktomorrow23:15
@sonney2kso doing an iteration would help23:15
gxrsonney2k, don't understand the scikits reference.23:15
@sonney2kthe rest is on the way I would say23:15
@sonney2kgxr, ahh we want to organize another workshop just after europython in berlin23:15
gxrOk. not sure I can make it.23:16
@sonney2kgxr, well some kind of collaboration with them would be nice. they have all the basic algorithms but miss some advanced stuff23:16
gxr(will try though).23:16
gxrok, re joint meeting.23:17
@sonney2kgxr, july 28th would be the plan23:17
gxrsonney2k, but I have some concerns regarding too much python in shogun. My take on this is that shogun is great and one important reason is that it can be used from many different languages and hence can reach much more people.23:18
@sonney2kgxr, well python is *the* language of scientific computing nowadays23:19
@sonney2kall the rest has become pretty insignificant23:19
gxrWell, that's an opinion that not everybody will agree on.23:20
@sonney2kbut yes it is nice to have pure c++ programs and java23:20
@sonney2kand there is little to nothing for octave except shogun. same holds for ruby etc23:20
gxrR, java, octave/matlab ...23:20
@sonney2kmatlab doesn't even work atm I think - just because no one here has it23:21
gxrR is a case which has lot's of computation. Combio people appear to use more R and less python.23:21
@sonney2ktrue R is also pretty popular23:22
@sonney2kbut python is a different league23:22
shogun-buildbotbuild #182 of clang34 - thread analysis is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/182  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>, Roman Votyakov <votjakovr@gmail.com>23:22
@sonney2kR modular works now with shogun but sometimes the error messages are weird23:23
gxrR support is rather limited and much less tested than python. To get people to use shogun in R is to have a bioconductor package.23:23
gxrpubmed finds ≈500 publications on "bioconductor" and ≈1200 papers with "python". (which isn't quite a fair comparison as I cannot use the broader term "R" for the search)23:24
gxrSo, yes, python is somewhat more popular, but I wouldn't say the difference is huge.23:25
gxr(in the field of "data scientists", not computer science or engineering in general)23:26
@sonney2kgxr, well R works the way it can with swig so we cannot really do much23:26
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]23:27
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun23:27
gxrNot sure what the state is here, but from what I heard is that the swig/R interface isn't stable enough for serious use.23:27
gxrAm I wrong her?23:28
@sonney2kgxr, for sure there is no way around shogun if you want to use it from multiple languages23:28
@sonney2kgxr, well all the shogun examples just run fine...23:28
gxrI understand that there are memory management issues.23:28
@sonney2kgxr, http://buildbot.shogun-toolbox.org/builders/deb3%20-%20modular_interfaces/builds/2191/steps/test%20r%20modular/logs/stdio23:29
@sonney2kgxr, not that I know of23:29
@sonney2kwe only have 54 examples but still23:29
gxrok, maybe then this is working ok now and I'm out-of-date (quite possibly).23:29
@sonney2kgxr, yeah we had these problems maybe until 1 year back23:30
@sonney2kbut it is ok now23:30
gxrgetting a bioconductor package would increase usage of shogun a lot.23:30
gxrbut this requires to have the package available on multiple platforms. I believe one is windows.23:30
@sonney2kgxr, very tough23:31
gxrAnd the acceptance criteria are tough23:31
gxrIs this something a GSoC student could do?23:31
@sonney2kgxr, I think already a win32 port is very tough23:32
gxr(tough here mostly means, to do all the leg work, fix warnings, getting the packages to compile etc).23:32
gxrHm, maybe too tough.23:32
@sonney2kyeah it might mean not to get it to work even23:32
@sonney2kwiking tried and failed23:33
@sonney2kbut of course no one had the time to try it for 3 months straight23:33
gxrCan we break it into pieces and come up with a plan to have it in 2-3 years?23:33
gxrSo, for instance, first only lib-shogun with R-static basic functionality.23:34
@iglesiasgAll right guys, I abandon for today. Tty again soon!23:34
@sonney2kiglesiasg, see you around!23:35
@sonney2kgxr, yes first libshogun23:35
-!- iglesiasg [~iglesiasg@524AE0A7.cm-4-3d.dynamic.ziggo.nl] has quit [Quit: Leaving]23:35
gxrsee you!23:35
@sonney2kgxr, the rest will be easy I suspect23:35
gxrso, is this something one should try as a "hard" GSoC project?23:36
gxr(I personally think it would be worth trying, to get all these R people to use and like shogun)23:37
@sonney2kgxr, the windows port yes23:38
@sonney2kgxr, alright I am too tired too23:39
gxrok, good. was great irc'ing. Sorry that I was late...23:39
gxrWill try to join earlier next time.23:39
@sonney2kgxr, thanks for joining23:39
gxrthanks for organizing the meeting!23:40
gxrCU23:40
-!- gxr [8ca3fe9e@gateway/web/freenode/ip.140.163.254.158] has left #shogun []23:40
@sonney2kcu23:40
-!- FSCV [~FSCV@50.7.50.60] has joined #shogun23:56
-!- FSCV [~FSCV@50.7.50.60] has quit [Remote host closed the connection]23:57
-!- pickle27 [d8bfe7da@gateway/web/freenode/ip.216.191.231.218] has quit [Ping timeout: 245 seconds]23:59
--- Log closed Tue Feb 11 00:00:53 2014

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!