IRC logs of #shogun for Monday, 2011-07-18

--- Log opened Mon Jul 18 00:00:11 2011
--- Day changed Mon Jul 18 2011
f-xsonney2k: so its fine to add a %import "Features.i" line in Library.i?00:00
f-xfeels like the class separation would be messed up00:00
@sonney2kf-x, it certainly is messed up - but not only there00:01
@sonney2kI don't see how this can be resolved though00:01
f-xsonney2k: one option is separating all the streaming stuff into a separate file - that would not touch the 'base' interfaces like Library, Features etc. but again that wouldn't be very consistent with the overall scheme00:03
f-xon the other hand, the central interfaces would be clean00:03
f-xwe would need to import Streaming.i from a few of these files though00:03
@sonney2kyeah and there comes the problem that it is not consitent00:04
@sonney2kwhatever clean solution we try to do - we should do it in a way that it is the same from the c++ and the swig interface side00:04
f-xsonney2k: as a matter of good design, or will it not work otherwise?00:05
@sonney2kyes only wrt design00:05
f-xi'm thinking i should wait until (if) i can come up with a better way00:05
f-xthan messing with all the .i files just for these additions00:06
@sonney2kI am afraid that this will require a lot of restructuring00:06
@sonney2kI mean there is already some mess in there now - and if we resolve it we should really resolve it00:06
@sonney2kthat would probably mean that one has to split up library into mulitple pieces00:07
f-xsonney2k: i vote we resolve it first, and then i can add this stuff00:07
@sonney2kf-x, I would say just try if this 'hack' works and we resolve later00:07
@sonney2kotherwise we have too many things to resolve at once00:08
* sonney2k continues the interface transition00:08
f-xsonney2k: well ok.. i'll try to keep it as clean as i can00:08
blackburngood design is not about shogun now :D00:09
@sonney2kblackburn, just think of a better design - and we will see if it is possible00:11
@sonney2kbetter design == no mutual includes00:11
blackburnsonney2k: I don't know how to it better :)00:11
bettyboo^_^00:11
@sonney2kblackburn, f-x I would really wish we could even modularize shogun further00:13
@sonney2ksuch that one could ship e.g. classifiers in one library separately00:13
@sonney2kbut I don't see it00:14
f-xsonney2k: too many dependencies on other shogun features?00:14
@sonney2kyeah00:14
@sonney2klike the one you have00:14
@sonney2keven for shoguns 'Features'00:14
@sonney2kthey use Distributions to generate features00:14
@sonney2kor Kernels can use distances etc etc00:15
@sonney2kf-x, how would one resolve that?00:24
blackburnput all the files into megashogun folder00:25
blackburnsonney2k: drei mal zwei ist sechs00:26
@sonney2kkoneschno00:27
blackburnsonney2k: ich bin 20 jahre alt00:27
blackburnwie alt sind sie?00:27
@sonney2ktebja sowut sergey00:27
blackburna tebya zyoren00:27
blackburn:D00:27
blackburnhmm I have an idea how to joke with chris00:29
blackburnI will write him a letter in deutsch00:29
blackburnsonney2k: умляут или умлаут?00:37
@sonney2khmmhh compilation times are down to 000:44
blackburneeeeh?00:45
@sonney2kyeah hard to beat00:48
-!- blackburn1 [~blackburn@188.122.238.99] has joined #shogun02:02
-!- blackburn1 [~blackburn@188.122.238.99] has quit [Client Quit]02:04
-!- blackburn [~blackburn@188.122.238.99] has quit [Ping timeout: 255 seconds]02:05
CIA-87shogun: Soeren Sonnenburg master * rb01925e / (1663 files in 79 dirs):02:11
CIA-87shogun: Restructure repository, such that02:11
CIA-87shogun: - libshogun and libshogunui are merged and in shogun subdir02:11
CIA-87shogun: - all interfaces are found in src/interfaces/<interface>02:11
@sonney2kprobably the biggest change ever02:11
CIA-87shogun: - static interfaces have a _static suffix - http://bit.ly/ncU4f302:11
@sonney2kf-x, did you manage to get it to work?02:33
f-xsonney2k: i'm finding i need to include lots of *_includes.i files in other interface files02:38
@sonney2kf-x, yes that is 'normal'02:38
f-xsonney2k: for example02:38
f-xi think02:38
@sonney2kI know it is a pain in fact02:38
@sonney2kbut due to that cross-linking there is no other way - swig is not recursively including anything so you have to unroll the include's02:39
f-xsonney2k: exactly02:39
f-xso is it sensible to make a 'cumulative' include file?02:39
@sonney2kI think that would be even worse02:40
f-xwhen i say include 'Features_include.i', i intuitively assume that all #includes needed by Features.i will be satisfied by that call02:40
@sonney2kthen whenever that file is touched -> everything needs to be rebuilt02:40
f-xsonney2k: right.. with these unnecessary includes i have to add, compilation time is going up,up,up02:40
@sonney2kbut it is like this no?02:40
f-xsonney2k: i don't think so02:41
f-xwe have to include each file included by Features.i again02:41
@sonney2kwhat is missing?02:41
f-xnow that Features and Library depend on each other,02:41
f-x1. we have to include all of Feature's includes02:42
f-x2. we have to include all of Library's includes02:42
f-xtoo02:42
@sonney2kyeah but that is why I have this inlcude Library_includes.i there02:42
f-x(whenever we want to import either of their .i files)02:42
@sonney2k%include "Library_includes.i"02:42
@sonney2kin Features.i02:42
CIA-87shogun: Soeren Sonnenburg master * rccc1ef3 / (16 files in 4 dirs):02:59
CIA-87shogun: fix errors after occurring with doxygen etc caused by the interfaces/02:59
CIA-87shogun: move - http://bit.ly/niwCwF02:59
@sonney2kf-x, I've restructured the repository02:59
@sonney2kbut left modular where it was02:59
@sonney2kso when you have your patch ready  - submit it - then I will also relocate the modular dir02:59
f-xsonney2k: great job :)03:00
f-xand yeah03:00
f-xok03:00
@sonney2kif I had inf time I would do much more polishing in this configure / make stuff03:00
@sonney2kbut the way it is I only made it work - there is 0 beauty in this03:01
@sonney2kanyway - need to sleep now cu!03:01
-!- f-x [~user@117.192.218.159] has quit [Ping timeout: 260 seconds]04:24
CIA-87shogun: Soeren Sonnenburg master * rff7b19d / src/configure : don't try to tail configure.log if file doesn't exist - http://bit.ly/pLUExP08:53
CIA-87shogun: Soeren Sonnenburg master * r9c679cc / (11 files in 3 dirs):08:56
CIA-87shogun: Merge pull request #207 from frx/python_stream_bad08:56
CIA-87shogun: StreamingFeatures modular interfaces - http://bit.ly/qFfK5I08:56
CIA-87shogun: Soeren Sonnenburg master * r61a56fc / src/Makefile : generated shogun/Makefile depends on Makefile.template - http://bit.ly/pxJmOG09:50
CIA-87shogun: Soeren Sonnenburg master * r300df4a / (6 files in 3 dirs): fix a number of path issues caused by interface transition - http://bit.ly/rfuGS109:50
CIA-87shogun: Soeren Sonnenburg master * r5dbeb21 / (75 files in 3 dirs): move modular into interfaces/ - http://bit.ly/nG1tTf09:50
CIA-87shogun: Soeren Sonnenburg master * r118155e / src/configure : fix configure to not generate a.out cruft - http://bit.ly/nTzYGQ10:11
CIA-87shogun: Soeren Sonnenburg master * rebf230a / (src/INSTALL src/README.developer src/configure):10:35
CIA-87shogun: update documentation to new layout (libshogun never needs to be10:35
CIA-87shogun: specified on ./configure --interfaces=xxx from now on) - http://bit.ly/mVpvJc10:35
-!- blackburn [~blackburn@188.122.238.99] has joined #shogun11:44
blackburnsonney2k: berserk!11:45
-!- cwidmer [~quassel@connect.tuebingen.mpg.de] has joined #shogun12:15
blackburnstrange to meet you, cwidmer ;)12:26
-!- blackburn [~blackburn@188.122.238.99] has quit [Quit: Leaving.]12:44
-!- gsomix [~gsomix@85.26.234.128] has joined #shogun13:28
-!- heiko [~heiko@main.uni-duisburg.de] has joined #shogun13:45
@sonney2kheiko, hey!13:45
@sonney2kheiko, ping me please if you wake up :D14:32
-!- gsomix [~gsomix@85.26.234.128] has quit [Ping timeout: 255 seconds]14:39
@sonney2kalesis_, any news on the examples?14:50
-!- gsomix [~gsomix@85.26.235.120] has joined #shogun14:51
-!- gsomix [~gsomix@85.26.235.120] has quit [Ping timeout: 255 seconds]14:59
-!- gsomix [~gsomix@85.26.234.160] has joined #shogun15:11
heikosonney2k, hi there!15:18
heikojust woke up :D15:18
heikoand also some questions:15:18
heikoI want to implement computing confidence intervals for the evaluation of a machine15:19
@sonney2kheiko, good morning ;-)15:19
@sonney2kthere are a number of rather drastic changes in shogun now15:19
@sonney2kand one more to come15:20
heikofor the confidence intervals, I need to borrow some statistics code, and I thought of perhaps putting this into a new class like CStatistics instead of CMathematics ... but to high priority for now, I just worked on this on the weekend a bit15:20
@sonney2kso you should probably have a look15:20
heikook15:20
heikowhats happening?15:20
@sonney2kwe decided to just re-organize the repository15:21
@sonney2knot functional changes (letst hope so)15:21
@sonney2kwhich means15:21
@sonney2kwe only have a directory src/shogun now with libshogun and libshogunui merged15:22
@sonney2kthen a directory interfaces15:22
@sonney2kwith all the interfaces beneath15:22
heikook15:22
@sonney2kincluding the 'modular' directory15:22
@sonney2kand renamed all the python,matlab,... static interfaces to python_static, etc15:22
@sonney2kwhen doing configure one now has to say only --interfaces=python_modular15:23
@sonney2kif you don't want anything besides libshogun (that will be always built) then --interfaces=15:24
@sonney2kthat makes it much easier to grasp what shogun is about15:24
@sonney2kand new comers don't have to specify libshogun or so ever15:24
heikook15:24
@sonney2kI am now changing all include paths to look like15:24
@sonney2k<shogun/features/SimpleFeatures.h>15:25
@sonney2kthis way I can directly install the header files into usr/include15:25
heikook15:25
@sonney2kand one can build c++ extensions with libshogun + src15:25
heikojust fetched current git15:25
heikobuilding ...15:26
@sonney2kheiko, things will change in a minute again though...15:26
@sonney2kheiko, regarding the statistics thingy15:26
@sonney2kI wonder if we should split up library a bit15:26
@sonney2kI mean having some math subdir wouldn't hurt...15:26
heikoyes, something like this15:26
heikothe mathematics file is huge already15:27
@sonney2klibrary just became too big... I mean i/o for example could also be in a different dir15:27
heikocomputing a students t distribution would make it even larger15:27
@sonney2kyeah15:27
@sonney2kand the pvalue stuff I recently added does also not make that much sense in there...15:27
@sonney2khowever, if we do redesign / relocation we should rather do it in the next 2 weeks15:29
heikook, I will put the new methods in this statistics file then15:29
@sonney2kotherwise we won't get any stability in august15:29
heikothe file is additionally then for now and is moved in two weeks15:29
@sonney2kheiko, I think we should have a math15:31
@sonney2kand an io dir in shogun/15:31
@sonney2kthen it is already much more digestible15:31
@sonney2ktwo more swig modules then + more fine grained control possible15:31
heikoWhat about the kernel/distance machine stuff?15:32
heikoI think this should be done next15:32
@sonney2k?15:32
heikohow they store their model15:33
heikoindices/copies of feature vectors15:33
@sonney2kahh yes15:33
@sonney2kthat is true15:33
@sonney2kthat is another big issue15:33
@sonney2kthe only other thing I can think of is that it is pretty messy in swig to do the %import / %include stuff15:34
@sonney2kdue to e.g. kernels being able to use distances15:34
@sonney2kor files that emulate streaming from features15:34
@sonney2kthese cross-links kill the nice separation we had15:35
@sonney2kbut on the other hand these are damn cool features.15:35
@sonney2kno idea how to fix this....15:35
CIA-87shogun: Soeren Sonnenburg master * r7719b1c / examples/undocumented/python_modular/distribution_ppwm_modular.py : make ppwm example a bit more meaningful - http://bit.ly/pUUoGH15:39
CIA-87shogun: Soeren Sonnenburg master * re364989 / (548 files in 18 dirs):15:39
CIA-87shogun: change include paths to be all relative to /src, e.g.15:39
CIA-87shogun: <shogun/features/SimpleFeatures.i> - http://bit.ly/nHKwVU15:39
@sonney2kheiko, any thoughts about the Modelselection vs ModelSelection issue?15:39
heikosorry, a professor just came in :)15:40
heikobut back now15:40
heikothe name clash: just change it all to ModelSelection?15:41
heikoI do no remember why I exactly did this, but I thought i stepped over something similar: CamelCase in libshogun Camelcase in swig15:42
heikosonney2k, should I just go for the kernelmachine change when I am done with the confidence intervals?15:44
@sonney2kheiko, btw I set up another mirror http://code.google.com/p/shogun-toolbox/source/browse/15:45
@sonney2k(code.google.com finally support git too :)15:45
@sonney2kheiko, yes15:45
heikoah ok cool, google code is nice :)15:46
heikook, then I will go for that now ...15:46
heikowill change the Modelselection names on the fly15:46
@sonney2kheiko, regarding the naming it should be consistent at least15:47
-!- gsomix [~gsomix@85.26.234.160] has quit [Ping timeout: 250 seconds]15:47
@sonney2kModelSelection?15:47
heikoyes true15:47
heikoyes, like that more15:47
@sonney2kit is a borderline case15:52
@sonney2kPreprocessor vs PreProcessor15:52
@sonney2kwe chose the first one for that15:52
heikoah yes, that was my source of inspiration :)15:52
bettybooha ha15:52
@sonney2kbut it is Preprocessor also in C++15:53
@sonney2kso that is different from your approach :D15:53
heikook then,15:53
heikoi confest :)15:53
heikoi do not like camel case ;)15:53
@sonney2kyou will run into a problem though15:53
@sonney2kIIRC you have a class called ModelSelection15:54
@sonney2kso you will get a naming clash15:54
@sonney2kthe module name will clash with the class name15:54
@sonney2kthat is a problem for java_modular15:54
@sonney2kahh and before renaming please git pull --rebase again15:55
-!- gsomix [~gsomix@85.26.234.160] has joined #shogun15:55
@sonney2kheiko, nice plan for this week15:56
@sonney2kjust seen your weekly report...15:56
heikothanks :)15:56
heikohope this does not take too long15:56
heikoI will borrow some methods from ALGLIB for the students t distribution15:57
@sonney2kthe kernel/distance thing can be a nightmare ...15:57
heikoyes this thing also15:57
heikohopefully not :)15:57
@sonney2kheiko, just make sure that we don't get a licensing clash15:57
heikoit is gpl 2+15:57
heikois that ok?15:57
@sonney2kyes perfect15:59
heikook15:59
heikoI initially thought this would be some minor stuff15:59
heikobut students t needs gammafunction betafunction and some other stuff16:00
heikoso there will be like 5 new methods16:00
heikonumerical stuff16:00
@sonney2kheiko, gammafunction is already in math right16:02
@sonney2klgamma right?16:02
heikooh16:02
heikodid not see16:02
@sonney2kheiko, well iti s a standard thing in llibm16:03
@sonney2klibm16:03
@sonney2kheiko, does ALGLIB have its own implementation for that?16:04
@sonney2kif so I would be interested in seeing how much these things differ - I mean who has better numerical precision16:05
heikoyes, alglib has its own implementation, seems like they pay much attention on numerical correctness16:06
heikothey have it documented in the method comments16:06
@sonney2kok then it doesn't hurt to have their method in there too16:10
@sonney2kOK things still compile for all interfaces :-))16:11
@sonney2kso heiko feel free to do the rename16:11
@sonney2kheiko, ahh btw regarding the naming clash: we had that with module Kernel and class Kernel16:12
@sonney2kso I renamed the class to KernelBase16:12
@sonney2k(in swig only)16:12
heikoalready done, currently building to test whether i forgot something16:12
@sonney2kjust do the same if you run into problems16:12
@sonney2kyou will need interfaces=python_modular,java_modular to catch all problems16:13
* sonney2k thinks we need some public *fast* build-bot just for shogun devel's16:13
heikook16:13
* heiko agrees16:14
heikothat would be quite cool16:14
@sonney2ktoo bad that I cannot afford one from GSoC money...16:15
heikowouldnt the TU-Berlin support this?16:15
@sonney2knot really a dedicated server ...16:16
@sonney2kjust some processor like this http://geizhals.at/deutschland/655274 and 32G of memory and some ugly harddrive16:19
-!- [1]warpy [~warpy@bzq-79-181-19-104.red.bezeqint.net] has joined #shogun16:19
heikooh, :(16:20
@sonney2kheiko, ?16:21
heikothe processor16:21
@sonney2kyes what about it?16:22
heikonot enough for a fast buildbot16:22
@sonney2kheiko, why not?16:23
@sonney2k6cores...16:23
[1]warpyhey soeren16:23
heikodont you use it for other stuff?16:24
[1]warpydid you get a chance to dig into the c# thing16:24
heikothe bioinformaticians here have a 250 core cluster :D16:24
bettyboo :>16:24
@sonney2kheiko, I've seen shogun compile on some 8-16 core machines. it takes <1 minute16:25
@sonney2konly harddrive is the speed limit then16:25
heikocool thing :)16:25
heikohere, it takes more than five minutes16:25
heikoespecially the wrap.cxx files take long16:26
@sonney2kheiko, but developing just the library is fast ... only swig based interfaces is a pain, but using ccache + --disable-optimizations --enable-debug --disable-doxygen it is ok16:26
@sonney2kheiko, yes these are >2MB files16:26
heikoyes, thats the way i do it16:26
@sonney2kif you only change anything in a .cpp file it doesn't take any time...16:26
heikoyes, true16:27
@sonney2kso we should probably put more in *.cpp16:27
@sonney2kanything that is not timing critical16:27
@sonney2k[1]warpy, I thought daniel wanted to have a look16:27
@sonney2k[1]warpy, I didn't yet... but there is some good news: sploving will also work on c# at some point in august.16:28
[1]warpygreat16:40
[1]warpyyeah he was planning to work on it16:40
[1]warpybut since we are in a different time zone (we and him)16:40
[1]warpyyour reply probably came at night16:41
[1]warpyi am sure he will only touch it next week16:41
[1]warpyi realy hope baozeng helps us. its impressive what he is doing16:41
@sonney2khe will do lua and ruby first though16:44
@sonney2kand surely c# is more difficult than the other two together16:44
heikosonney2k, just got a linker error, because i do not have ant installed16:50
heikothis perhaps should be checked ?16:50
@sonney2ksurprising... I don't like that we need ant anyways. we could have easily done this w/o16:51
@sonney2kbut hey java guys :)16:51
heiko ;)16:52
bettyboo:Q16:52
@sonney2kwe are lucky that they didn't suck in maven16:52
gsomixsonney2k, I'm going to integrate C5.0. All questions will be coordinated with blackburn. Ok?16:54
@sonney2kgsomix, great :-)16:54
@sonney2klooking very much forward to it16:54
@sonney2kI discussed with blackburn recently about it so plan would be to first get it in wrapper style and then modify the internals of C5.0 to use shogun's feature representations.16:56
[1]warpywhy do you think its more difficult ?16:56
[1]warpywe have ton some of the word..16:57
CIA-87shogun: Soeren Sonnenburg master * r8e49447 / src/configure : test whether ant is installed (and disable java if not available) - http://bit.ly/nySl8t17:00
@sonney2k[1]warpy, the typemaps are just not useful as of now17:00
@sonney2k[1]warpy, however it would help a lot if you ported the examples17:00
@sonney2kthis would help sploving a lot17:01
@sonney2kheiko, ^ fixed the ant detection17:01
@sonney2khope it tells you that java won't work now :)17:01
[1]warpyi did port them17:03
[1]warpyhe might have added more by most are already ported17:04
[1]warpyjava and c# are almost identical when it comes to easy code17:04
@sonney2k[1]warpy, yeah but we don't know yet if these are working17:04
[1]warpyyou can check out my fork17:04
heikosonney2k, well, I installed ant in the meantime to check my  name changes :)17:04
[1]warpyi have no idea how to test those without the typemap thing..17:05
[1]warpyso its a chicken and egg for now :)17:05
@sonney2k[1]warpy, it is impossible17:05
@sonney2kyes17:05
@sonney2kheiko, bah17:05
* sonney2k renames ant17:05
heikoehm, what?17:05
@sonney2kheiko, btw build time for shogun here with full python_modular 1 minute 43 secs17:06
heikothats good :)17:06
heikoI will hopefully buy a new computer soon17:06
@sonney2k(core 2 duo - nothing too fancy)17:06
heikomain problem here is memory17:06
heikoits always full, so harddisc is working a lot17:07
@sonney2k[1]warpy, eventually we will get there - but it is better that the main work rests not on my shoulders this time. otherwise we won't get anything done17:07
heikojust sent pull request for name change17:07
@sonney2kheiko, but memory is el cheapo17:07
@sonney2kIIRC I just bought 8GB for this notebook for 40 EUR or so17:07
heikotrue, but my slots are already full, well perhaps I will buy some17:08
heikoand throw the old away17:08
CIA-87shogun: Heiko Strathmann master * r9541603 / (8 files in 2 dirs): renamed Modelselection to ModelSelection - http://bit.ly/oDWEhM17:08
CIA-87shogun: Soeren Sonnenburg master * rd67fba1 / (8 files in 2 dirs):17:08
CIA-87shogun: Merge pull request #208 from karlnapf/master17:08
CIA-87shogun: Modelselection ->ModelSelection - http://bit.ly/pPMG0Q17:08
@sonney2kheiko, I have 2x 4GB now in here17:09
@sonney2kBTW only because 1 memory module died recently I know all this ...17:09
@sonney2kheiko, thx for the patch - exactly as I would have done it!!!17:09
heikohehe ok :)  8GB is something i need here17:10
* heiko checks amazon17:10
[1]warpyi will try to convert all the examples if there are new ones. i understand that the java examples are considered finished ?17:10
@sonney2k[1]warpy, more or less... some still have problems but the big majority works17:11
@sonney2k[1]warpy, btw send a pull request and I merge them - chances are good that sploving will modify them when he attempts to do the interface17:11
heikosonney2k, where did you buy your memory?17:12
@sonney2kheiko, now imagine what a hexacore would do ... compile time probably 30 secs17:12
@sonney2kheiko, I checked geizhals.at17:13
@sonney2kgeizhals.at/de that is17:13
heikosonney2k, as for the multi-core stuff ... It would be really cool if the grid-search model selection would use munltiple threads17:13
@sonney2kheiko, surely it would but I am afraid that we have to do a full redesign to support this17:14
heikoreally?17:14
@sonney2kso better postpone for shogun 2.017:14
heikobasically all iterations of one loop should be parallel17:14
heikobut they are completely independent17:14
@sonney2kyou would need to create different data splits, different models etc17:14
@sonney2kbut really clone them or?17:15
heikook yes, true17:15
@sonney2kok for data you could have multiple data objects with different views somehow17:15
@sonney2kbut that we don't have right now17:15
heikotrue, ok then, shogun 2.0 :)17:15
heikonext gsoc :)17:15
@sonney2kif you do that then you can aswell support some fancy distributed model selection thing...17:16
@sonney2kI mean distribute to cluster nodes17:16
heikoyes, really cool stuff :)17:16
heikocompletely cool17:16
@sonney2kshould be possible since every shogun object can be serialized17:16
@sonney2kdata should probably get some different handling :)17:17
heikommh 63€ here for 2*2GB17:17
@sonney2kheiko, http://geizhals.at/deutschland/607694 ?17:18
@sonney2kno idea what type of memory you need - but the above looks rather cheap17:18
heikoi got an inspiron notebook from dell. need this here17:19
heikohttp://www.geizkragen.de/suche/2GB%20-%20PC2-5300%20-%20DDR2%20667MHz%20200pin%20SO-DIMM%20DDR2#tabdiv17:19
@sonney2k19 EUR17:19
heikooh yes17:19
heikogeizkragen is worse than geizhals :)17:19
@sonney2kdon't use geizkragen17:20
@sonney2kthat's just crap17:20
@sonney2kbut you are right DDR2 memory is much more expensive17:20
@sonney2kanyway back to work17:21
heikoyes :)17:21
[1]warpysonney2k, which uni are you at ?17:35
-!- heiko [~heiko@main.uni-duisburg.de] has quit [Ping timeout: 258 seconds]18:08
-!- [1]warpy [~warpy@bzq-79-181-19-104.red.bezeqint.net] has quit [Quit: HydraIRC -> http://www.hydrairc.com <- In tests, 0x09 out of 0x0A l33t h4x0rz prefer it :)]18:49
-!- serialhex [~quassel@99-101-148-183.lightspeed.wepbfl.sbcglobal.net] has quit [Read error: Connection reset by peer]19:27
-!- blackburn [~blackburn@188.122.238.99] has joined #shogun19:27
blackburnhey revolutionary guys you have revolutioned it pretty much so far19:34
-!- gsomix [~gsomix@85.26.234.160] has quit [Ping timeout: 259 seconds]19:50
-!- gsomix [~gsomix@109.169.235.179] has joined #shogun20:08
-!- gsomix [~gsomix@109.169.235.179] has quit [Ping timeout: 252 seconds]20:13
-!- gsomix [~gsomix@85.26.234.160] has joined #shogun20:26
-!- gsomix [~gsomix@85.26.234.160] has quit [Ping timeout: 276 seconds]20:49
@sonney2kblackburn, ~~~ooohh~~~soviet~~~~russia~~~you~~~make~~~me~~~feeel~~~like~~~reeeeeeevolution!~~~la~~20:54
blackburn:D20:54
@sonney2kblackburn, does everything still work for you?20:55
blackburnat morning it did20:55
blackburn'll check now20:56
@sonney2kthen it will probably still work20:56
@sonney2kblackburn, so it is time for more breakage^H^H^H^H^H^restructuring20:57
blackburnmore??20:57
@sonney2kblackburn, yeah I was thinking the Library.i  / the lib/ folder got too big20:57
@sonney2kso I would suggest to have an io module20:58
@sonney2kand a math module20:58
@sonney2kand then split up Mathematics depending on what functions are in there20:58
blackburnsonney2k: are sub-namespace possible for C++?20:58
blackburnshogun::math?20:59
blackburnah nevermind20:59
blackburnbad idea20:59
blackburnhehe20:59
@sonney2kI don't know - I guess so but I am not a big fan of doing it20:59
@sonney2klib/ has now 86 files21:00
@sonney2kthat is just too much21:00
@sonney2kblackburn, btw http://code.google.com/p/shogun-toolbox/21:02
@sonney2kanother mirror21:03
@sonney2kI added you as committer21:03
-!- blackburn1 [~blackburn@188.122.238.99] has joined #shogun21:03
@sonney2kblackburn, so just do git remote add google https://code.google.com/p/shogun-toolbox/21:03
@sonney2kaha21:03
@sonney2kwho is who now blackburn vs blackburn1?21:03
blackburn1sorry I will be disconnected again hehe21:04
-!- blackburn [~blackburn@188.122.238.99] has quit [Ping timeout: 255 seconds]21:04
-!- blackburn [~blackburn@188.122.238.99] has joined #shogun21:05
blackburnokay here more stable now21:05
blackburnwired hehe21:05
blackburnsonney2k: should i push to google too?21:05
@sonney2kyes21:06
blackburnokay21:06
blackburnit is nice they enabled git21:06
@sonney2kwhat was the last message you'v seen21:06
@sonney2k?21:06
blackburn(11:00:29 PM) sonney2k: lib/ has now 86 files21:06
blackburn(11:00:56 PM) sonney2k: that is just too much21:06
blackburn(11:03:46 PM) sonney2k: who is who now blackburn vs blackburn1?21:06
blackburn(11:04:07 PM) blackburn1: sorry I will be disconnected again hehe21:06
@sonney2k<sonney2k> blackburn, btw http://code.google.com/p/shogun-toolbox/21:07
@sonney2k<sonney2k> another mirror21:07
@sonney2k<sonney2k> I added you as committer21:07
@sonney2k--> blackburn1 (~blackburn@188.122.238.99) has joined #shogun21:07
@sonney2k<sonney2k> blackburn, so just do git remote add google https://code.google.com/p/shogun-toolbox/21:07
@sonney2k<sonney2k> aha21:07
blackburnah okay21:07
@sonney2khaving 3 mirrors will make backups obsolete :D21:08
@sonney2kso just push there too21:08
blackburnyeah hehe21:08
-!- blackburn1 [~blackburn@188.122.238.99] has quit [Ping timeout: 255 seconds]21:08
@sonney2kso what do you think - should we split up lib/ too or are you already happy now?21:09
@sonney2kblackburn, ^21:10
@sonney2k?21:10
blackburndon't know21:10
blackburnin fact I don't feel embaressed with too large lib/ :D21:10
@sonney2kat least - I like the new structure quite a bit21:11
@sonney2kblackburn, yeah but io and math would be very logical sub-units21:11
@sonney2kwe have like 30 i/o classes in there21:11
blackburnif you have time - do it21:11
@sonney2kand math will contain some statistics and general and loss functions21:11
@sonney2kI never have time21:12
@sonney2kbut it is now or neer21:13
@sonney2knever21:13
blackburnyeah, now is better ;)21:13
@sonney2kblackburn, do you like the new structure or now?21:13
@sonney2kyou seem a little quiet today...21:13
blackburnexactly it is better than it was21:13
@sonney2kblackburn, math or mathematics as subfolders?21:15
@sonney2kblackburn, disconnected again?21:16
@sonney2kseems so21:16
* sonney2k chooses mathematics21:17
-!- gsomix [~gsomix@178.45.37.165] has joined #shogun21:17
blackburnsonney2k: sorry was afk21:18
blackburnsonney2k: up to you, both are ok21:18
@sonney2ki guess math will have more clash potential21:21
* sonney2k enters berserk mode again21:29
blackburnsonney2k: how about add an article to machinelearning.ru? should I?21:30
blackburnabout shogun of course21:30
@sonney2kblackburn, when version 1.0 is out and you have the russian docu ready :)21:30
blackburnhmm yes21:31
blackburnmakes more sense21:31
@sonney2kblackburn, btw we have to update NEWS file with all the changes21:31
@sonney2kI am slowly loosing track...21:31
blackburnyes I was talking bout it yesterday21:31
blackburnI completely lost it21:32
@sonney2kcurrently it lists nothing21:32
@sonney2kblackburn, btw one more thing that is an easy task is to move quite a lot of code from *.h files into *.cpp21:34
@sonney2kall finctions that are not time critical21:34
@sonney2kthat will increase the size of libshogun but decrease compile time / wrapper size21:34
@sonney2kthings like get_matrix etc21:34
@sonney2kof course this won't work for templates...21:34
blackburnsonney2k: ehhh?21:35
blackburnhow will it improve performance?21:35
@sonney2kehh what?21:35
@sonney2kI don't understand this question.21:36
blackburn(11:34:00 PM) sonney2k: blackburn, btw one more thing that is an easy task is to move quite a lot of code from *.h files into *.cpp21:36
blackburn(11:34:09 PM) sonney2k: all finctions that are not time critical21:36
@sonney2kyes exactly21:36
@sonney2kso all the multiple include stuff in all the interfaces will go away21:37
blackburnhow it depends on where is the code?21:37
@sonney2k-> smaller wrapper21:37
@sonney2k-> faster compilation21:37
blackburnso better to write all the code in .cpp?21:37
blackburnseriously it is surprise to me21:37
@sonney2kif one changes sth in the *.cpp files -> no need to recompile the wrappers21:37
@sonney2kcurrently if you touch a .h file the interfaces are regenerated21:38
@sonney2kjust touch Mathematics.h21:38
@sonney2kand you know what I mean21:38
@sonney2ktouch Mathematics.cpp -> compile time 2 secs21:38
blackburnahh21:38
blackburnokay I will move my code from .h to .cpp now ;)21:39
blackburngsomix: join us hehe21:41
blackburnit's ok to be gay lets rejoice with the boys21:41
@sonney2kblackburn, well only do this for non-time critical stuff21:41
@sonney2kor for code that communicates only within libshogun21:41
blackburnhow will it depends on performance?21:42
@sonney2kfor other things it can matter21:42
blackburndon't understand21:42
@sonney2kblackburn, inline'd functions21:42
@sonney2kthey will just be copy-pasted to the postition where they are needed21:42
blackburnwell we inline only get_name stuff and so on21:42
@sonney2kso instead of having a function ptr, putting variables on stack etc only the code of the inine function will be called21:43
blackburnI heard inline is not a silver bullet ;)21:43
@sonney2kfighting vampires today?21:44
blackburnhmm21:44
blackburngoogle inlines when function is small21:44
@sonney2kfew lines or performance critical21:45
gsomixblackburn, wut? what to do?21:45
blackburnhttp://google-styleguide.googlecode.com/svn/trunk/cppguide.xml#Inline_Functions21:45
@sonney2kblackburn, but look at get_kernel_col in Kernel.h21:46
@sonney2ktotally unnecessary that this is in *.h21:46
blackburngsomix: you could help us with moving some code from .h to .cpp21:46
gsomixok21:46
@sonney2ktoo bad that templated functions have to stay in *.h21:47
blackburnsonney2k: btw update your fork now21:47
@sonney2kblackburn, what did you do?21:47
blackburnsonney2k: when?21:47
@sonney2kyou said update your fork now21:47
blackburnoh sorry21:47
blackburn:D21:48
blackburngsomix: update your fork now21:48
blackburn:D21:48
* sonney2k orders another vodka for blackburn21:48
* sonney2k continues to split up lib21:49
gsomixwhat files to change?21:52
blackburnsonney2k: I'm still compile it without ccache21:52
* gsomix loves google translate.21:53
blackburnI'm too lame to set it up hehe21:53
@sonney2kblackburn, too lazy21:53
blackburnwhat are the files to change21:53
blackburnenglish lessons on #shogun hehe21:54
@sonney2kblackburn, should arpack be in mathematics?21:54
@sonney2kI would guess so or?21:54
blackburnyes it is mathematics :D21:54
@sonney2kan lapack too21:54
blackburnyeap21:54
gsomixblackburn, :)21:54
@sonney2kthen cplex too21:55
@sonney2kls lib/21:55
@sonney2kArray2.h  Array.h      Cache.h   Compressor.cpp  DataType.cpp  DynamicArray.h        DynInt.h   Hash.cpp  IndirectObject.h  List.h      memory.h  Signal.cpp  Time.cpp  Trie.cpp  v_array.h21:55
@sonney2kArray3.h  BitString.h  common.h  Compressor.h    DataType.h    DynamicObjectArray.h  GCArray.h  Hash.h    __init__.py       memory.cpp  Set.h     Signal.h    Time.h    Trie.h21:55
blackburnwhere ArrayN is used?21:55
@sonney2kwhat is that __init__.py doing in there?!?!21:56
@sonney2kerasing21:56
blackburnsomeone added it? ;)21:56
@sonney2k$ ls mathematics/21:58
@sonney2karpack.cpp  arpack.h  Cplex.cpp  Cplex.h  lapack.cpp  lapack.h  Loss.h  Math.cpp  Math.h21:58
@sonney2k$ ls io/21:58
@sonney2kAsciiFile.cpp   HDF5File.cpp   LibSVMFile.h                   SerializableFile.cpp          SerializableJsonFile.h        ShogunException.cpp            StreamingFileFromFeatures.h21:58
@sonney2kAsciiFile.h     HDF5File.h     MemoryMappedFile.h             SerializableFile.h            SerializableJsonReader00.cpp  ShogunException.h              StreamingFileFromSimpleFeatures.h21:58
@sonney2kBinaryFile.cpp  InputParser.h  ParseBuffer.h                  SerializableHdf5File.cpp      SerializableJsonReader00.h    SimpleFile.h                   StreamingFileFromSparseFeatures.h21:58
@sonney2kBinaryFile.h    IOBuffer.cpp   SerializableAsciiFile.cpp      SerializableHdf5File.h        SerializableXmlFile.cpp       StreamingAsciiFile.cpp         StreamingFileFromStringFeatures.h21:58
@sonney2kBinaryStream.h  IOBuffer.h     SerializableAsciiFile.h        SerializableHdf5Reader00.cpp  SerializableXmlFile.h         StreamingAsciiFile.h           StreamingFile.h21:58
blackburnno lib/?21:58
@sonney2kFile.cpp        io.cpp         SerializableAsciiReader00.cpp  SerializableHdf5Reader00.h    SerializableXmlReader00.cpp   StreamingFile.cpp21:58
@sonney2kFile.h          io.h           SerializableAsciiReader00.h    SerializableJsonFile.cpp      SerializableXmlReader00.h     StreamingFileFromFeatures.cpp21:58
@sonney2k$ ls lib/21:58
@sonney2kArray2.h  Array.h      Cache.h   Compressor.cpp  DataType.cpp  DynamicArray.h        DynInt.h   Hash.cpp  IndirectObject.h  memory.cpp  Set.h       Signal.h  Time.h    Trie.h21:58
@sonney2kArray3.h  BitString.h  common.h  Compressor.h    DataType.h    DynamicObjectArray.h  GCArray.h  Hash.h    List.h            memory.h    Signal.cpp  Time.cpp  Trie.cpp  v_array.h21:58
@sonney2klooks much better IMHO21:58
blackburnagree21:59
@sonney2know let me get this to compile21:59
@sonney2kand we need 2 new swig modules too...21:59
* sonney2k sighs21:59
blackburnsonney2k: do we need swig for maths?22:00
@sonney2kblackburn, yeah sometimes - for random numbers22:00
blackburnbad22:00
@sonney2kcertainly not for lapack or so22:00
-!- gsomix [~gsomix@178.45.37.165] has quit [Ping timeout: 240 seconds]22:00
@sonney2kblackburn, but changing math now won't require the whole library module to be recreated22:01
@sonney2kwell except if we have these circular  includes22:01
* blackburn wonders if someone could use shogun because it have nice arpack wrapper ;)22:01
blackburnsonney2k: http://dl.dropbox.com/u/10139213/shogun/lle.png22:02
blackburn*I was playing with lle while it was compiling22:03
@sonney2knice22:03
blackburnbetter than mds22:04
-!- gsomix [~gsomix@85.26.232.139] has joined #shogun22:04
blackburnI hope we will do something like that for genomic data with cwidmer ;)22:04
blackburnsonney2k: when will you commit your changes? I could better wait for you before doing some changes22:06
@sonney2kthis will take me >1 h I think22:07
blackburnokay, will implement ltsa now hehe22:08
bettyboostrange22:08
-!- genix [~gsomix@85.26.235.146] has joined #shogun22:17
-!- gsomix [~gsomix@85.26.232.139] has quit [Ping timeout: 255 seconds]22:18
-!- genix is now known as gsomix22:19
@sonney2kblackburn, is gsomix in the same wlan like you?22:19
blackburnsonney2k: no, we are pretty far away from each22:20
blackburnof us22:20
@sonney2kother22:20
blackburnaha22:20
@sonney2kyou meant - ok so how far?22:20
blackburnmay be even more than 200 km22:20
@sonney2kwow - how do you know each other then?22:20
blackburnwell I lost connection because my wi-fi access point is acting very bad sometimes22:20
blackburnwe study in one university in samara22:21
blackburnbut now we both at home22:21
@sonney2kblackburn, I recommend one of those http://en.wikipedia.org/wiki/Linksys_WRT54G_series22:21
@sonney2krock stable with e.g. dd-wrt22:21
blackburnI have no idea why my wi-fi lost connection on high load22:22
blackburnnot notebook issues - it was working before22:22
@sonney2khmmhh it did compile?!22:23
@sonney2kshall I commit?22:23
blackburnwhy not?22:23
@sonney2kbecause I modified every single file?22:23
-!- gsomix [~gsomix@85.26.235.146] has quit [Ping timeout: 255 seconds]22:24
blackburnsonney2k: ^ he uses 3g hehe22:24
@sonney2kI see22:24
blackburn2514roubles for Linksys WRT54G22:25
blackburnwill buy later22:25
blackburnnot much more than dlink hardware22:25
CIA-87shogun: Soeren Sonnenburg master * rbf5a3a3 / .gitignore :22:26
CIA-87shogun: remove shogun from ignored dirs since that is now the main shogun aka22:26
CIA-87shogun: libshogun dir - http://bit.ly/r4mPpC22:26
CIA-87shogun: Soeren Sonnenburg master * r245cf3e / src/Makefile.template :22:26
CIA-87shogun: remove sed -i operation on shogun dir - no longer necessary with new22:26
CIA-87shogun: directory layout - http://bit.ly/oW5PzX22:26
CIA-87shogun: Soeren Sonnenburg master * r6569436 / (369 files in 31 dirs): split up lib/ into io/ lib/ mathematics/ for clarity - http://bit.ly/pAouA222:26
@sonney2kso committed22:26
blackburnnow we know what is the file count in shogun22:26
@sonney2kI didn't do the change in python modular now22:26
@sonney2kI guess I should do it right away22:27
@sonney2kblackburn, but please try to compile first22:27
blackburnw/o python?22:27
blackburnsonney2k: distclean tries to remove shogun22:28
@sonney2kgreat22:28
blackburnmy luck he can't22:28
-!- gsomix [~gsomix@85.26.233.192] has joined #shogun22:28
@sonney2kfixed22:29
CIA-87shogun: Soeren Sonnenburg master * r85442d2 / src/Makefile : don't try to remove shogun on distclean - http://bit.ly/nccMxO22:29
blackburnsonney2k: does git status show you that ../data is modified?22:31
@sonney2kno22:32
@sonney2kdid yo add sth?22:32
blackburnweek ago or os22:32
blackburnso22:32
blackburnsonney2k: btw you intended to *_modular -> *?22:33
blackburncompiling..22:34
@sonney2kblackburn, yes - but after consideration I think it is more clear now22:34
blackburnsonney2k: okay too much errors I can copy-paste22:36
@sonney2kdid you git clean dfx before?22:37
blackburngit clean22:37
@sonney2kOK I've split up Library...22:39
@sonney2know we have Mathematics.i and IO.i too22:39
-!- in3xes_ [~in3xes@180.149.49.227] has joined #shogun22:41
blackburnlibshogun compiled ok22:43
-!- blackburn [~blackburn@188.122.238.99] has quit [Quit: Leaving.]22:43
-!- blackburn [~blackburn@188.122.238.99] has joined #shogun22:43
blackburnhaha I got disconnected even wired22:43
bettyboo8)22:43
-!- in3xes_ [~in3xes@180.149.49.227] has quit [Client Quit]22:44
blackburnsonney2k: I have K parameter in LLE, how can we add parameter search for heiko's fancy modelselection?22:46
blackburnsimilar for isomap22:46
blackburnI can provide reconstruction error by option22:46
@sonney2kblackburn, that doesn't work currently22:47
@sonney2kit only works for 'machine' derived classes22:47
@sonney2kthat have a train() and apply() function22:47
blackburnhm okay22:47
@sonney2kyou could probably write a machine for this22:49
blackburnyes maybe makes sense22:50
gsomixare you need me? i was planning to go sleep.22:52
blackburnheh22:53
blackburngsomix: do as you was planning ;)22:53
blackburnsonney2k: okay compile22:56
blackburnd22:56
CIA-87shogun: Soeren Sonnenburg master * re70754f / (17 files in 2 dirs): split up modular Library interface into Library, Mathematics and IO - http://bit.ly/oE1zMv22:57
@sonney2kso finally22:57
@sonney2kI guess you will have to update some examples still22:57
@sonney2kbut it seems to work just fine...22:58
-!- gsomix [~gsomix@85.26.233.192] has quit [Quit: Ухожу я от вас (xchat 2.4.5 или старше)]22:59
@sonney2kblackburn, I am trying to remove my BoolSparseMatrix) SGSparseMatrix definitions from SGBase.i to Library.i again and then just use imports in SGBase22:59
@sonney2k(now that library is small)23:00
blackburnI didn't realize what you just said23:00
blackburn:D23:00
@sonney2k91 C23:07
@sonney2kCPU temperature23:07
blackburnI hope it is not notebook?23:07
@sonney2kit is23:07
@sonney2kmacbook pro23:07
@sonney2ktoo hot23:07
blackburnyay23:07
@sonney2kfans running at 6200 RPM23:07
@sonney2klike sitting in a plane23:07
@sonney2kunbelievable23:08
@sonney2kit still compiles and examples run?!23:08
@sonney2kam I doing sth wrong?23:09
blackburnmake[1]: *** No rule to make target `IO_doxygen.i', needed by `IO_wrap.cxx'.  Stop.23:09
blackburnI got that thing again23:09
CIA-87shogun: Soeren Sonnenburg master * r2514157 / (13 files in 4 dirs): move data types back to library - http://bit.ly/nalMPD23:17
-!- serialhex [~quassel@99-101-148-183.lightspeed.wepbfl.sbcglobal.net] has joined #shogun23:19
@sonney2kblackburn, that should fix your problem23:20
CIA-87shogun: Soeren Sonnenburg master * r4c71689 / src/.generate_link_dependencies.py : mention doxy files in link dependency generator - http://bit.ly/rn62Kq23:20
* blackburn trying to write a paper about IRLM for LLE hehe23:23
@sonney2kblackburn, do we need a Machine module?23:24
blackburnin swig?23:24
@sonney2kin modular if's23:24
blackburnI don't think so, where do we use it?23:24
@sonney2kOK one could only use it for trained kernelmachines or so23:26
blackburnshit I can't translate 'manifold learning' to russian ahaha23:26
blackburnsonney2k: not fixed23:31
@sonney2ksure it is23:31
@sonney2kI just rebuilt everything...23:31
blackburnokay 'll try again23:32
@sonney2kdont' forget the git clean -dfx23:32
@sonney2khmmhh naming clash - IO (the module) vs IO (the class)23:34
@sonney2kblackburn, suggestions for a better name?23:34
blackburnsome Logger hehe23:36
blackburnShogunIO23:36
blackburnsonney2k: did git clean23:38
blackburnmake distclean23:38
@sonney2kblackburn, git clean -dfx ?23:38
blackburnmake[1]: *** No rule to make target `IO_doxygen.i', needed by `IO_wrap.cxx'.  Stop.23:38
blackburnyes23:38
@sonney2kbut you have a IO_doxygen.i in interfaces/modular/ ?23:39
blackburnI have olny IO.doxy23:40
@sonney2kerr sorry IO.doxy23:40
-!- alesis_ [~alesis@188.74.87.206] has quit [Ping timeout: 252 seconds]23:42
@sonney2kblackburn, and if you grep IO_ .generate*.py23:42
@sonney2kyou have it in there or not?23:43
-!- alesis_ [~alesis@188.74.87.206] has joined #shogun23:43
@sonney2krenaming to SGIO23:44
blackburngrep is slow for some reason23:44
blackburnok23:45
blackburnit compiled23:45
blackburnsorry23:45
blackburnsonney2k:  I guess I did something wrong23:45
@sonney2k?!23:45
@sonney2kheisenbug?23:45
blackburnno idea23:46
--- Log closed Tue Jul 19 00:00:39 2011

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!