IRC logs of #shogun for Friday, 2011-08-12

« Thursday, 2011-08-11 Index Saturday, 2011-08-13 »
--- Log opened Fri Aug 12 00:00:07 2011
-!- in3xes [~in3xes@182.156.166.217] has quit [Ping timeout: 264 seconds]00:15
serialhexsonney2k: u around??00:26
-!- f-x [~user@117.192.211.222] has left #shogun ["ERC Version 5.3 (IRC client for Emacs)"]00:38
CIA-87shogun: Baozeng Ding master * rf97132e / src/interfaces/ruby_modular/swig_typemaps.i : fix ruby stringlist bug by removing SGFREE(str) - http://bit.ly/pRYhgF06:34
CIA-87shogun: Baozeng Ding master * rfbcb1ec / (2 files in 2 dirs): fix ruby stringlist bug, add result=arr statement - http://bit.ly/qC0i1e06:34
CIA-87shogun: Soeren Sonnenburg master * r7594a76 / (2 files in 2 dirs):06:34
CIA-87shogun: Merge pull request #289 from sploving/master06:34
CIA-87shogun: ruby stringlist can work now - http://bit.ly/oLI3mt06:34
CIA-87shogun: Soeren Sonnenburg master * rdbfda65 / (10 files in 3 dirs):06:53
CIA-87shogun: Merge pull request #288 from frx/streaming_vw06:53
CIA-87shogun: Added StreamingVwFeatures. - http://bit.ly/q5yJV306:53
-!- in3xes [~in3xes@49.201.194.134] has joined #shogun08:52
-!- blackburn [~blackburn@188.122.238.50] has joined #shogun11:16
@sonney2kblackburn, that is from the new serialization stuff - how did you get it?12:25
@sonney2kblackburn, btw did the other interfaces compile?12:26
blackburncreated SerializableAsciiFile and tried to save_serializable12:26
@sonney2kblackburn, if so it would be a good idea to commit the new typemaps12:26
blackburnyes, all ok12:26
@sonney2kok then commit12:26
@sonney2kand then we continue12:26
blackburnI'll commit it with java readObject12:27
blackburnsoon12:27
-!- f-x [~user@117.192.212.86] has joined #shogun13:18
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]13:37
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun13:41
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]13:47
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun13:47
blackburnshogun-buildbot: status14:28
shogun-buildbotcmdline_static: idle14:28
shogun-buildbotcsharp_modular: idle14:28
shogun-buildbotjava_modular: idle14:28
shogun-buildbotlibshogun: idle14:28
shogun-buildbotlua_modular: idle14:28
shogun-buildbotmatlab_static: idle14:28
shogun-buildbotoctave_modular: idle14:28
shogun-buildbotoctave_static: idle14:28
shogun-buildbotpython_modular: idle14:28
shogun-buildbotpython_static: idle14:28
shogun-buildbotr_modular: idle14:28
shogun-buildbotr_static: idle14:28
shogun-buildbotruby_modular: idle14:28
blackburnwow14:28
blackburnstop stop14:28
blackburn:D14:28
CIA-87shogun: Sergey Lisitsyn master * rcfab782 / (5 files): Added write/readObject for java serialization, added ignores and removed unnecessary modular classes - http://bit.ly/n42Fih14:34
CIA-87shogun: Sergey Lisitsyn master * r9778993 / src/interfaces/modular/Library.i : Fixed wrong deletion of SGNDArray<uint16_t> - http://bit.ly/q2iahU14:49
-!- f-x [~user@117.192.212.86] has quit [Ping timeout: 260 seconds]15:02
blackburnshogun-buildbot: status15:42
shogun-buildbotcmdline_static: idle15:42
shogun-buildbotcsharp_modular: idle15:42
shogun-buildbotjava_modular: idle15:42
shogun-buildbotlibshogun: idle, last build 46m46s ago: failed test15:42
shogun-buildbotlua_modular: idle15:42
shogun-buildbotmatlab_static: idle15:42
shogun-buildbotoctave_modular: idle15:42
shogun-buildbotoctave_static: idle15:42
shogun-buildbotpython_modular: idle15:42
shogun-buildbotpython_static: idle15:42
shogun-buildbotr_modular: idle15:42
shogun-buildbotr_static: idle15:42
shogun-buildbotruby_modular: idle15:42
blackburnshogun-buildbot: help15:42
shogun-buildbotGet help on what? (try 'help <foo>', or 'commands' for a command list)15:42
blackburnshogun-buildbot: commands15:42
shogun-buildbotbuildbot commands: commands, dance, destroy, excited, force, hello, help, last, list, mute, notify, source, status, stop, unmute, version, watch15:42
@sonney2kblackburn, I am still configuring the bot...16:09
@sonney2kseems like it works more or less16:09
@sonney2kshogun-buildbot status libshogun16:10
CIA-87shogun: Soeren Sonnenburg master * rfc12543 / (3 files in 2 dirs): fix remaining warnigns in classifier - http://bit.ly/p2Zc0l16:18
@sonney2kshogun-buildbot, status libshogun16:21
shogun-buildbotlibshogun: building(compiling)16:21
@sonney2kblackburn, did you get an email from the buildbot?16:22
shogun-buildbotbuild #1 of libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org:5347/builders/libshogun/builds/116:24
@sonney2khurray!16:25
blackburnsonney2k: no, can't see any email16:26
@sonney2kblackburn, not even on failure?16:27
blackburnsonney2k: nope16:28
@sonney2khmmh16:29
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]16:36
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun16:36
CIA-87shogun: Soeren Sonnenburg master * r99d18cc / src/shogun/classifier/svm/WDSVMOcas.cpp : remove unused 'end' variable - http://bit.ly/nZM1hl16:37
CIA-87shogun: Soeren Sonnenburg master * r0b64595 / (3 files in 2 dirs):16:41
CIA-87shogun: Merge pull request #290 from sploving/master16:41
CIA-87shogun: add ruby and csharp docs - http://bit.ly/n2aUHX16:41
CIA-87shogun: Soeren Sonnenburg master * r4c34008 / (6 files in 3 dirs):16:42
CIA-87shogun: Merge pull request #291 from frx/streaming_vw16:42
CIA-87shogun: Documented and renamed a few functions in parser/ring for readability. - http://bit.ly/nWH2Fo16:42
blackburnsonney2k: what's up with memory usage?16:44
blackburndid it get lower?16:44
@sonney2kno idea16:45
@sonney2kthe buildbot didn't seem to pick up the build...16:45
@sonney2k*sigh*16:45
@sonney2khmmhh now it does16:47
blackburnsonney2k: it seems java serialization works16:51
blackburnI'll check carefully a little bit later16:52
@sonney2kblackburn, yay! now the buildbot is in super action http://shogun-toolbox.org:5347/waterfall16:55
blackburnnice17:15
blackburnsonney2k: hey much less warnings now17:19
-!- in3xes [~in3xes@49.201.194.134] has quit [Quit: Leaving]17:44
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]20:00
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun20:00
-!- in3xes [~in3xes@49.202.137.17] has joined #shogun20:03
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]20:06
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun20:07
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Client Quit]20:07
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun20:08
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]20:26
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun20:27
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Client Quit]20:27
-!- shogun-buildbot [~shogun-bu@87.118.92.43] has joined #shogun20:28
-!- in3xes [~in3xes@49.202.137.17] has quit [Ping timeout: 260 seconds]20:28
@sonney2kblackburn, memory requirements are down to 300 MB?20:55
@sonney2kcould that be?20:55
@sonney2kahh no20:56
blackburnsonney2k: not possible20:56
blackburnI would believe ~60020:56
@sonney2k1.6G20:59
blackburnbad20:59
@sonney2kbut will full optimization21:00
blackburnsonney2k: no idea how to lower it <1g21:02
@sonney2kwell lets see how much octave_modular requires21:05
@sonney2k1.9G already21:05
@sonney2k2.121:06
@sonney2k2.421:06
@sonney2k<out_of_memory>21:07
@sonney2kblackburn, look failures when build with all opts on and with all disabled http://shogun-toolbox.org:5347/waterfall21:08
@sonney2know we need to also run make check-tests  / check-examples at some point and all good21:09
@sonney2kand osx21:09
@sonney2kand cygwin support21:09
@sonney2kblackburn, btw everyone could install a buildbot-slave on his machine21:09
@sonney2kthen we can run things on more machines - so if you know s.o. with a mac / windows machine that is on all the time anyways - ask him :)21:10
blackburnokay21:10
@sonney2kblackburn, ahh and btw. I added links to github - e.g. if you click on http://shogun-toolbox.org:5347/console21:11
blackburnsonney2k: how 'big' should be serialized SVMLight?21:11
@sonney2kand then fc12543ea..21:11
blackburnnice work21:11
@sonney2kthen you will see the diff of this patch :)21:12
@sonney2kwe could even have back links to trac if we were really using it :)21:12
blackburnsonney2k: what is nightly?21:12
@sonney2knightly is running at 19:00 UTC21:12
@sonney2kand running once with everything in configure --enable-*'d21:13
blackburnhm ok21:13
@sonney2kand once everything disabled21:13
@sonney2kas you can see both fail21:13
blackburnarpack test fails21:13
@sonney2kyeah, didn't have it installed on the build slave21:14
blackburnbut configure shouldn't fail if no arpack..21:14
@sonney2kit should of course21:14
@sonney2kit is enable-arapch'd21:14
@sonney2karpack21:14
blackburnah21:14
@sonney2kblackburn, the cool thing is that we could even create daily snapshots - but only when all tests pass... e.g. .tar.gz and .deb pkg's21:18
blackburnsonney2k: seen mail from serialhex?21:19
@sonney2kno21:19
@sonney2kblackburn, now yes21:22
@sonney2kperfect timeing :)21:22
@sonney2kblackburn, what is mythical 15 milliseconds in fibheap?21:23
blackburnsonney2k: reducing memory allocation rate21:23
blackburnhrr21:23
blackburnforgot to merge eugeniy's patch21:23
CIA-87shogun: Evgeniy Andreev master * rac3d853 / (246 files in 23 dirs): Merge branch 'master' of git://github.com/shogun-toolbox/shogun - http://bit.ly/n8h61M21:25
CIA-87shogun: Evgeniy Andreev master * rcb5c195 / (4 files): Implemented Hash set and added 'mythical 15 milliseconds' for Fibonacci heap - http://bit.ly/pedzQ321:25
CIA-87shogun: Soeren Sonnenburg master * r850010a / (4 files):21:25
CIA-87shogun: Merge pull request #292 from gsomix/master21:25
CIA-87shogun: Implemented Hash set and added 'mythical 15 milliseconds' for Fibonacci heap - http://bit.ly/pGJ80e21:25
@sonney2kblackburn, sry21:25
@sonney2kwas reading his patch...21:25
blackburnhmm he has already implemented hashset21:26
blackburnnice21:26
@sonney2kblackburn, problem is I don't knwo how reliable it is -21:26
@sonney2kif we use it for mission critical stuff21:26
blackburnsonney2k: fibonacci heap is pretty reliable21:26
blackburnsonney2k: uh.. just noticed very bad thing with java serialization21:28
@sonney2k?21:28
blackburne.g. it is called for SVMLight first21:29
blackburnthen for SVM21:29
blackburnthen for SGObject, so on21:29
@sonney2khmmhh, why that? so what we would need is to only implement the serializable interface for the class deepest in the hierarchy21:31
@sonney2kdammed21:31
@sonney2kmy home machine just rebooted21:31
@sonney2kno idea why21:31
blackburnI can't understand why it is called for each successor..21:31
blackburnbut as I can see there are 5 temporary files21:31
@sonney2kblackburn, is there any way that you can make it only call it once for the child class?21:32
blackburnI'll try to investigate21:33
-!- gsomix [~gsomix@88.200.215.245] has joined #shogun21:35
gsomixhi all21:35
gsomixsonney2k, collisions are solved by means of lists (chains).21:35
@sonney2kblackburn, I mean could you somehow figure out that your object is in fact some 'base' class21:36
@sonney2kgsomix, ahh great21:36
@sonney2kgsomix, did you test it?21:36
gsomixsonney2k, i tested a little bit. Tomorrow will continue.21:36
blackburnsonney2k: yeah I'll try21:36
blackburnI lost jdk sources again21:37
blackburnwill check how objectoutputstream works21:37
@sonney2kgsomix, it is just before we replace the *crappy* CSet and replace it with yours we should know that it works :)21:37
blackburnsonney2k: false alarm I'd say21:50
blackburnbut why called 5 times..21:50
@sonney2k:)21:54
gsomixsonney2k, ok. I'm going to use valgrind.21:56
blackburnalways 5 times ?!21:56
gsomixAnd to explore vim. Hehe. However, it does not matter.21:56
blackburnsonney2k: your fault! ;)22:02
@sonney2kahh of course22:02
@sonney2kI knew it :D22:02
@sonney2kblackburn, so enlighten me22:02
@sonney2kwhat did I do?22:02
blackburnyou forgot throws in writeObject signature :)22:02
blackburnbut I'm not sure it would help22:04
@sonney2kaha22:05
blackburnyeah didn't help22:07
@sonney2kblackburn, ok even if you try some very simple example?22:07
@sonney2ke.g. serializae22:07
@sonney2kCLabels?22:07
blackburnsonney2k: yeah 4 times for RealFeatures22:08
@sonney2kblackburn, try Labels22:08
blackburnsonney2k: 2 times for Labels??22:09
@sonney2kblackburn, can you think of anything simpler than labels?22:10
blackburnsonney2k: SGObject I guess22:10
@sonney2kblackburn, ok then try it22:11
-!- in3xes [~in3xes@180.149.49.227] has joined #shogun22:11
shogun-buildbotbuild #1 of octave_modular is complete: Failure [failed compile]  Build details are at http://www.shogun-toolbox.org:5347/builders/octave_modular/builds/1  blamelist: gsomix@gmail.com22:13
gsomixO_o22:13
-!- in3xes [~in3xes@180.149.49.227] has quit [Client Quit]22:14
-!- in3xes [~in3xes@180.149.49.227] has joined #shogun22:16
@sonney2kgsomix, hmmhh internal compiler error?22:19
@sonney2kmaybe my machine has memory issues22:19
gsomixsonney2k, it's not me. о_О22:20
CIA-87shogun: Soeren Sonnenburg master * rdd165c5 / src/shogun/io/SerializableXmlReader00.cpp : fix further warning in io - http://bit.ly/qF2MiJ22:30
shogun-buildbotbuild #3 of octave_modular is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org:5347/builders/octave_modular/builds/322:30
@sonney2kgsomix, see everything good ^22:33
gsomix^_^22:33
-!- in3xes [~in3xes@180.149.49.227] has quit [Ping timeout: 276 seconds]22:37
-!- in3xes [~in3xes@180.149.49.227] has joined #shogun22:37
-!- in3xes [~in3xes@180.149.49.227] has quit [Ping timeout: 240 seconds]22:45
blackburnstill didn't find an answer22:50
@sonney2kblackburn, so when you serilaize sgobject22:50
@sonney2kyou have 1 ?22:50
blackburnI can't instantiate SGObject22:51
@sonney2kblackburn, because of get_name22:51
@sonney2k?22:51
blackburndon't know, may be yes22:51
@sonney2kso how about adding a dummy DummyObject derived from sgobject that doesn't do anything?22:51
blackburnI'm pretty sure it is related22:51
blackburnif SGObject - Kernel - GaussianKernel then 3 or so22:52
@sonney2kbut then your initial guess was correct - or?22:52
blackburnyes but can't see any solution22:53
blackburnSGObject writeObject22:55
blackburnclass org.shogun.Labels22:55
blackburn/tmp/-1568551569shogun.tmp22:55
blackburnLabels writeObject22:55
blackburnclass org.shogun.Labels22:55
blackburn/tmp/-1706591360shogun.tmp22:55
blackburnyes, I've modified SGObject writeObject and Labels writeObject22:55
@sonney2kblackburn, so java's serialization works by telling all parental classes to serialize first and then serializing the current class right?23:03
blackburnseems so23:03
@sonney2kif so - then it would explain what we see23:03
@sonney2kand then all we could do is some hack23:04
@sonney2klike set a flag i_am_already_serialized in SGObject23:04
-!- f-x [~user@117.192.192.210] has joined #shogun23:06
blackburnsonney2k: nono, we should do it such  way23:06
blackburnI'll try to make it Externizable, not Serializable23:06
blackburnExternilizable23:07
blackburnshit23:07
blackburnExternalizable23:07
blackburnsonney2k: Externalizable fits much better to this task23:10
blackburnreally full control of serialization process23:10
@sonney2kblackburn, how is that different?23:10
blackburnthere are some structure of serialization process23:10
blackburndefaultWriteObject and the other things23:11
blackburnin the Externalizable we only override write/read and voi-la23:11
@sonney2kblackburn, yeah but what if write/read are overridden in all (parental) classes?23:12
@sonney2kI mean don't we have the same problem?23:12
blackburnthere is no overriding here23:12
blackburnread/write are private23:12
blackburnSerialization uses reflection process to sort out the things here23:13
blackburnif it is externalizable all should work exactly how we want23:13
@sonney2kblackburn, so it means the class will be externalized w/o recursing to parental classes?23:14
blackburnshould be so23:14
blackburnoh23:15
blackburnI got wrong23:15
blackburnin the serialization there are public read/write23:15
blackburnerr in externalization23:15
@sonney2kyeah an in serialization they are private23:15
blackburnsonney2k: but we should definitely use externalization23:16
blackburni.e. custom serialization is if we are serializing only half of array and 3/4 integer values23:16
blackburnand externalization if we output object to say some .pdf23:17
@sonney2kok as you say :)23:18
blackburnsonney2k: hooray!23:18
@sonney2k?23:18
blackburnworks23:18
blackburncalled 1 time23:19
@sonney2kgreat!23:19
-!- in3xes [~in3xes@180.149.49.227] has joined #shogun23:20
@sonney2kand the buildbot is happy too http://shogun-toolbox.org:5347/console23:20
@sonney2kalright happy end for today - cu tomorrow23:20
blackburnsonney2k: is sparse bug fixed?23:21
blackburnsee you23:21
-!- in3xes [~in3xes@180.149.49.227] has quit [Remote host closed the connection]23:29
-!- gsomix [~gsomix@88.200.215.245] has quit [Quit: Ухожу я от вас (xchat 2.4.5 или старше)]23:49
--- Log closed Sat Aug 13 00:00:18 2011
« Thursday, 2011-08-11 Index Saturday, 2011-08-13 »

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!