IRC logs of #shogun for Tuesday, 2014-08-05

--- Log opened Tue Aug 05 00:00:45 2014
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:04
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:06
-!- HeikoS [~heiko@05439144.skybroadband.com] has joined #shogun00:07
-!- mode/#shogun [+o HeikoS] by ChanServ00:07
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:09
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:09
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:14
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:16
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:19
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:19
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:24
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:26
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:29
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:29
-!- HeikoS [~heiko@05439144.skybroadband.com] has quit [Quit: Leaving.]00:29
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:34
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:34
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:39
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:41
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:44
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:44
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:49
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:49
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:54
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:56
-!- wiking [~wiking@info2k1.hu] has joined #shogun00:59
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]00:59
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:04
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:04
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:09
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:11
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:14
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:15
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:19
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:19
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:24
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:26
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:29
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:29
-!- PirosB3 [~pirosb3@host132-36-dynamic.9-87-r.retail.telecomitalia.it] has joined #shogun01:32
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:34
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:36
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:39
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:39
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:44
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:44
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:49
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:49
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:54
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]01:54
-!- wiking [~wiking@info2k1.hu] has joined #shogun01:59
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]02:01
-!- wiking [~wiking@info2k1.hu] has joined #shogun02:04
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]02:04
-!- wiking [~wiking@info2k1.hu] has joined #shogun02:09
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]02:09
-!- PirosB3 [~pirosb3@host132-36-dynamic.9-87-r.retail.telecomitalia.it] has quit [Quit: PirosB3]02:10
-!- wiking [~wiking@info2k1.hu] has joined #shogun02:14
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]02:15
-!- wiking [~wiking@info2k1.hu] has joined #shogun02:19
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]02:19
-!- wiking [~wiking@info2k1.hu] has joined #shogun02:24
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]02:25
-!- wiking [~wiking@info2k1.hu] has joined #shogun02:29
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]02:29
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun02:40
-!- mode/#shogun [+o wiking] by ChanServ02:40
-!- besser82 [~quassel@fedora/besser82] has quit [Ping timeout: 260 seconds]08:14
-!- besser82 [~quassel@fedora/besser82] has joined #shogun08:17
-!- mode/#shogun [+o besser82] by ChanServ08:17
-!- besser82 [~quassel@fedora/besser82] has quit [Quit: Freedom, Friends, Features, First ---> http://fedoraproject.org/]09:18
-!- besser82 [~quassel@fedora/besser82] has joined #shogun09:18
-!- mode/#shogun [+o besser82] by ChanServ09:18
-!- besser82 [~quassel@fedora/besser82] has quit [Quit: Freedom, Friends, Features, First ---> http://fedoraproject.org/]09:42
-!- besser82 [~quassel@fedora/besser82] has joined #shogun09:43
-!- mode/#shogun [+o besser82] by ChanServ09:43
-!- soumyaC [uid15286@gateway/web/irccloud.com/x-xslbwrxnibkvshpo] has joined #shogun09:56
-!- abinash_panda [~abinash@106.51.234.101] has joined #shogun10:11
-!- HeikoS [~heiko@05439144.skybroadband.com] has joined #shogun11:06
-!- mode/#shogun [+o HeikoS] by ChanServ11:06
-!- PirosB3 [~pirosb3@host132-36-dynamic.9-87-r.retail.telecomitalia.it] has joined #shogun11:13
-!- rajul [~rajul@103.28.255.207] has joined #shogun11:30
-!- witness___ [uid10044@gateway/web/irccloud.com/x-daehroejzezuookm] has joined #shogun11:47
sonne|workwiking: so did you have time to fiddle with the hedonismbot?11:48
@wikingsonne|work: yeah it's up and running11:54
@wikingsonne|work: i still have to move some tasks from fatbot11:54
sonne|workwiking: yeah makes sense to move all compile stuff over11:55
@wikingbut i've already added the a new trusty job + opencl tests11:55
sonne|workwiking: nice!11:55
@wikingsonne|work: only thing is missing actually to move the basic libshogun + modular and static test to hedonism11:55
@wikingall the buildbot related chroots are moved to hedonisms11:56
sonne|workwiking: so sounds like you did almost all the work already11:58
-!- abinash_panda [~abinash@106.51.234.101] has quit [Remote host closed the connection]12:01
@wikingyeps12:03
-!- rajul [~rajul@103.28.255.207] has quit [Remote host closed the connection]12:04
-!- kislay [~Abhijeet@210.212.61.185] has joined #shogun12:53
-!- kislay [~Abhijeet@210.212.61.185] has quit [Read error: Connection reset by peer]13:00
-!- kislay [~Abhijeet@117.239.94.112] has joined #shogun13:13
-!- kislay [~Abhijeet@117.239.94.112] has quit [Remote host closed the connection]13:14
-!- kislay [~Abhijeet@210.212.61.185] has joined #shogun13:15
-!- kislay [~Abhijeet@210.212.61.185] has quit [Remote host closed the connection]13:15
-!- kislay [~Abhijeet@117.239.94.112] has joined #shogun13:20
-!- HeikoS [~heiko@05439144.skybroadband.com] has quit [Ping timeout: 264 seconds]13:21
-!- kislay_ [~Abhijeet@14.139.41.150] has joined #shogun13:36
-!- kislay [~Abhijeet@117.239.94.112] has quit [Ping timeout: 250 seconds]13:39
-!- kislay_ [~Abhijeet@14.139.41.150] has quit [Quit: Leaving]13:52
-!- witness___ [uid10044@gateway/web/irccloud.com/x-daehroejzezuookm] has quit [Quit: Connection closed for inactivity]14:14
-!- HeikoS [~heiko@nat-182-31.internal.eduroam.ucl.ac.uk] has joined #shogun15:02
-!- mode/#shogun [+o HeikoS] by ChanServ15:02
-!- Netsplit *.net <-> *.split quits: txomon|home15:14
-!- Tom_ [bc17103c@gateway/web/freenode/ip.188.23.16.60] has joined #shogun15:14
-!- Tom_ is now known as Guest1486615:15
-!- Netsplit over, joins: txomon|home15:15
Guest14866Hi, I am just trying to save and load files in python by the SHOGUN SVM with save_serializable and load_serializable but this is freaking slow and I think I am just misusing it for my requirement. Can you tell me how to do it in a proper way?15:20
@besser82wiking, ping?15:21
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting]15:21
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun15:21
@wikingpong15:21
Guest14866I have already tried the wrapped method bool save (FILE *svm_file) but I don't know which file descriptor I have to pass to this method15:21
@wikingbesser82: pong15:21
Guest14866... via python!15:22
@wikingGuest14866: what SerializableFile type are u using?15:22
Guest14866Neither Ascii nor Binary does work15:23
@wikingbinary?15:23
@wikingwhat binary r u trying?15:23
@wikingmm Guest14866 ok can u actually paste how do you try to serialize SVM?15:24
@wikingjust paste the snippet of the code to pastebin.com15:24
@besser82wiking, can you give me a user-acc for sg-hp on django, plz?15:24
@wikingbesser82: mmmm15:24
@wikinglemme see if i can15:24
@besser82wiking, HeikoS cannot... So you, Fernando and S?ren are left  ;)15:25
@wikingbesser82: gimme pub key15:25
Guest14866The problem is, save_serializable gives us a file, but the save(..) routine of MulticlassLibSVM has been wrapped to accept FILE* as its first argument. How does one specify a C FILE pedant in python? Or is a wrapper for this function not available?15:26
@besser82wiking, query ^^15:26
@wikingGuest14866: have u checked this example actually: examples/undocumented/python_modular/serialization_complex_example.py15:27
@wikingok15:27
@wikingbesser82: you should be able to update now the site15:27
@besser82wiking, many thx ^^15:28
@wikingbesser82: simply run 'make release' in shogun-web directory15:28
@besser82wiking, can you give me push acc to that repo as well, plz?!?15:28
@wikingbesser82: u dont have?15:29
@wikingk15:29
@wikingjust a sec15:29
@besser82wiking, nope, not yet...  only sg && sg-data...15:29
@wikingbesser82: done added15:30
@besser82wiking, many thanks ^^  just got mail ^^15:31
Guest14866@wiking: Yes, thank you for the link but I already tried this examples but each of it is very slow and so I guessed that there is another way to do it?15:32
@wikingGuest14866: mmm how big is your training set?15:34
Guest14866@wiking: 400 examples and each feature vector has a length of 300015:35
@wikingGuest14866: what you could try to speed up the serialization of the svm15:36
@wikingto clear it's features15:36
@wikingr u using kernels?15:37
Guest14866does is suffice to save the kernel only?15:38
@wikingso you r using MulticlassLibSVM with a kernel?15:38
Guest14866@wiking: linear kernel15:38
Guest14866yes15:38
@wikinglinear kernel?15:38
@wikingwhy dont u use then liblinear?15:38
Guest14866we have already tried different configurations15:39
@wikingah i see15:39
@wikingno worries15:39
@wikingwell15:39
@wikinghow slow is slow?15:39
@wikingcould you save it at least15:39
@wikingor not at all?15:39
Guest14866it takes longer than to train it :)15:40
@wikingand how big was the serialized file if u managed to save it15:40
@wikingjesus15:40
Guest14866you see.. :)15:40
@wikingbut have u managed it on the end15:40
@wikingor not ?15:40
Guest14866yes15:40
Guest14866but it was very huge, the filesize was ... just a moment15:40
@wikingok15:41
Guest14866280 mb15:41
@wikingGuest14866: do u still have the file?15:41
Guest14866yes15:41
@wikingcan u share it?15:41
Guest14866yes, but it will take some time to upload :)15:42
@wikingi can wait :)15:42
@wikingGuest14866: but please send me a reminding to wiking@maeth.com15:42
@wikingas i'm going to go to sleep soonish15:43
Guest14866sure, thanks a lot!15:43
@wikingnw15:43
-!- Guest14866 [bc17103c@gateway/web/freenode/ip.188.23.16.60] has quit [Ping timeout: 246 seconds]16:48
@wikingdudes17:22
@wikinghttp://uscilab.github.io/cereal/17:22
@besser82wiking, already packaging that for fc19+ / el7 ^^17:57
-!- PirosB3 [~pirosb3@host132-36-dynamic.9-87-r.retail.telecomitalia.it] has quit [Quit: PirosB3]19:24
-!- HeikoS [~heiko@nat-182-31.internal.eduroam.ucl.ac.uk] has quit [Quit: Leaving.]19:36
-!- lambday [7aa6a9cf@gateway/web/freenode/ip.122.166.169.207] has joined #shogun22:38
sonney2k_wiking, ceral smells like serious code bloat and looks exactly like the boost stuff (which did increase compile time and code size by like factor 10)23:10
@besser82sonney2k_, nope ^^23:19
@besser82sonney2k_, compile time with cereal is actually pretty fast23:20
@besser82sonney2k_, and from code pov it is even real simple stuff and not even comparable to boost-serialize23:21
@wikingsonney2k_: it's header only lib... not like boost23:21
@wikingsonney2k_: we have to change serialization/parameter fw as the current one is unmaintainable...23:26
@wikingsonney2k_: https://github.com/thekvs/cpp-serializers23:41
-!- randomguy_ [cb6ef619@gateway/web/freenode/ip.203.110.246.25] has joined #shogun23:58
--- Log closed Wed Aug 06 00:00:22 2014

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!