--- Log opened Tue Aug 05 00:00:45 2014 | ||
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:04 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:06 | |
-!- HeikoS [~heiko@05439144.skybroadband.com] has joined #shogun | 00:07 | |
-!- mode/#shogun [+o HeikoS] by ChanServ | 00:07 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:09 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:09 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:14 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:16 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:19 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:19 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:24 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:26 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:29 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:29 | |
-!- HeikoS [~heiko@05439144.skybroadband.com] has quit [Quit: Leaving.] | 00:29 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:34 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:34 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:39 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:41 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:44 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:44 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:49 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:49 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:54 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:56 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 00:59 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 00:59 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:04 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:04 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:09 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:11 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:14 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:15 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:19 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:19 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:24 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:26 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:29 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:29 | |
-!- PirosB3 [~pirosb3@host132-36-dynamic.9-87-r.retail.telecomitalia.it] has joined #shogun | 01:32 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:34 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:36 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:39 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:39 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:44 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:44 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:49 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:49 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:54 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 01:54 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 01:59 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 02:01 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 02:04 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 02:04 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 02:09 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 02:09 | |
-!- PirosB3 [~pirosb3@host132-36-dynamic.9-87-r.retail.telecomitalia.it] has quit [Quit: PirosB3] | 02:10 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 02:14 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 02:15 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 02:19 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 02:19 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 02:24 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 02:25 | |
-!- wiking [~wiking@info2k1.hu] has joined #shogun | 02:29 | |
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer] | 02:29 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 02:40 | |
-!- mode/#shogun [+o wiking] by ChanServ | 02:40 | |
-!- besser82 [~quassel@fedora/besser82] has quit [Ping timeout: 260 seconds] | 08:14 | |
-!- besser82 [~quassel@fedora/besser82] has joined #shogun | 08:17 | |
-!- mode/#shogun [+o besser82] by ChanServ | 08:17 | |
-!- besser82 [~quassel@fedora/besser82] has quit [Quit: Freedom, Friends, Features, First ---> http://fedoraproject.org/] | 09:18 | |
-!- besser82 [~quassel@fedora/besser82] has joined #shogun | 09:18 | |
-!- mode/#shogun [+o besser82] by ChanServ | 09:18 | |
-!- besser82 [~quassel@fedora/besser82] has quit [Quit: Freedom, Friends, Features, First ---> http://fedoraproject.org/] | 09:42 | |
-!- besser82 [~quassel@fedora/besser82] has joined #shogun | 09:43 | |
-!- mode/#shogun [+o besser82] by ChanServ | 09:43 | |
-!- soumyaC [uid15286@gateway/web/irccloud.com/x-xslbwrxnibkvshpo] has joined #shogun | 09:56 | |
-!- abinash_panda [~abinash@106.51.234.101] has joined #shogun | 10:11 | |
-!- HeikoS [~heiko@05439144.skybroadband.com] has joined #shogun | 11:06 | |
-!- mode/#shogun [+o HeikoS] by ChanServ | 11:06 | |
-!- PirosB3 [~pirosb3@host132-36-dynamic.9-87-r.retail.telecomitalia.it] has joined #shogun | 11:13 | |
-!- rajul [~rajul@103.28.255.207] has joined #shogun | 11:30 | |
-!- witness___ [uid10044@gateway/web/irccloud.com/x-daehroejzezuookm] has joined #shogun | 11:47 | |
sonne|work | wiking: so did you have time to fiddle with the hedonismbot? | 11:48 |
---|---|---|
@wiking | sonne|work: yeah it's up and running | 11:54 |
@wiking | sonne|work: i still have to move some tasks from fatbot | 11:54 |
sonne|work | wiking: yeah makes sense to move all compile stuff over | 11:55 |
@wiking | but i've already added the a new trusty job + opencl tests | 11:55 |
sonne|work | wiking: nice! | 11:55 |
@wiking | sonne|work: only thing is missing actually to move the basic libshogun + modular and static test to hedonism | 11:55 |
@wiking | all the buildbot related chroots are moved to hedonisms | 11:56 |
sonne|work | wiking: so sounds like you did almost all the work already | 11:58 |
-!- abinash_panda [~abinash@106.51.234.101] has quit [Remote host closed the connection] | 12:01 | |
@wiking | yeps | 12:03 |
-!- rajul [~rajul@103.28.255.207] has quit [Remote host closed the connection] | 12:04 | |
-!- kislay [~Abhijeet@210.212.61.185] has joined #shogun | 12:53 | |
-!- kislay [~Abhijeet@210.212.61.185] has quit [Read error: Connection reset by peer] | 13:00 | |
-!- kislay [~Abhijeet@117.239.94.112] has joined #shogun | 13:13 | |
-!- kislay [~Abhijeet@117.239.94.112] has quit [Remote host closed the connection] | 13:14 | |
-!- kislay [~Abhijeet@210.212.61.185] has joined #shogun | 13:15 | |
-!- kislay [~Abhijeet@210.212.61.185] has quit [Remote host closed the connection] | 13:15 | |
-!- kislay [~Abhijeet@117.239.94.112] has joined #shogun | 13:20 | |
-!- HeikoS [~heiko@05439144.skybroadband.com] has quit [Ping timeout: 264 seconds] | 13:21 | |
-!- kislay_ [~Abhijeet@14.139.41.150] has joined #shogun | 13:36 | |
-!- kislay [~Abhijeet@117.239.94.112] has quit [Ping timeout: 250 seconds] | 13:39 | |
-!- kislay_ [~Abhijeet@14.139.41.150] has quit [Quit: Leaving] | 13:52 | |
-!- witness___ [uid10044@gateway/web/irccloud.com/x-daehroejzezuookm] has quit [Quit: Connection closed for inactivity] | 14:14 | |
-!- HeikoS [~heiko@nat-182-31.internal.eduroam.ucl.ac.uk] has joined #shogun | 15:02 | |
-!- mode/#shogun [+o HeikoS] by ChanServ | 15:02 | |
-!- Netsplit *.net <-> *.split quits: txomon|home | 15:14 | |
-!- Tom_ [bc17103c@gateway/web/freenode/ip.188.23.16.60] has joined #shogun | 15:14 | |
-!- Tom_ is now known as Guest14866 | 15:15 | |
-!- Netsplit over, joins: txomon|home | 15:15 | |
Guest14866 | Hi, I am just trying to save and load files in python by the SHOGUN SVM with save_serializable and load_serializable but this is freaking slow and I think I am just misusing it for my requirement. Can you tell me how to do it in a proper way? | 15:20 |
@besser82 | wiking, ping? | 15:21 |
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting] | 15:21 | |
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun | 15:21 | |
@wiking | pong | 15:21 |
Guest14866 | I have already tried the wrapped method bool save (FILE *svm_file) but I don't know which file descriptor I have to pass to this method | 15:21 |
@wiking | besser82: pong | 15:21 |
Guest14866 | ... via python! | 15:22 |
@wiking | Guest14866: what SerializableFile type are u using? | 15:22 |
Guest14866 | Neither Ascii nor Binary does work | 15:23 |
@wiking | binary? | 15:23 |
@wiking | what binary r u trying? | 15:23 |
@wiking | mm Guest14866 ok can u actually paste how do you try to serialize SVM? | 15:24 |
@wiking | just paste the snippet of the code to pastebin.com | 15:24 |
@besser82 | wiking, can you give me a user-acc for sg-hp on django, plz? | 15:24 |
@wiking | besser82: mmmm | 15:24 |
@wiking | lemme see if i can | 15:24 |
@besser82 | wiking, HeikoS cannot... So you, Fernando and S?ren are left ;) | 15:25 |
@wiking | besser82: gimme pub key | 15:25 |
Guest14866 | The problem is, save_serializable gives us a file, but the save(..) routine of MulticlassLibSVM has been wrapped to accept FILE* as its first argument. How does one specify a C FILE pedant in python? Or is a wrapper for this function not available? | 15:26 |
@besser82 | wiking, query ^^ | 15:26 |
@wiking | Guest14866: have u checked this example actually: examples/undocumented/python_modular/serialization_complex_example.py | 15:27 |
@wiking | ok | 15:27 |
@wiking | besser82: you should be able to update now the site | 15:27 |
@besser82 | wiking, many thx ^^ | 15:28 |
@wiking | besser82: simply run 'make release' in shogun-web directory | 15:28 |
@besser82 | wiking, can you give me push acc to that repo as well, plz?!? | 15:28 |
@wiking | besser82: u dont have? | 15:29 |
@wiking | k | 15:29 |
@wiking | just a sec | 15:29 |
@besser82 | wiking, nope, not yet... only sg && sg-data... | 15:29 |
@wiking | besser82: done added | 15:30 |
@besser82 | wiking, many thanks ^^ just got mail ^^ | 15:31 |
Guest14866 | @wiking: Yes, thank you for the link but I already tried this examples but each of it is very slow and so I guessed that there is another way to do it? | 15:32 |
@wiking | Guest14866: mmm how big is your training set? | 15:34 |
Guest14866 | @wiking: 400 examples and each feature vector has a length of 3000 | 15:35 |
@wiking | Guest14866: what you could try to speed up the serialization of the svm | 15:36 |
@wiking | to clear it's features | 15:36 |
@wiking | r u using kernels? | 15:37 |
Guest14866 | does is suffice to save the kernel only? | 15:38 |
@wiking | so you r using MulticlassLibSVM with a kernel? | 15:38 |
Guest14866 | @wiking: linear kernel | 15:38 |
Guest14866 | yes | 15:38 |
@wiking | linear kernel? | 15:38 |
@wiking | why dont u use then liblinear? | 15:38 |
Guest14866 | we have already tried different configurations | 15:39 |
@wiking | ah i see | 15:39 |
@wiking | no worries | 15:39 |
@wiking | well | 15:39 |
@wiking | how slow is slow? | 15:39 |
@wiking | could you save it at least | 15:39 |
@wiking | or not at all? | 15:39 |
Guest14866 | it takes longer than to train it :) | 15:40 |
@wiking | and how big was the serialized file if u managed to save it | 15:40 |
@wiking | jesus | 15:40 |
Guest14866 | you see.. :) | 15:40 |
@wiking | but have u managed it on the end | 15:40 |
@wiking | or not ? | 15:40 |
Guest14866 | yes | 15:40 |
Guest14866 | but it was very huge, the filesize was ... just a moment | 15:40 |
@wiking | ok | 15:41 |
Guest14866 | 280 mb | 15:41 |
@wiking | Guest14866: do u still have the file? | 15:41 |
Guest14866 | yes | 15:41 |
@wiking | can u share it? | 15:41 |
Guest14866 | yes, but it will take some time to upload :) | 15:42 |
@wiking | i can wait :) | 15:42 |
@wiking | Guest14866: but please send me a reminding to wiking@maeth.com | 15:42 |
@wiking | as i'm going to go to sleep soonish | 15:43 |
Guest14866 | sure, thanks a lot! | 15:43 |
@wiking | nw | 15:43 |
-!- Guest14866 [bc17103c@gateway/web/freenode/ip.188.23.16.60] has quit [Ping timeout: 246 seconds] | 16:48 | |
@wiking | dudes | 17:22 |
@wiking | http://uscilab.github.io/cereal/ | 17:22 |
@besser82 | wiking, already packaging that for fc19+ / el7 ^^ | 17:57 |
-!- PirosB3 [~pirosb3@host132-36-dynamic.9-87-r.retail.telecomitalia.it] has quit [Quit: PirosB3] | 19:24 | |
-!- HeikoS [~heiko@nat-182-31.internal.eduroam.ucl.ac.uk] has quit [Quit: Leaving.] | 19:36 | |
-!- lambday [7aa6a9cf@gateway/web/freenode/ip.122.166.169.207] has joined #shogun | 22:38 | |
sonney2k_ | wiking, ceral smells like serious code bloat and looks exactly like the boost stuff (which did increase compile time and code size by like factor 10) | 23:10 |
@besser82 | sonney2k_, nope ^^ | 23:19 |
@besser82 | sonney2k_, compile time with cereal is actually pretty fast | 23:20 |
@besser82 | sonney2k_, and from code pov it is even real simple stuff and not even comparable to boost-serialize | 23:21 |
@wiking | sonney2k_: it's header only lib... not like boost | 23:21 |
@wiking | sonney2k_: we have to change serialization/parameter fw as the current one is unmaintainable... | 23:26 |
@wiking | sonney2k_: https://github.com/thekvs/cpp-serializers | 23:41 |
-!- randomguy_ [cb6ef619@gateway/web/freenode/ip.203.110.246.25] has joined #shogun | 23:58 | |
--- Log closed Wed Aug 06 00:00:22 2014 |
Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!