IRC logs of #shogun for Tuesday, 2013-07-09

--- Log opened Tue Jul 09 00:00:23 2013
shogun-buildbotbuild #1342 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1342  blamelist: Sergey Lisitsyn <lisitsyn.s.o@gmail.com>, Kevin <kevinhughes27@gmail.com>00:11
-!- van51 [~van51@athedsl-399972.home.otenet.gr] has quit [Quit: Leaving.]00:30
@iglesiasgok guys, good night00:58
@iglesiasglisitsyn: have a nice flight!00:59
-!- iglesiasg [~Fernando@s83-179-44-135.cust.tele2.se] has quit [Quit: Leaving]00:59
-!- travis-ci [~travis-ci@ec2-54-235-27-28.compute-1.amazonaws.com] has joined #shogun01:21
travis-ci[travis-ci] it's Sergey Lisitsyn's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/886330501:21
-!- travis-ci [~travis-ci@ec2-54-235-27-28.compute-1.amazonaws.com] has left #shogun []01:21
-!- nube [~rho@49.244.112.133] has quit [Ping timeout: 260 seconds]01:51
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]02:03
-!- zxtx [~zv@rrcs-76-79-81-162.west.biz.rr.com] has quit [Ping timeout: 246 seconds]02:22
-!- gsomix [~gsomix@109.188.125.190] has quit [Ping timeout: 256 seconds]02:44
-!- nube [~rho@36.253.205.110] has joined #shogun03:56
-!- nube1 [~rho@36.252.235.46] has joined #shogun04:03
-!- nube [~rho@36.253.205.110] has quit [Ping timeout: 256 seconds]04:04
-!- zxtx [~zv@cpe-75-83-151-252.socal.res.rr.com] has joined #shogun04:24
-!- gsomix [~gsomix@109.188.127.50] has joined #shogun04:27
shogun-buildbotbuild #452 of nightly_default is complete: Failure [failed test]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_default/builds/45204:38
-!- nube1 [~rho@36.252.235.46] has quit [Read error: Connection reset by peer]04:58
-!- hushell [~hushell@c-24-21-141-32.hsd1.or.comcast.net] has quit [Quit: WeeChat 0.3.7]05:42
-!- nube [~rho@116.90.239.13] has joined #shogun06:25
-!- foulwall [~user@2001:da8:215:6100:ad3e:1706:207e:6816] has joined #shogun06:44
gsomixsonney2k, sent PR.06:52
gsomixneed to go - CRAZY TRAIN! ALL ABOARD!06:54
-!- gsomix [~gsomix@109.188.127.50] has quit [Quit: Leaving]06:54
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun08:28
shogun-notifier-shogun: Evgeniy Andreev :develop * 9977edb / / (7 files): https://github.com/shogun-toolbox/shogun/commit/9977edbbdb3405ee9b1c5667f41b55f0d1ec540a08:28
shogun-notifier-shogun: LineReader have configurable delimiters now; fixed some bugs08:28
shogun-notifier-shogun: Soeren Sonnenburg :develop * 7a5b65a / / (7 files): https://github.com/shogun-toolbox/shogun/commit/7a5b65adbe5044152d85f8d09422526d1b10397e08:28
shogun-notifier-shogun: Merge pull request #1226 from gsomix/feature/linereader08:28
shogun-notifier-shogun:08:28
shogun-notifier-shogun: LineReader have configurable delimiters now08:28
shogun-notifier-shogun: van51 :develop * 82715cb / / (3 files): https://github.com/shogun-toolbox/shogun/commit/82715cb78919b3a8998be3ae6c8350df6cf0df3008:35
shogun-notifier-shogun: Streaming Hashed Doc Features08:35
shogun-notifier-shogun: Soeren Sonnenburg :develop * aef8ebc / / (3 files): https://github.com/shogun-toolbox/shogun/commit/aef8ebc05cfdbad2d60788195a1c050705a133ad08:35
shogun-notifier-shogun: Merge pull request #1216 from van51/feature/hashing08:35
shogun-notifier-shogun:08:35
shogun-notifier-shogun: Streaming Hashed Doc Features08:35
shogun-buildbotbuild #1221 of bsd1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/bsd1%20-%20libshogun/builds/122108:43
shogun-buildbotbuild #1343 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1343  blamelist: Soeren Sonnenburg <sonne@debian.org>09:12
-!- foulwall` [~user@2001:da8:215:6100:44cf:cdc9:76bb:c777] has joined #shogun09:34
-!- foulwall [~user@2001:da8:215:6100:ad3e:1706:207e:6816] has quit [Ping timeout: 245 seconds]09:35
shogun-buildbotbuild #1344 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1344  blamelist: Evgeniy Andreev <gsomix@gmail.com>, Soeren Sonnenburg <sonne@debian.org>, van51 <vangelis_51@hotmail.com>09:42
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has joined #shogun10:04
shogun-notifier-shogun-demo: foulwall :master * ea70146 / / (26 files): https://github.com/shogun-toolbox/shogun-demo/commit/ea70146277bde42117b8271a6257f5f24e4a501410:13
shogun-notifier-shogun-demo: 1. add a data loader. 2. change the json structure, add a colomn for label value 3. fix the legend digit. 4. add auto-scale to the axis 5. remove the shogun-demo submodule10:13
shogun-notifier-shogun-demo: Soeren Sonnenburg :master * 749255c / / (26 files): https://github.com/shogun-toolbox/shogun-demo/commit/749255cc0c32ff275f008f5b393ecce35823d0fe10:13
shogun-notifier-shogun-demo: Merge pull request #12 from foulwall/perceptron10:13
shogun-notifier-shogun-demo:10:13
shogun-notifier-shogun-demo: data importer10:13
-!- iglesiasg [~Fernando@s83-179-44-135.cust.tele2.se] has joined #shogun10:28
-!- mode/#shogun [+o iglesiasg] by ChanServ10:28
lisitsynflight time!11:02
lisitsynin 4 hours but I am packing notebook ;)11:02
-!- lisitsyn [~lisitsyn@31-28-52-76.clients.tlt.100megabit.ru] has left #shogun []11:02
-!- HeikoS [~heiko@nat-177-161.internal.eduroam.ucl.ac.uk] has joined #shogun11:08
-!- mode/#shogun [+o HeikoS] by ChanServ11:08
-!- Netsplit *.net <-> *.split quits: shogun-notifier-, sonne|work, zxtx11:12
-!- Netsplit over, joins: shogun-notifier-, zxtx, sonne|work11:15
@iglesiasgsonne|work: I should really write a few unit tests for knn11:38
sonne|workyeah refactoring is dangerous without11:39
@iglesiasgsonne|work, HeikoS : are there already unit tests reading input data from files?11:40
@iglesiasgto avoid using too trivial data11:40
sonne|workdon't understand the question11:40
sonne|workiglesiasg: I think unit tests should rather work without loading data but just using some data generators11:41
@iglesiasgsonne|work: difficult to test then functions like nearest neighbors where I want to see if the indices of the nearest neighbors are correct11:42
@iglesiasgsonney2k: I read data generators as random data generators11:42
-!- van51 [~van51@79.131.114.98] has joined #shogun11:43
sonne|workiglesiasg: or you create the toy data your own11:43
@iglesiasgsonne|work: then we fall back to the too trivial data problem I mentioned above :)11:44
sonne|workiglesiasg: well knn still has integration tests11:44
@iglesiasgsonney2k: are they testing for correctness of the results?11:45
@iglesiasgoops bad name11:47
@iglesiasgsonne|work: ^11:47
sonne|workiglesiasg: well they make sure that the same result comes out11:48
sonne|workso if the previous was correct11:48
@iglesiasggot it, it seems enough then11:49
-!- sanyam [uid10602@gateway/web/irccloud.com/x-bxwsbyychdryheqd] has quit [Quit: Connection closed for inactivity]12:02
@HeikoSiglesiasg: hey12:16
@HeikoSiglesiasg: usually, the unit tests are more for testing basic functionality, so fixed, very simple data12:16
@HeikoSlow dimensions etc12:17
@HeikoSjust to ensure things work12:17
@HeikoSthe big problems are tested in integration tests12:17
@HeikoSvotjakovr: hi!12:28
@iglesiasgHeikoS: thanks HeikoS, it makes sense12:29
@HeikoSiglesiasg: what I always do when I have reference implementations: set up a very small example that covers all cases and then copy/paste the result numbers to unit-test assertions12:29
votjakovrHeikoS: hi12:30
@HeikoSiglesiasg: have a look at votjakovr unit tests for gps, thats a good way to go12:30
@HeikoSvotjakovr: hey, how are things?12:30
votjakovrHeikoS: not so bad, i'm working on stuff for numerical integration12:31
@HeikoSvotjakovr: nice, any particular problems with that? challenges?12:32
votjakovrHeikoS: no problems, but source of alglib is a real challenge :)12:34
@HeikoSvotjakovr: yes thats true, how do you proceed in integrating it? :)12:34
votjakovrHeikoS: i created mathematics/Integration with static method for integration with Gauss-Kronrod quadrature and mathematics/IntegrableFunction12:37
@HeikoSvotjakovr: good!12:38
@HeikoSvotjakovr: ok, also I wanted to let you know that I will go to Berlin today. I will work from there, but probably will not be around all day. If you cannot catch me in IRC, send a mail. I will also prepare the workshop slides a bit more and probably use your probit classifier :)12:39
votjakovrHeikoS: ok, have a nice travel ;)12:40
@HeikoSvotjakovr: thanks :)12:40
-!- lambday [67157f37@gateway/web/freenode/ip.103.21.127.55] has joined #shogun12:43
lambdayHeikoS: hi12:43
@HeikoSlambday:  hi!12:43
@HeikoShow are things?12:43
lambdayHeikoS: I added SGSparseMatrix... copy and equals seems to work, unit-tested12:43
lambdayHeikoS: sending the PR, please have a look12:44
lambdayHeikoS: also, added "add" wrappers12:44
@HeikoSlambday: added it where?12:44
@HeikoSah wow12:44
@HeikoSin the parameter framework?12:44
@HeikoSniiiiice :D12:44
lambdayHeikoS: yes12:44
@HeikoSsend it ill have  alook12:44
lambdayHeikoS: :D first have a look and check if its okay12:45
lambdayHeikoS: sent12:46
-!- foulwall` [~user@2001:da8:215:6100:44cf:cdc9:76bb:c777] has quit [Ping timeout: 264 seconds]12:46
@HeikoSlambday:  checking12:46
@HeikoSlambday: wow nice with the unit tests12:49
@HeikoSmakes it quite easy to see that things work12:49
@HeikoSdid you check them for leaks?12:50
lambdayHeikoS: yes :)12:50
lambdayyes12:50
@HeikoSlambday:  can you quickly explain me the lines12:50
@HeikoS/* for ST_SPARSE allocate only for a vector of m_length_y */+        if (m_datatype.m_stype==ST_SPARSE)+          num_bytes=*m_datatype.m_length_y * m_datatype.sizeof_stype();12:50
@HeikoSlambday: ah no12:50
@HeikoSI see12:51
lambdaylol.. I typed a long sentence and deleted12:51
lambday:D12:51
lambdayHeikoS: this looks reasonable, no?12:51
lambdayalso had to change the point where it starts reading the next vector12:52
lambdaycause iteration is over SGSparseVector<>*12:52
lambdayHeikoS: since copy works, so clone should also work once I add it as a param in a class, right?12:53
-!- foulwall [~foulwall@117.136.0.204] has joined #shogun12:53
lambdayI can test that12:53
@HeikoSlambday: yep looks all reasonable12:56
lambdayphew! :D12:56
@HeikoSlambday: yes that would be good to add a unit test for clone for a class with a sgsparse matrix as parameter12:56
@HeikoSlambday: but dont commit, just test it12:56
lambdayHeikoS: alright12:57
@HeikoSwiking: will you finish the unit tests some time? Otherwise I will just hack something myself12:57
@HeikoSlambday: we will soon have clone/equals test for all objects12:57
@HeikoSso if you add a class which has a sgpsarsematrix member12:57
@HeikoSit will automagically be tested12:57
lambdayHeikoS: that's great!12:57
van51sonne|work: hey12:58
@HeikoSlambday: btw I am going to Berlin today. I will be working from there a bit, but not be around all day. so if you cannot catch me in irc, send me an email12:58
van51sonne|work: I was thinking of start a vw parser today, as it was in Olivier's milestones12:58
lambdayHeikoS: okay.. for the workshop?12:58
@HeikoSlambday: exactly12:58
van51sonne|work: but I see there is already a vw parser and a class for vw examples12:58
shogun-notifier-shogun: lambday :develop * d78cca8 / / (4 files): https://github.com/shogun-toolbox/shogun/commit/d78cca84b554271f81b171d551db93dc5511584612:58
shogun-notifier-shogun: added sparse matrix under parameter framework12:58
shogun-notifier-shogun: Heiko Strathmann :develop * fd2ba03 / / (4 files): https://github.com/shogun-toolbox/shogun/commit/fd2ba0370749c27bc3d34006a159bd9ca5a5867812:59
shogun-notifier-shogun: Merge pull request #1227 from lambday/feature/log_determinant12:59
shogun-notifier-shogun:12:59
shogun-notifier-shogun: added sparse matrix under parameter framework12:59
van51sonne|work: should I just make use of those and create another dot features class?12:59
lambdayHeikoS: awesome! I'll get to see some video I guess12:59
@HeikoSlambday: YES :)12:59
@HeikoSwe might have a video stream12:59
lambday:D13:00
@HeikoSlambday: ok nice, will leave now -- ill keep my phone so I can merge any PRs, see you later!13:12
lambdayHeikoS: alright :)13:12
-!- lambday [67157f37@gateway/web/freenode/ip.103.21.127.55] has quit [Ping timeout: 250 seconds]13:17
-!- HeikoS [~heiko@nat-177-161.internal.eduroam.ucl.ac.uk] has left #shogun []13:17
-!- foulwall` [~user@2001:da8:215:6100:4466:5e8c:5b16:50d8] has joined #shogun13:31
-!- foulwall [~foulwall@117.136.0.204] has quit [Quit: AndroIRC - Android IRC Client ( http://www.androirc.com )]13:32
shogun-buildbotbuild #1345 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1345  blamelist: lambday <heavensdevil6909@gmail.com>14:01
-!- nube [~rho@116.90.239.13] has quit [Quit: Leaving.]14:14
shogun-buildbotbuild #1346 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1346  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>14:17
-!- foulwall` [~user@2001:da8:215:6100:4466:5e8c:5b16:50d8] has left #shogun ["ERC Version 5.3 (IRC client for Emacs)"]14:39
-!- iglesiasg [~Fernando@s83-179-44-135.cust.tele2.se] has quit [Ping timeout: 240 seconds]14:45
-!- van51 [~van51@79.131.114.98] has quit [Read error: Connection reset by peer]14:53
-!- van51 [~van51@athedsl-399972.home.otenet.gr] has joined #shogun14:54
-!- nube [~rho@49.244.94.201] has joined #shogun15:06
-!- foulwall` [~user@2001:da8:215:6100:4466:5e8c:5b16:50d8] has joined #shogun15:48
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]15:59
-!- iglesiasg [~Fernando@s83-179-44-135.cust.tele2.se] has joined #shogun16:02
-!- mode/#shogun [+o iglesiasg] by ChanServ16:02
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has left #shogun ["ERC Version 5.3 (IRC client for Emacs)"]16:15
-!- iglesiasg [~Fernando@s83-179-44-135.cust.tele2.se] has quit [Ping timeout: 268 seconds]16:27
-!- foulwall` [~user@2001:da8:215:6100:4466:5e8c:5b16:50d8] has quit [Ping timeout: 264 seconds]16:36
-!- pickle27 [~Kevin@d67-193-243-174.home3.cgocable.net] has joined #shogun16:37
-!- iglesiasg [~Fernando@s83-179-44-135.cust.tele2.se] has joined #shogun16:42
-!- mode/#shogun [+o iglesiasg] by ChanServ16:42
-!- van51 [~van51@athedsl-399972.home.otenet.gr] has left #shogun ["QUIT :Leaving."]17:01
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun17:19
shogun-notifier-shogun-demo: foulwall :master * a3a4c81 / demo/kernel_matrix.py,templates/gp/index.html,templates/kernel_matrix/index.html: https://github.com/shogun-toolbox/shogun-demo/commit/a3a4c81a6277f84e4371b7cb6c073ad21a84f5bb17:19
shogun-notifier-shogun-demo: 1. fix kernel_matrix in new style. 2. fix the curve animation in gp demo.17:19
shogun-notifier-shogun-demo: Soeren Sonnenburg :master * f75d935 / demo/kernel_matrix.py,templates/gp/index.html,templates/kernel_matrix/index.html: https://github.com/shogun-toolbox/shogun-demo/commit/f75d9357122e9d13618da9f40261b505856de52517:19
shogun-notifier-shogun-demo: Merge pull request #13 from foulwall/kernel_matrix17:19
shogun-notifier-shogun-demo:17:19
shogun-notifier-shogun-demo: kernel_matrix17:19
@iglesiasgsonne|work: just in case you wanted to check ;)17:21
sonne|workiglesiasg: I hope you did :)17:22
shogun-notifier-shogun: Fernando Iglesias :develop * 2a59ace / src/shogun/multiclass/KNN.cpp,src/shogun/multiclass/KNN.h: https://github.com/shogun-toolbox/shogun/commit/2a59acebc3036476dd00e9cbf4b16d7102a980a317:23
shogun-notifier-shogun: Add method in KNN to obtain nearest neighbors.17:23
shogun-notifier-shogun: Internally, the apply now calls the new method to obtain the nearest17:23
shogun-notifier-shogun: neighbors first and then computes the labels.17:23
shogun-notifier-shogun: Fernando Iglesias :develop * 28e5183 / / (3 files): https://github.com/shogun-toolbox/shogun/commit/28e518379a79a097692a21fa50d2adf7b2621b1c17:23
shogun-notifier-shogun: libshogun simple kNN example with random data17:23
shogun-notifier-shogun: Fernando Iglesias :develop * fb0c239 / / (3 files): https://github.com/shogun-toolbox/shogun/commit/fb0c2399bbf4c33c59b1a4c8194c93836cbcbc1717:23
shogun-notifier-shogun: Use nearest neighbors method in classify for multiple k.17:23
shogun-notifier-shogun: Also, avoid code duplication by introducing choose for multiple k17:23
shogun-notifier-shogun: method, used in classify for multiple k w/ and w/o cover tree.17:23
shogun-notifier-shogun: Fernando Iglesias :develop * 3c8ea00 / / (4 files): https://github.com/shogun-toolbox/shogun/commit/3c8ea00915ba0462fb86b2d099ed396d3385787817:23
shogun-notifier-shogun: Merge pull request #1225 from iglesias/feature/knn_public_neighbors17:23
shogun-notifier-shogun:17:23
shogun-notifier-shogun: Feature/knn public neighbors17:23
-!- vgorbati [~vgorbati@91.216.173.29] has joined #shogun17:25
-!- foulwall` [~user@2001:da8:215:c252:24ad:63e:d49e:8091] has joined #shogun17:26
shogun-buildbotbuild #1226 of bsd1 - libshogun is complete: Failure [failed test]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/bsd1%20-%20libshogun/builds/1226  blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com>17:36
shogun-buildbotbuild #1227 of bsd1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/bsd1%20-%20libshogun/builds/122717:50
-!- pickle27 [~Kevin@d67-193-243-174.home3.cgocable.net] has quit [Quit: Leaving]18:11
shogun-buildbotbuild #1347 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1347  blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com>18:16
-!- foulwall` [~user@2001:da8:215:c252:24ad:63e:d49e:8091] has quit [Ping timeout: 264 seconds]18:32
shogun-notifier-shogun: Soeren Sonnenburg :develop * 206a880 / src/shogun/ (6 files): https://github.com/shogun-toolbox/shogun/commit/206a880f5af85c4a6cf6c8f7387a6dd262b25a0e18:38
shogun-notifier-shogun: fix get_name in MKL classes fixing serialization / parameter framework18:38
shogun-buildbotbuild #1348 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1348  blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com>18:43
-!- pickle27 [~kevin@rcv3-lab-pc.ee.queensu.ca] has joined #shogun18:50
sonne|workpickle27: hey18:51
pickle27hey18:51
sonne|workpickle27: please also do the audio application18:51
pickle27oh yeah Im planning to do both!18:51
sonne|workpickle27: I find that more fancy than some bioinformatics stuff18:51
sonne|workvery good18:51
pickle27the audio example itself shouldn't be too tough18:52
pickle27its very similar to the graphical example I made for the modular python18:52
pickle27the tough part will actually be the user interface which I have less experience with18:53
-!- iglesiasg [~Fernando@s83-179-44-135.cust.tele2.se] has quit [Quit: Leaving]19:16
sonne|workpickle27: I think foulwall can help here19:19
-!- pickle27 [~kevin@rcv3-lab-pc.ee.queensu.ca] has quit [Quit: Leaving]19:20
sonne|workpickle27: you should ask him19:20
-!- vgorbati [~vgorbati@91.216.173.29] has quit [Quit: vgorbati]19:27
shogun-buildbotbuild #1349 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1349  blamelist: Soeren Sonnenburg <sonne@debian.org>19:30
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has joined #shogun19:38
@sonney2kvotjakovr, did you have a chance to look at the regression_gaussian_process_modular.py setting 1/2 failure?19:41
votjakovrsonney2k: hi, i found, that this commit cd27d057b1c1a7cd2e5a22741c9b7be1e1d8e896 breaks it, and now i'm trying to figure out why19:53
@sonney2kvotjakovr, nice thanks.19:55
-!- vgorbati [~vgorbati@91.216.173.29] has joined #shogun19:59
votjakovrsonney2k: i think, i have find what gives different results :)20:16
votjakovrsonney2k: i've just sent a PR20:32
-!- iglesiasg [~Fernando@s83-179-44-135.cust.tele2.se] has joined #shogun20:34
-!- mode/#shogun [+o iglesiasg] by ChanServ20:34
naywhayaresonney2k: is there a k-means integration test or something so I can test if my patch works, or do I have to take a look at the results and compare with output of something else?20:45
naywhayareit's a two-character patch :)20:45
@sonney2kvotjakovr, cool!20:46
@sonney2kvotjakovr, so it is not really a bug right?20:50
votjakovrsonney2k: yep20:51
votjakovrsonney2k: but now regression_gaussian_process_modular.py is OK on my machine20:52
@sonney2kvotjakovr, yeah numerics :( it is good that you've found it20:54
-!- van51 [~van51@athedsl-399972.home.otenet.gr] has joined #shogun20:55
votjakovrsonney2k: yep :)20:56
shogun-notifier-shogun: Roman Votyakov :develop * 55adddc / src/shogun/machine/gp/ExactInferenceMethod.cpp: https://github.com/shogun-toolbox/shogun/commit/55adddc9506cdc54573897564acb2a398359fe8a21:00
shogun-notifier-shogun: fix bug which caused different results in integration test21:00
shogun-notifier-shogun: Soeren Sonnenburg :develop * 044d4ed / src/shogun/machine/gp/ExactInferenceMethod.cpp: https://github.com/shogun-toolbox/shogun/commit/044d4ed31b7cb471b34ff6eb01a660be3ef20f5021:00
shogun-notifier-shogun: Merge pull request #1228 from votjakovr/develop21:00
shogun-notifier-shogun:21:00
shogun-notifier-shogun: potentially fix integration test21:00
@sonney2knaywhayare, yes there is21:01
@sonney2knaywhayare, just do a pull request the buildbot will then build your code :)21:02
naywhayareok.  I live in the past, so let me learn a bit about git :)21:02
@sonney2knaywhayare, actually *I* haven't done any PR but AFAIK it is just creating a branch derived from develop and then you can press a pull request knob on github21:04
@sonney2kvan51, how is it going?21:05
naywhayarehaha.  I figure it's time for me to learn about this stuff anyway... git isn't exactly "new technology" anymore :)21:05
van51sonney2k: hey21:06
@sonney2knaywhayare, well github is making things easy https://help.github.com/articles/using-pull-requests21:06
van51sonney2k: I 've only started a bit the nwordtokenizer21:07
van51sonney2k: I was planning on working thourgh the night, it's less hot :)21:07
@sonney2kvan51, what is the temperature down there?21:07
van51sonney2k: should I proceed with what I told you before? I mean a DotFeatures class based on the current vw_example and vw_parser classes21:07
van51sonney2k: it's around 30 degrees now21:08
@sonney2kwoah21:08
@sonney2kyeah berlin is a chilly place21:08
@sonney2k23 C now21:08
van51I'm jealous21:08
van51although you get used to it21:08
@sonney2kvan51, I actaully don't know what this vw* stuff is for21:09
van51during the day is the worst21:09
van51sonney2k: there is a whole bunch of classes21:09
van51sonney2k: for vw stuff21:09
van51sonney2k: I think it was an integration of vw21:09
@sonney2kvan51, yeah we tried that 2 gsoc's ago but  nowadays I would rather turn vw into a library and have some shallow shogun wrappers around it21:10
@sonney2kanyways I don't really know why we have that21:10
@sonney2kI mean vw is also only using an example == (features, plus one label)21:11
@sonney2kand it can use shogun's streamingfeatures21:11
van51sonney2k: Olivier's and Benoit's suggestion was to have datasets in vw format and then build DotFeatures  object with them that hash the namespace21:12
van51sonney2k: like vw does21:12
@sonney2kvan51, I don't know what vw does here and what that means - could you elaborate?21:13
van51sonney2k: from what I understand, each feature is accompanied by a name which is hashed and that is how they find where to store its value21:14
* sonney2k wonders if lisitsyn made it to berlin21:15
@sonney2kvan51, so it is hashed *together* with the feature?21:15
van51sonney2k: something like that, I;m trying to find the page where I had read it21:16
@sonney2kvan51, if that is the case we should add features supporting this. it is kind of a (sparse) feature matrix plus some category label21:19
van51sonney2k: I can ask Benoit for more details on our hangout21:20
@sonney2kvan51, yeah ask him21:24
@sonney2kiglesiasg, is there no way to avoid the eigen3 code  in the .h?21:25
@iglesiasgsonney2k: I am not sure of it if I want to use it in the arguments of the private methods21:26
@iglesiasgsonney2k: can that become a problem?21:26
@iglesiasgsonney2k: I can add mathematics/eigen3 instead and use typedef for MatrixXd21:26
@sonney2kiglesiasg, it is all about compile speed with swig21:28
@sonney2kiglesiasg, do you know how sergey is hiding tapkee's eigen3 use in shogun?21:29
@iglesiasgsonney2k: the methods are implemented in hpp methods that are called from the cpp21:30
@iglesiasgthere are also some code in between tapkee and Shogun21:30
@sonney2kswig is only wrapping the specified .h files21:31
@sonney2kso none of this is visible directly to swig but will still be needed at compile time21:31
@sonney2kso an option would be to have some class in your code that does the eigen3 std:: etc stuff but that is not %included from swig21:32
@sonney2kand you only need a member of that class and all access to the class is in the .cpp file21:33
@sonney2kvan51, ohh and please add the benchmark code to benchmarks/21:33
@sonney2kvan51, we should really add more benchmarks also for all the other dot features21:34
van51sonney2k: yea the representation is like that. you have a sparse feature matrix and the name of each feature is hashed to find its index in the matrix21:34
@sonney2kvan51, sry parse error21:35
van51sonney2k: I 've jotted it down to push the benchmark21:35
@sonney2kkk21:35
@sonney2kso you have a sparse matrix ok21:36
van51sonney2k: I just have to add some fixed strings as it was reading a file21:36
@sonney2kbut what about the string?21:36
@sonney2kyou have one for each example or each feature?21:36
@sonney2kand why a string not a number21:36
van51sonney2k: each feature has a string name21:37
van51sonney2k: which is hashed pretty much like we were doing for the tokens21:37
@iglesiasgsonney2k: mm I think it is weird to create a new class to implement private methods21:37
@sonney2kvan51,  ok but it would make sense to have just a nubmer instead of a string21:38
van51sonney2k: https://github.com/JohnLangford/vowpal_wabbit/wiki/Tutorial#a-first-dataset21:39
@sonney2kiglesiasg, yeah well but it  would solve it21:39
* sonney2k afk21:39
@iglesiasgsonney2k: what is the part exactly that would make compilation slower?21:40
@iglesiasgsonney2k: include set and vector? include Eigen/Dense in the header?21:40
@iglesiasgsonney2k: if it is about Eigen, we already have a header that includes them, mathematics/eigen3 so I could just include that one instead21:41
@sonney2kiglesiasg, but mathematics/eigen3 is not included from swig21:44
@iglesiasgsonney2k: does that mean I cannot include it from the header?21:45
@sonney2kiglesiasg, well your class would be the only one doing it21:47
@sonney2kso try to avoid it21:47
@sonney2kvan51, pretty complex format21:50
@sonney2kvan51, got it now though21:50
@sonney2kvan51, so an extra category vector would do it21:50
van51sonney2k: what for?21:52
@iglesiasgsonney2k: http://stackoverflow.com/questions/5665471/avoiding-declaring-private-functions-in-class-header-files-c21:53
@iglesiasgsonney2k: see the first answer. Something like this would be good21:53
@sonney2kvan51, instead of having a name for each feature you could use a number21:53
van51sonney2k: the name is used in the data file that is in that format21:55
@sonney2kiglesiasg, yes exactly that is what I had in mind21:56
van51sonney2k: once read an example would consist of pairs (index,value)21:56
@iglesiasgsonney2k: all right then, it feels better to see that it has name and it seems something people already use :) http://en.wikipedia.org/wiki/Opaque_pointer#C.2B.2B21:56
@sonney2kvan51, ahh OK single pass over the data so one could as well do expensive ops on the strings21:57
@sonney2kvan51, btw does StreamingVwFeatures.h already do this?21:57
van51sonney2k: yea I think21:58
@sonney2kiglesiasg, hmmmhh maybe it can even help us to reduce swig wrapper size21:58
van51sonney2k: I had only seend the VwParser21:58
@sonney2kiglesiasg, we cannot use nested classes though due to limitations of the interfaces swig is wrapping to21:59
@iglesiasgsonney2k: but this does not need to be a nested class, right?22:00
@sonney2kvan51, you might follow a different approach22:00
@iglesiasgwith nested class I understand class Foo { class bar {}; };22:00
@sonney2kvan51, consider you have for each feature some category number to be more concrete:22:01
@iglesiasgthis seems to be possible just having one pointer to Bar in Foo22:01
@sonney2kconsider you use DenseFeatures22:01
@sonney2kyou could then create CategorialDenseFeatures out of it by adding a vector of size #dims - which you then do hash  together with its index22:02
shogun-buildbotbuild #1350 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/135022:03
@sonney2ksame with sparse features22:03
@sonney2kvotjakovr, success!!22:03
@sonney2kiglesiasg, yes22:04
@sonney2kiglesiasg, I think using this idiom would really help us to improve shogun's compile speed and readability!22:05
van51sonney2k: you mean an extra vector? with eg random indices for each dimension?22:06
votjakovrsonney2k: good :)22:07
van51sonney2k: and then you would hash value with index? for each feature22:07
@sonney2kvotjakovr, I think the bot will be all green tonight!22:07
@sonney2kvan51, yes an extra vector so one value per dimension with the 'true' dimension being computed based on one value of the extra vector (corresponding to one dimension) and the dimension index22:08
@sonney2kvan51, based on this a sparse feature matrix can be created from any categorial one22:12
van51sonney2k: I think the only problem would be if you a large number of dimensions22:12
van51have*22:12
@sonney2kvan51, for sparse you mean?22:13
@sonney2kvan51, but note that the learned w vector is dense anyway22:13
van51sonney2k: for that extra vector22:13
@sonney2kso it is not that much of a problem22:13
van51sonney2k: can't the dimension index be hashed directly? what good is the extra vector for?22:16
naywhayareokay, I think I did this pull request right: https://github.com/shogun-toolbox/shogun/pull/123022:17
naywhayaresonney2k: so you say this will build automatically and run integration tests?22:17
@sonney2kvan51, sure you could create a sparse matrix immediately22:20
@sonney2knaywhayare, yeah look at https://github.com/shogun-toolbox/shogun/pull/123022:20
@sonney2kand click details on Determining merge status — The Travis CI build is in progress (Details)22:20
@sonney2kthen you will see the tests being run22:20
naywhayarespiffy!  I like it22:20
@sonney2kyeah it is cool stuff22:21
van51sonney2k: cool I'll get started with that then22:21
van51sonney2k: and try to arrange a hangout with Benoit for tomorrow22:21
@sonney2kvan51, btw gsomix' line reader is in22:21
van51sonney2k: yea I saw it :022:21
van51:) *22:21
@sonney2ktogether with support for your delimiter features22:21
van51he also made some imporvements!22:21
@sonney2ktokenizer I mean22:22
* sonney2k tired22:22
van51yes yes :D22:22
@sonney2kso parsing ascii should be much much easier now22:22
@sonney2kif it is all correct22:22
van51sonney2k: idd22:22
@sonney2kof course22:22
van51sonney2k: but not in streaming features22:22
van51sonney2k: they use the streamingAsciiFile class22:22
@sonney2kvan51, well that has to be converted!22:23
van51sonney2k: hehe I was thinking you'd say that :)22:23
@sonney2kvan51, we   only want one well tested line reader22:23
@sonney2kand in shogun we have currently 10 or so ;)22:23
@sonney2kvan51, heh so then what are you waiting for :P22:24
van51sonney2k: hehe those streaming I/O classes look a bit messy22:24
@sonney2kvan51, yeah they were written pre-existince of SGVector & friends22:24
van51sonney2k: all in due time :D22:24
van51sonney2k: I don't mind starting on that as well22:25
@sonney2kvan51, the more you do the more you will realize that there is even more to do :)22:26
van51sonney2k: so you're saying I should be doing less :p22:27
van51less is more22:27
@sonney2kvan51, to the contrary give up   real live that is all we want :-)\22:27
van51they have a reason for saying that :p22:27
van51and here I was thinking you were over-demanding :)22:28
@sonney2kno way22:28
van51but to be honest not much else to do now22:28
van51most friends are sitting exams22:28
van51!22:28
@sonney2ksee22:28
@sonney2kyou have no excuse22:28
@sonney2kvan51, why am I still talking to you then :P22:29
van51sonney2k: dunno! I am starting :)22:29
@sonney2knaywhayare, btw the fix seems indeed a surgical operation22:43
naywhayare:)22:44
naywhayareit took a long time to understand the basic ideas of what was going on22:44
@sonney2kall that condensed into 2 ascii chars22:44
@sonney2kand then forgotten to be rediscovered by other poor individuals22:45
naywhayareso this is all the same benchmarking program I used with k-means for the mlpack paper22:45
naywhayarethe most confusing thing to me is why it worked before22:45
naywhayarewith shogun 1.0.022:45
-!- lisitsyn [~lisitsyn@p5099e2ec.dip0.t-ipconnect.de] has joined #shogun22:45
lisitsynHA-HA! I am in germany22:46
naywhayareI suspect that I compiled it without asserts (to be as fast as possible) and it just wrote over some random memory bits somewhere...22:46
@sonney2klisitsyn, yeaaah!22:46
lisitsynI don't understand what people say!22:46
@sonney2klisitsyn, you managed to catch your plane!22:47
lisitsynsonney2k: oh it was easy22:47
@sonney2klisitsyn, now you finally understand how I feel talking to you22:47
lisitsynsonney2k: bahh you make me sad with such words22:47
@sonney2klisitsyn, why? did the other one have a delay ?22:47
lisitsynsonney2k: no it was really fast22:47
lisitsyncustoms is just a walk through a corridor22:48
lisitsynin SXF it was the same btw22:48
@iglesiasglisitsyn: hello!22:49
lisitsyniglesiasg: hey22:49
@iglesiasglisitsyn: how is Germany then?22:49
lisitsyniglesiasg: I am scared! :D22:50
@iglesiasglisitsyn: haha why?22:51
lisitsyniglesiasg: I am afraid with communicating with people a bit!22:52
@iglesiasglisitsyn: hehe but German people should be good at English!22:54
lisitsyniglesiasg: it is me who is bad at english!22:54
@iglesiasglisitsyn: lol I don't think so!22:55
lisitsyniglesiasg: believe me!22:55
@iglesiasglisitsyn: probably you are just a bit shy to speak right away22:55
@sonney2klisitsyn, don't be afraid most germans don't speak english nor german :)22:59
@iglesiasgnor German lol22:59
lisitsynsonney2k: taxi driver speaked russian :D23:02
@sonney2klisitsyn, hehe23:04
shogun-notifier-shogun: ryan :develop * a4adc15 / src/shogun/clustering/KMeans.cpp: https://github.com/shogun-toolbox/shogun/commit/a4adc155f550d37aeb5c6f49d1f1372ef166705f23:04
shogun-notifier-shogun: Only calculate distances to the correct number of centroids when using prespecified mus.23:04
shogun-notifier-shogun: Soeren Sonnenburg :develop * b33d6b4 / src/shogun/clustering/KMeans.cpp: https://github.com/shogun-toolbox/shogun/commit/b33d6b4243b7b52273d25fc53b05bd1422fdacfe23:04
shogun-notifier-shogun: Merge pull request #1230 from rcurtin/develop23:04
shogun-notifier-shogun:23:04
shogun-notifier-shogun: Only calculate distances to the correct number of centroids when using prespecified mus.23:04
@sonney2knaywhayare, ^merged23:04
naywhayarethanks!23:07
naywhayareI am glad I could help :)23:07
@sonney2kthanks a lot23:11
@sonney2knaywhayare, so now the class overloading with the predefined centers will work?23:11
@sonney2kiglesiasg, could you please twitter about our video recording of the workshop & final program?23:11
naywhayaresonney2k: yeah, it will, but there's no good interface to it.  you have to overload KMeans and rewrite train_machine() and then call clustknb(true, initial_mus)23:13
@iglesiasgsonney2k: done23:15
@sonney2knaywhayare, well it is not problem to add a setter for initial mus23:17
-!- vgorbati [~vgorbati@91.216.173.29] has quit [Ping timeout: 264 seconds]23:17
naywhayaresonney2k: it'll require a little more refactoring than that, but yeah, it won't be too incredibly difficult23:18
@iglesiasgsonney2k, lisitsyn retweet please guys23:18
van51iglesiasg: maybe the date should be specified on the tweet? or at the site23:19
@iglesiasgvan51: yes23:19
@iglesiasgvan51: let me do something about that :)23:19
@sonney2klisitsyn, have you seen serialhex is still alive :)23:20
van51iglesiasg: cool :)23:20
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has left #shogun ["Fallen asleep!"]23:20
@sonney2knaywhayare, yeah sure one (short) train ride ;)23:20
lisitsynsonney2k: yes sure23:21
lisitsyniglesiasg: in a minute23:21
lisitsynretweeted23:21
@iglesiasgthanks23:21
@iglesiasgvan51: date in both places now23:23
van51iglesiasg: good job :)23:23
@iglesiasgvan51: thank you for pointing it out!23:23
van51iglesiasg: heh np23:24
lisitsynokay I'll take some rest now23:25
lisitsynsee you23:25
-!- lisitsyn [~lisitsyn@p5099e2ec.dip0.t-ipconnect.de] has left #shogun []23:26
shogun-buildbotbuild #1028 of cyg1 - libshogun is complete: Failure [failed configure]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/cyg1%20-%20libshogun/builds/1028  blamelist: ryan <ryan@shoeshine.cc.gt.atl.ga.us>23:27
@sonney2k$%*($%(*CF cygwin!23:28
@sonney2kif I only knew what it's problem is23:29
-!- van51 [~van51@athedsl-399972.home.otenet.gr] has quit [Read error: No route to host]23:45
-!- van51 [~van51@athedsl-399972.home.otenet.gr] has joined #shogun23:47
--- Log closed Wed Jul 10 00:00:25 2013

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!