IRC logs of #shogun for Wednesday, 2013-05-22

--- Log opened Wed May 22 00:00:05 2013
--- Day changed Wed May 22 2013
-!- van51 [~van51@athedsl-320452.home.otenet.gr] has left #shogun ["PING 1369173601"]00:00
foulwallHi dvalcarce?01:25
dvalcarcefoulwall, hi!01:37
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]01:41
-!- iglesiasg [d58f329d@gateway/web/freenode/ip.213.143.50.157] has quit [Quit: Page closed]02:07
-!- dvalcarce [5b757556@gateway/web/freenode/ip.91.117.117.86] has quit [Quit: Page closed]02:50
-!- nube1 [~rho@49.244.29.35] has quit [Quit: Leaving.]04:51
-!- hushell [~hushell@8-92.ptpg.oregonstate.edu] has left #shogun ["WeeChat 0.3.7"]05:15
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has joined #shogun06:08
-!- foulwall [~foulwall@2001:da8:215:503:4172:782d:f853:e6d6] has quit [Remote host closed the connection]06:20
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has quit [Quit: Leaving]06:21
-!- gsomix [~gsomix@37.61.180.77] has quit [Quit: Leaving]07:03
-!- zxtx [~zv@ool-1892e23a.dyn.optonline.net] has joined #shogun07:14
-!- nube [~rho@116.90.239.13] has joined #shogun07:30
-!- nube [~rho@116.90.239.13] has quit [Client Quit]07:32
-!- nube [~rho@116.90.239.13] has joined #shogun07:33
-!- foulwall_ [~foulwall@2001:da8:215:503:a4da:7547:abec:5503] has joined #shogun07:37
-!- hushell [~hushell@8-92.ptpg.oregonstate.edu] has joined #shogun08:30
-!- hushell [~hushell@8-92.ptpg.oregonstate.edu] has quit [Quit: WeeChat 0.3.7]08:39
-!- lisitsyn [~blackburn@37.61.180.77] has quit [Quit: Leaving.]08:49
@wikingsonney2k: ok i'll check today before late night the thingy09:02
-!- iglesiasg [c1934402@gateway/web/freenode/ip.193.147.68.2] has joined #shogun09:15
-!- mode/#shogun [+o iglesiasg] by ChanServ09:15
-!- lisitsyn [~lisitsin@mxs.kg.ru] has joined #shogun09:16
-!- mode/#shogun [+o lisitsyn] by ChanServ09:16
@lisitsynsonney2k: sonne|work: yes I will push it soon09:22
@lisitsyn(about RNG in tapkee)09:22
sonne|worklisitsyn: I assume you will then youse the CMath::random* functions?09:23
@lisitsynsonne|work: yes with some define magic09:23
sonne|workok09:23
sonne|worklisitsyn: just make sure that shogun's random(min,max) functions are closed interval09:24
sonne|workI mean that this fits what you need09:24
@wikinglisitsyn: if not then you can use some other random_* functions in CRandom09:26
@wiking;P09:26
sonne|workwiking: well in fact once my patch is merged - we should make introduce static random() functions in Random and drop the ones from CMath09:28
-!- nube [~rho@116.90.239.13] has quit [Quit: Leaving.]09:56
-!- nube [~rho@116.90.239.13] has joined #shogun09:57
sonne|workwiking: btw any feedback?09:57
@wikingsonne|work: hard drives are dying around me10:28
@wikingactually now it seems even mine10:28
@wikingsorry but have to do seomthing about this first10:28
sonne|workgood luck10:28
-!- hushell [~hushell@c-67-189-100-116.hsd1.or.comcast.net] has joined #shogun10:46
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun11:03
shogun-notifier-shogun: lambday :develop * b005795 / / (5 files): https://github.com/shogun-toolbox/shogun/commit/b0057954d3f6dda266b21c5e9c4e3062d909784911:03
shogun-notifier-shogun: Jacobi Elliptic Functions added11:03
shogun-notifier-shogun: Heiko Strathmann :develop * 8bb3fd5 / / (5 files): https://github.com/shogun-toolbox/shogun/commit/8bb3fd559da99d5adc90dc8c2f97f26c4fb832bf11:03
shogun-notifier-shogun: Merge pull request #1111 from lambday/develop11:03
shogun-notifier-shogun:11:03
shogun-notifier-shogun: JacobiEllipticFunctions added11:03
shogun-buildbotbuild #859 of cyg1 - libshogun is complete: Failure [failed configure]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/cyg1%20-%20libshogun/builds/859  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>11:08
shogun-buildbotbuild #860 of cyg1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/cyg1%20-%20libshogun/builds/86011:30
-!- iglesiasg [c1934402@gateway/web/freenode/ip.193.147.68.2] has quit [Quit: Page closed]12:16
-!- lambday [e8b6149@gateway/web/cgi-irc/kiwiirc.com/x-kxrcuwzhyylfmgom] has joined #shogun12:22
-!- gsomix [~gsomix@185.6.239.113] has joined #shogun12:22
gsomixhello!12:22
@HeikoShi!12:22
lambdayHeikoS: hi12:22
@HeikoShi lambday12:23
lambdayHeikoS: arprec seemed to have worked...12:24
lambdayHeikoS: we need to more methods that computes shifts and weights.. do you think Statistics is a good place for that?12:24
@HeikoSlambday: good question12:26
@HeikoSmaybe a helper class for CG12:26
@HeikoSah no12:26
@HeikoSits related to the rational approximations12:27
@HeikoSso a helper class for this12:27
@HeikoScontour integral helper or so12:27
lambdayHeikoS: hmm.. okay12:28
lambdayso a separate class with two static methods, right?12:29
lambdayCContourIntegral or something12:29
@HeikoSyes12:29
@HeikoSwith a reference etc12:29
lambdayumm.. reference?12:30
@HeikoSjust what the contour integral is etc12:31
@HeikoSand paper reference12:31
lambdayohh12:31
lambdayyes12:31
lambdayonce this is done I'll chalk out a class diagram of the framework12:32
@HeikoSokay12:32
@HeikoSsounds good12:32
lambdayone question - while registering the systems (to be solved later) we need to store the shifts for those systems somewhere in the computation class, right?12:34
@HeikoSyes exactly12:34
lambdayokay12:34
@HeikoSmaybe we can do this via indices or so12:34
@HeikoSsince redundant12:34
@HeikoSso one passes a vector of shifts12:35
@HeikoSand every problem has a list of indices for them12:35
@HeikoSthis minimises the communication overhead12:35
lambdayHeikoS: awesome idea12:35
lambdayokay...12:35
-!- iglesiasg [c1934d16@gateway/web/freenode/ip.193.147.77.22] has joined #shogun12:45
-!- mode/#shogun [+o iglesiasg] by ChanServ12:45
sonne|workhi gsomix! how is it going?13:00
sonne|workand hey foulwall_! are you feeling better?13:00
gsomixsonne|work, fine, have returned from the university. now testing and preparing PR.13:01
-!- lambday [e8b6149@gateway/web/cgi-irc/kiwiirc.com/x-kxrcuwzhyylfmgom] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]13:02
@lisitsynsonne|work: http://jmlr.org/papers/volume14/curtin13a/curtin13a.pdf shameful tests for us13:10
sonne|worklisitsyn: well KNN / k-means - not really shameful13:12
@wikinglisitsyn: :)13:13
sonne|workand you don't know which version of shogun this is13:13
@wikinglisitsyn: we only need to work on knn and kmeans :P13:13
@lisitsynnaywhayare: which version of shogun that is? ;)13:13
@lisitsynsonne|work: and they named us shogun toolkit13:14
@lisitsyn:D13:14
sonne|worklisitsyn: btw I wonder why shogun is like 4 times faster on the isolet dataset13:16
sonne|workbut consistently slower on everything else13:16
@wikingsonne|work: btw: about bagging13:16
@wikingu got a sec to talk about that?13:16
sonne|workwiking: well talk13:16
@wikingsonne|work: bagging class would simply just work only on one type of classifier at a time right?13:18
sonne|workyes13:18
@wikingsonne|work: i.e. Bagging(machine, features, labels)13:18
sonne|workBaggingMachine yes13:18
@wikingor not necessarily in constructor13:18
@wikingor Bagging(features,labels)13:19
sonne|workand some number of baggings to do13:19
@wikingand then Bagging.run(machine, number of bags)13:19
sonne|workwell it needs a machine, features, labels, num_baggings13:19
sonne|workwiking: wait no13:19
sonne|workkeep it to work with the machine interface13:19
sonne|workso train(data)13:19
@wikingaaah13:19
sonne|workparameters have to be set before13:19
@wikingbut still then13:19
@wikingBagging(features,labels)13:20
@wikingbagging.set_machine(machine)13:20
@wikingbagging.train(data)13:20
@wikingsomething like this13:20
@wikingso that one could reuse Bagging object for the same feature,label pair13:20
@wikingwith different machine13:20
sonne|worklisitsyn: yeah and it is all rather small data sets still13:21
@wikingah yeah there should be as well bagging.set_num_bags(bags)13:21
@wikingok13:21
@wikingthis should be pretty straightforward as far as i can see now13:21
sonne|workwiking: yeah all you need is a good prng :D13:22
@wikingsonne|work: lol13:22
@wikingsonne|work: btw for the final Bagging.classify(data) we would need to be able to set different voting schemes13:22
@wikingok one remaining question13:23
@wikingwhere should Bagging reside?13:23
@wikingsonne|work: machine/Bagging.?13:23
@wikingor modelselection? :)13:24
@wikingit's pretty far fetched but still13:24
sonne|workwiking: machine/BaggingMachine.h for the master class13:26
@wikingk13:26
@wikingand then we would still implement RandomForest : BaggingMachine?13:27
sonne|workwiking: rather implement a tree13:28
@wikingyep i thought so13:28
sonne|workthat is then directly used in baggingmachine to create the forest13:28
sonne|workthough it might be helpful for some to create a RandomForest class that just utilizes the baggingmachine with a tree13:29
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has joined #shogun13:32
sonne|worklisitsyn: I think we should also create some kind of benchmark table - just for us to see if our algorithms became slower/faster13:34
@lisitsynsonne|work: makes sense13:36
gsomixsonne|work, done13:40
@wikinggsomix: benchmark table? woah that was fast!13:41
@lisitsynhahhahahah13:41
@lisitsynrofl13:41
gsomixwiking, lol. >:313:41
sonne|workgsomix: where?13:42
gsomixsonne|work, about PR, I hope? https://github.com/shogun-toolbox/shogun/pull/111913:43
@lisitsynsonne|work: ha! why is it BSD?13:44
sonne|workgsomix: am I missing something?13:44
sonne|worklisitsyn: ?13:44
@lisitsynsonne|work: license of the file13:45
@lisitsynasciifile13:45
sonne|worklisitsyn: ahh13:45
@lisitsynahhh got it13:45
gsomixsonney2k, mmm? O_O13:45
@lisitsynI saw just a few lines13:45
@lisitsynin the diff13:45
@lisitsynso GPL + BSD13:45
sonne|workgsomix: where is the function?13:45
gsomixsonne|work, line 1024.13:46
-!- nube [~rho@116.90.239.13] has quit [Quit: Leaving.]13:46
-!- nube [~rho@116.90.239.13] has joined #shogun13:47
sonne|workgsomix: you  need to benchmark / test this thoroughly - the function is not easily readable :/13:49
sonne|workgsomix: take e.g. a file of a few GB in size (say 10GB) and one with a few bytes only13:50
sonne|workand then test how long it takes to read it / count number of lines or sth as test13:50
gsomixsonne|work, ok!13:50
-!- van51 [~van51@195.251.235.71] has joined #shogun13:53
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]14:04
@wikingsonne|work: actually nothing is against having the benchmark tests be part of the unit tests ;)14:11
@wikingsonne|work: since the running time e.g. is measured by google unit test FW ;P14:11
sonne|workwiking: haha we don't want to wait an hour :D14:12
@wikingsonne|work: well then just create a new dir but still keep using gtest fw14:13
@wiking:P14:13
-!- hushell [~hushell@c-67-189-100-116.hsd1.or.comcast.net] has quit [Ping timeout: 252 seconds]14:16
-!- iglesiasg [c1934d16@gateway/web/freenode/ip.193.147.77.22] has quit [Ping timeout: 250 seconds]14:16
-!- van51 [~van51@195.251.235.71] has quit [Quit: Leaving.]14:19
vgorbatilisitsyn: here?14:26
@lisitsynvgorbati: yes14:27
vgorbatilisitsyn: back to my question: is it ok to put the function 'get_feature_vectors_and_compute' into 'Kernel.h' file?14:28
@lisitsynvgorbati: yeah probably14:28
sonne|workvgorbati, lisitsyn what is this for?14:30
sonne|workwiking: haha14:30
vgorbatisonne|work: a lot of kernels share the same pattern: they get feature vectors from lhs and rhs, and then do some computations14:30
vgorbatisonne|work: I suggested to extract the part of getting the feature vectors into separate function and re-use it14:31
vgorbatisonne|work: I have already tried this approach for one kernel, what if I send a PR, so that you can decide whether it makes sense, and if it does - I will do it for other kernels?14:32
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has quit [Ping timeout: 250 seconds]14:45
foulwall_hi sonne|work14:46
sonne|workhi foulwall14:46
sonne|workhow are you?14:46
foulwall_sonne|work: all right. I'm doing the data importer14:47
sonne|workfoulwall_: so headache is gone very good14:47
sonne|workfoulwall_: data importer?14:47
sonne|workyou mean reading of .h5 files?14:48
foulwall_sonne|work: What I think is make a new view, when the client requires a data by filename, the view respond with a json14:49
-!- foulwall_ [~foulwall@2001:da8:215:503:a4da:7547:abec:5503] has quit [Remote host closed the connection]14:51
-!- nube [~rho@116.90.239.13] has quit [Quit: Leaving.]15:01
-!- foulwall [~foulwall@2001:da8:215:6120:d86f:dfa7:6c8c:cc4] has joined #shogun15:08
-!- zxtx [~zv@ool-1892e23a.dyn.optonline.net] has quit [Ping timeout: 256 seconds]15:12
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has joined #shogun15:29
vgorbatilisitsyn, sonne|work: sent a PR15:44
-!- iglesiasg [c1934d16@gateway/web/freenode/ip.193.147.77.22] has joined #shogun16:07
-!- mode/#shogun [+o iglesiasg] by ChanServ16:08
@lisitsynsonne|work: first phase of dedup is here16:13
sonne|worklisitsyn: cool16:15
sonne|worklisitsyn: no conflicts?16:16
@lisitsynsonne|work: no16:16
@lisitsynsonne|work: https://github.com/shogun-toolbox/shogun/pull/1120/files#r4338851 please check when you get some time16:16
naywhayarelisitsyn: sorry about the "shogun toolbox".  I realized that after it was too late.  I think I also botched "scikit.learn" which should be "scikit-learn" (how did I do that?)16:36
@lisitsynnaywhayare: :)16:37
@lisitsynnaywhayare: I am finishing my paper for jmlr mloss as well16:38
@lisitsynI've been trying to finish it last two months haha :D16:38
-!- iglesiasg [c1934d16@gateway/web/freenode/ip.193.147.77.22] has quit [Ping timeout: 250 seconds]16:38
naywhayareI was using shogun out of git probably about eight months ago16:38
naywhayareI think with kNN, shogun was using the brute-force N^2 search16:39
@lisitsynI see16:39
naywhayarewhich explains why it seems to do better with ISOLET -- ISOLET has rather high dimensionality, and trees don't do as well in those settings16:39
naywhayarethe commands I was using was the best I could find in the documentation without digging too deep into the code16:39
naywhayareusing the text interface (I think that's what it's called) it looked like this:16:40
naywhayarenew_classifier KNN16:40
naywhayaretrain_classifier 416:40
naywhayareset_features TEST /some/file16:40
naywhayareout.txt = classify16:40
naywhayareI think in the paper we used k = 3 (I can't remember right now), but that doesn't make a huge difference16:41
sonne|worknaywhayare: knn / kmeans are not exactly fast in shogun anyway...16:42
naywhayareyeah; shogun focuses on SVM (to my understanding) so it's not like shogun is claiming to be the best in those things16:43
-!- foulwall [~foulwall@2001:da8:215:6120:d86f:dfa7:6c8c:cc4] has quit [Remote host closed the connection]16:43
-!- iglesiasg [c1934d16@gateway/web/freenode/ip.193.147.77.22] has joined #shogun16:44
-!- mode/#shogun [+o iglesiasg] by ChanServ16:44
-!- lisitsyn [~lisitsin@mxs.kg.ru] has quit [Quit: Leaving.]17:03
-!- pickle27 [~kevin@rcv3-lab-pc.ee.queensu.ca] has joined #shogun17:03
sonne|worknaywhayare: well we have lots of other stuff too but we only claim to be best in SVM related business :D17:04
@wikingsonne|work: we should diversify ;P17:04
sonne|workwiking: we do!17:05
-!- van51 [~van51@athedsl-320452.home.otenet.gr] has joined #shogun17:10
-!- foulwall [~foulwall@2001:da8:215:c252:bcbe:6ebf:7c7f:6188] has joined #shogun17:14
-!- romi__ [~mizobe@187.101.139.4] has joined #shogun17:38
foulwallsonney2k: sonney, there's only a australian.libsvm.h5 in shogun-data, respect to the other data files in the repo, I must do standardize job.17:46
foulwallsonne|work: and when I standardize, I'll convert all of them to .h5?17:47
@sonney2kfoulwall, no just use this single one17:48
@sonney2kfoulwall, we can add more data from mldata.org later17:48
foulwallsonne|work: sorry I went wrong again...17:49
@sonney2kfoulwall, better always ask - I totally don't mind to the contrary17:50
@sonney2kit is frustrating for you / me otherwise17:50
foulwallsonne|work: ok~17:51
@sonney2kgtg17:51
foulwallsonney2k: bye17:52
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has quit [Ping timeout: 250 seconds]17:53
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has joined #shogun17:59
-!- sumit [75e1c0a1@gateway/web/freenode/ip.117.225.192.161] has joined #shogun18:14
-!- sumit [75e1c0a1@gateway/web/freenode/ip.117.225.192.161] has quit [Quit: Page closed]18:49
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has joined #shogun18:58
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun19:09
shogun-notifier-shogun-demo: foulwall :data * 073026a / / (8 files): https://github.com/shogun-toolbox/shogun-demo/commit/073026a3893fd4028d8a651ee59d8397f118801d19:09
shogun-notifier-shogun-demo: 1. import the shogun-data as a submodule. 2. add serveral lines for19:09
shogun-notifier-shogun-demo: gp-demo, for fetch the data from australian.libsvm.h5. 3. add a feature19:09
shogun-notifier-shogun-demo: on all available demos, when user press the button, when the browser do19:09
shogun-notifier-shogun-demo: the ajax activity, the button are disabled to get rid of the duplicate19:09
shogun-notifier-shogun-demo: calculation.19:09
@sonney2kRe19:09
foulwallsonney2k: ah, notifier!19:09
-!- iglesiasg [c1934d16@gateway/web/freenode/ip.193.147.77.22] has quit [Quit: Page closed]19:11
@sonney2kfoulwall, something is wrong with data though19:23
@sonney2kfoulwall, it points to your data repository19:23
foulwallsonney2k: oh I fix19:24
foulwallsonney2k: The 'australian.libsvm.h5' file has 15 features, Is that means what I can do is extract any pair of features and treat them as 2 dims data, then send them into svr/gp demo?19:25
@sonney2kfoulwall, yes - btw please still work in your foulwall fork and interact with the official shogun-demo via PR's19:25
foulwallsonney2k: ok19:26
@sonney2kwiking, help help!19:28
foulwallsonney2k: sent the fix pr. I'll try to import the data to the demos as much as I can tomorrow. goodnight~19:36
-!- romi__ [~mizobe@187.101.139.4] has quit [Quit: Leaving]19:37
@sonney2kfoulwall, good night!19:38
@sonney2kHeikoS, I am getting this19:45
@sonney2k./statistics_mmd_kernel_selection_combined.py:73: RuntimeWarning: [WARN] ������MMDKernelSelectionComb::solve_optimization(): all mmd estimates are negative. This is techically possible, although extremely rare. Consider using different kernels. This combination will lead to a bad two-sample test. Since anycombination is bad, will now just return equally distributed kernel weights19:45
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has quit [Ping timeout: 250 seconds]19:46
@HeikoSreally?19:46
@HeikoSsonney2k, consistently?19:46
@sonney2kHeikoS, well I changed the rng so maybe this is causign this19:49
-!- foulwall [~foulwall@2001:da8:215:c252:bcbe:6ebf:7c7f:6188] has quit [Remote host closed the connection]19:53
shogun-notifier-shogun-data: Soeren Sonnenburg :master * 03cbc66 / testsuite/tests/ (12 files): https://github.com/shogun-toolbox/shogun-data/commit/03cbc66469bde59145b03048144a6b003c99127419:58
shogun-notifier-shogun-data: update integration tests to new random functions19:58
shogun-notifier-shogun-data: Soeren Sonnenburg :master * 4831243 / testsuite/clustering/KMeans_EuclideanDistance_3.m: https://github.com/shogun-toolbox/shogun-data/commit/483124318ef0cbd64b7d844520322898cc2b558219:58
shogun-notifier-shogun-data: fix old integration tests19:58
shogun-notifier-shogun: Soeren Sonnenburg :develop * a2519cf / / (6 files): https://github.com/shogun-toolbox/shogun/commit/a2519cf7694872290fb1ffc050aee9f10e08486719:58
shogun-notifier-shogun: use lower order bits in prng19:58
shogun-notifier-shogun:19:58
shogun-notifier-shogun: - This is about 2 times faster compared to the previous rng.19:58
shogun-notifier-shogun: - Add unit tests to ensure things are correct19:58
shogun-notifier-shogun: - Update integration test data19:58
shogun-notifier-shogun-demo: foulwall :master * d45d160 / / (8 files): https://github.com/shogun-toolbox/shogun-demo/commit/d45d160283b7e6095435cd23c1e4466150aa288720:00
shogun-notifier-shogun-demo: 1. import the shogun-data as a submodule. 2. add serveral lines for20:00
shogun-notifier-shogun-demo: gp-demo, for fetch the data from australian.libsvm.h5. 3. add a feature20:00
shogun-notifier-shogun-demo: on all available demos, when user press the button, when the browser do20:01
shogun-notifier-shogun-demo: the ajax activity, the button are disabled to get rid of the duplicate20:01
shogun-notifier-shogun-demo: calculation.20:01
shogun-notifier-shogun-demo: Soeren Sonnenburg :master * 083c75b / / (8 files): https://github.com/shogun-toolbox/shogun-demo/commit/083c75bd3caca92adc98a99f5609844548b3713720:01
shogun-notifier-shogun-demo: Merge pull request #3 from foulwall/data20:01
shogun-notifier-shogun-demo:20:01
shogun-notifier-shogun-demo: correct the shogun-data submodule repo url20:01
-!- HeikoS [~heiko@nat-163-207.internal.eduroam.ucl.ac.uk] has quit [Quit: Leaving.]20:01
shogun-buildbotbuild #861 of cyg1 - libshogun is complete: Failure [failed configure]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/cyg1%20-%20libshogun/builds/861  blamelist: Soeren Sonnenburg <sonne@debian.org>20:11
-!- iglesiasg [d58f32a1@gateway/web/freenode/ip.213.143.50.161] has joined #shogun20:22
-!- mode/#shogun [+o iglesiasg] by ChanServ20:22
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has joined #shogun20:25
-!- van51 [~van51@athedsl-320452.home.otenet.gr] has quit [Read error: Connection reset by peer]20:27
-!- van51 [~van51@athedsl-320452.home.otenet.gr] has joined #shogun20:27
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has quit [Client Quit]20:28
@sonney2kvan51, do you still have time for some stuff?20:29
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has joined #shogun20:29
@sonney2kI need to reduce this blacklist https://github.com/shogun-toolbox/shogun/blob/develop/tests/integration/python_modular/generator.py20:29
van51sonney2k: yea sure20:29
@sonney2kto close to 020:29
@sonney2kthese are all tests that fail for one reason or another20:29
-!- lisitsyn [~blackburn@185.6.239.113] has joined #shogun20:29
-!- mode/#shogun [+o lisitsyn] by ChanServ20:29
@sonney2ksome trivial some not fixable by a human being20:30
van51sonney2k: haha20:30
@sonney2k(without super powers)20:30
van51you want me to go over them?20:30
@sonney2kI am going over them too20:30
@sonney2kbasically what one needs to do is remove .py example from the blacklist20:31
@sonney2krun python generator.py example.py20:31
@sonney2kand then tester.py example.py20:31
@sonney2kand if it works - all fine20:31
@sonney2kif not make it work20:31
van51ok20:32
van51can do20:32
@sonney2kvgorbati, help much appriciated20:32
vgorbatisonney2k: in fixing integration tests?20:32
@sonney2kvgorbati, yeah ...20:34
van51sonney2k:should we report them back here?20:34
vgorbatisonney2k: what do you want more: converting to SGVector<..> in kernels or fixing tests?20:34
@sonney2kvan51 yeah20:37
@sonney2kI will also keep you updated about my findings20:37
@sonney2kvgorbati, tests first - maybe you choose the *kernel* ones20:39
@sonney2kvan51, doing library_time.py20:39
van51sonney2k: had you started them from the top?20:39
van51sonney2k: I took it from the bottom, I'm at distance_mahalanobis20:40
@sonney2kvan51, no random picks20:40
-!- hushell [~hushell@c-67-189-100-116.hsd1.or.comcast.net] has joined #shogun20:43
van51sonney2k: I went over them20:54
van51I have six not working20:54
van51sonney2k: and four say that I should recompile with --enable-swig-directors20:55
van51but they report ok, should I recompile?20:55
@sonney2kvan51, ohh the swig director ones are tough20:55
@sonney2kvan51, that needs superhuman powers ...20:56
van51sonney2k: the other six it is then20:56
@sonney2kvan51, IDK if you know but this is C++ class -> python class -> python class extended20:57
@sonney2kand the extensions in python are used by the C++ class!20:57
@sonney2kheureka!20:57
van51sonney2k: you kind of lost me :p20:58
@sonney2kvan51, think of a shogun C++ class20:58
@sonney2ksay CKernel20:58
@sonney2kswig gives you CKernel inside python20:58
@sonney2know think of a virtual function in CKernel20:58
@sonney2ksay compute(int idxa, int idxb)20:59
@sonney2kyou overload that class in python20:59
@sonney2kand whoever in shogun uses CKernel::compute20:59
@sonney2kwill call the python function!20:59
van51aah sweet20:59
van51and what was the heureka for?21:00
@sonney2kvan51, gsomix wrote that last gsoc - swig supports that but it is crazy21:00
@sonney2kcrazy feature IMHO21:00
@sonney2khighly unexpected to even work21:00
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has quit [Ping timeout: 250 seconds]21:01
@sonney2kvan51, do all the transfer_* things work?21:01
van51you think the errors in those examples come from this?21:01
@sonney2kvan51, ?21:01
van51sonney2k : yea21:01
@sonney2kvan51, ok then enable what works and send a PR21:02
van51ok21:02
@lisitsynsonney2k: why, people used it21:02
@sonney2kohh I need another round of time zone collection21:02
@sonney2kvan51, lisitsyn, votjakovr, pickle27, hushell, gsomix, iglesiasg  - you time zones please21:03
@sonney2klisitsyn, Heiko is in UTC+1 ?21:03
@iglesiasgsonney2k: your time zone ;)21:03
@sonney2kiglesiasg, UTC+221:03
@lisitsynsonney2k: heiko is in london I guess?21:03
@sonney2kiglesiasg, so 21hrs now?21:04
@lisitsynsonney2k: mine and gsomix is +421:04
@iglesiasgsonney2k: yeah21:04
van51sonney2k: UTC+3 now21:05
votjakovrsonney2k: UTC+721:05
@sonney2kvan51, you are travelling?21:05
@sonney2kor why now?21:05
gsomixlisitsyn, tnx21:06
van51sonney2k: heh no21:06
van51sonney2k: i was sure it was utc+221:06
van51and you said 21hrs21:06
van51so I looked it up21:06
van51because it's 10 o'clock here21:07
van51and it says UTC+2/321:07
van51so I'm guessing it has to do with daylight saving time21:07
gsomixsonney2k, van51 not crazy, just bad documented21:08
@sonney2kvan51, where is that?21:08
van51sonney2k: athens. greece21:08
van51gsomix: I never said anything :p21:08
@sonney2kvan51, uh and you still talk to me - I am honored21:08
van51sonney2k: just because I have to :p21:09
@sonney2khehe21:10
@sonney2klisitsyn, do you recall which timezone flouwall is in?21:11
@lisitsynsonney2k: whole china is in the one timezone iirc21:12
@lisitsynsonney2k: +8 or so21:12
@sonney2klisitsyn, pickle27 was from ?21:13
@sonney2keurope still?21:13
@lisitsynsonney2k: canada21:13
@lisitsynor so21:13
@sonney2kI suckk21:13
@sonney2kalright I recall21:13
@lisitsynahh21:14
@lisitsynsonney2k: yes21:14
@lisitsynsonney2k: ontario21:14
@sonney2khe is the one who doesn't want to get up early21:14
@sonney2kbut will have to if accepted21:14
@lisitsynsonney2k: haha21:14
@sonney2kmaybe he will reconsider :D21:14
pickle27sonney2k: lisitsyn yes Canada21:15
pickle27pacific time21:15
@sonney2kpickle27, so UTC-4 ?21:15
pickle27wait woops21:15
pickle27eastern time21:15
pickle27TUC - 521:16
pickle27UTC*21:16
@sonney2kpickle27, whats your local time now?21:16
pickle273:15 pm21:16
pickle27so 15:1521:16
@sonney2kUTC is 7pm21:16
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has joined #shogun21:16
@sonney2kerr 9pm21:16
@sonney2kerr 7 pm21:17
* sonney2k dies21:17
@sonney2kso UTC-421:17
@lisitsynsonney2k: just use 24h format21:17
pickle27sonney2k: time zones are confusing21:17
pickle27sorry yeah its UTC - 4 for summer21:17
@sonney2klisitsyn, pickle27 started with am/pm to confuse me21:17
@lisitsynI don't know any reason to use it21:18
@sonney2klisitsyn, do you recall hushell's UTC?21:19
@sonney2ktimezone I mean21:19
@lisitsynsonney2k: oregon21:19
@lisitsynsonney2k: may be utc -521:19
@sonney2kso alsoe UTC-421:19
@lisitsynsonney2k: west coast21:19
@sonney2kvgorbati, your time zone?21:19
pickle27 sonney2k I can get up early for meetings lol21:20
vgorbatisonney2k: UTC+3:0021:20
@sonney2kso let see21:21
@sonney2kcheng is UTC+1021:21
@sonney2kpickle27/hushell UTC-421:21
@sonney2kso if we had a meeting at 11 UTC it would be 7-8 for pickle27/hushell and 21-22 for cheng21:23
@sonney2knot too bad21:23
pickle27sonney2k: yeah I could do that21:24
vgorbatisonney2k: just want to be sure: if I run 'python generator.py test.py', followed by 'python tester.py test.py' and they both give 'OK' - then the test can be un-blacklisted?21:29
van51vgorbati: yeah, but I just made a PR about those21:37
van51if you have gone over some, maybe we can double-check21:38
van51although, probably travis will let me know, right?21:38
vgorbativan51: have you gone through all black-listed tests?21:42
-!- Netsplit *.net <-> *.split quits: sanyam21:42
van51vgorbati: yeah21:43
vgorbativan51: so, the green ones here https://github.com/shogun-toolbox/shogun/pull/1121/files are the tests that still fail?21:44
vgorbativan51: not green ones, but white ones*21:44
vgorbativan51: actually, both of them:)21:45
van51vgorbati: actually, both the green and white ones21:45
van51yea :)21:45
van51vgorbati: but that is on my machine, for some reason I see them failing on travis21:45
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has quit [Quit: Leaving]21:46
@sonney2kvan51, well you didn't submit the new data21:46
@sonney2kvan51, let me try with your blacklist21:46
@sonney2klisitsyn, converter_tdistributedstochasticneighborembedding_modular.py setting 1/1 ERROR21:51
@lisitsynsonney2k: again21:51
@lisitsyn:D21:51
vgorbatilisitsyn: this one should be refactored21:52
@lisitsynoh yes sure21:52
vgorbatisonney2k: it can't be OK without any changes21:52
@sonney2kvgorbati, ok blacklisting it again21:52
vgorbatisonney2k: I guess I will take this one to fix, since I am the one who wrote it:)21:53
van51does that one require a specific library?21:54
van51because it passed as ok to me21:54
vgorbativan51: no, this one basically can return new values at every run, since it is calling randomized method21:56
vgorbativan51: and since tester.py just compares the results with serialized file for strict equality, it will fail21:56
shogun-notifier-shogun-data: Soeren Sonnenburg :master * afe8ada / testsuite/tests/ (28 files): https://github.com/shogun-toolbox/shogun-data/commit/afe8adad2b7dd633f94e2e20a9b0269db03aa16c21:57
shogun-notifier-shogun-data: re-enable integration tests21:57
vgorbativan51: or, at least, it CAN fail even if the method is OK21:57
shogun-notifier-shogun: Soeren Sonnenburg :develop * 683cab4 / / (3 files): https://github.com/shogun-toolbox/shogun/commit/683cab4f9ace33f363ba2b0b6bb80456c50cf6e721:58
shogun-notifier-shogun: re-enable integration tests (thanks to van51!)21:58
@sonney2kvgorbati, maybe you could use the shogun random framework - then it should give some reproducible result21:58
@lisitsynsonney2k: I am merging tapkee with shogun random21:59
vgorbatilisitsyn: so, if tapkee will use shogun random, I can set the seed at the beginning of the test, and then it should produce similar results?22:02
@lisitsynvgorbati: no idea to be honest22:02
@lisitsynvgorbati: as I am merging your code to the repo you will be mentioned in the acknowledgments of my paper :)22:06
vgorbatilisitsyn: Does it mean I will become world-famous?:)22:06
@lisitsynvgorbati: not really but a bit :D22:07
@sonney2kiglesiasg, btw what is up with https://github.com/shogun-toolbox/shogun/pull/1089 ?22:08
@sonney2kiglesiasg, the code looked pretty ok, add some unit tests and get this merged22:09
@sonney2kotherwise it will rot22:09
@sonney2k(tm)22:10
-!- vgorbati [d4029f22@gateway/web/freenode/ip.212.2.159.34] has quit [Quit: Page closed]22:11
gsomixsonney2k, hope, it's readable now. https://github.com/shogun-toolbox/shogun/pull/111922:20
@sonney2kvan51, haha look at https://travis-ci.org/shogun-toolbox/shogun/jobs/740438522:20
@sonney2kbasically all the things we enabled fail now22:20
@sonney2ksearch for 'The following tests failed"22:21
shogun-buildbotbuild #862 of cyg1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/cyg1%20-%20libshogun/builds/86222:22
van51haha22:22
van51is it every single one that was enabled?22:22
@sonney2kgsomix, no still not readable - the function is 100 lines22:23
@sonney2kcan you break it down to say 20 line functions?22:23
gsomixsonney2k, of course. I'll do this.22:24
van51sonney2k: i'm telling you they are reporting OK here!22:24
@sonney2kvan51, yeah same here!22:25
van51sonney2k: good, I thought I was going crazy :p22:25
@sonney2kvan51, but not travis... I have no idea what travis does / runs on if you can figure out how we can simulate running on travis we could debug things22:25
@sonney2kif not then we have to somehow ``fix'' things from where we are22:25
@iglesiasgsonney2k: I will try to get some time for it ASAP22:27
-!- travis-ci [~travis-ci@ec2-184-73-46-130.compute-1.amazonaws.com] has joined #shogun22:28
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/740438122:28
-!- travis-ci [~travis-ci@ec2-184-73-46-130.compute-1.amazonaws.com] has left #shogun []22:28
van51sonney2k: apart from "classifier_conjugateindex_modular.py" all other error are very small, right?22:29
@sonney2kvan51, yeah seems like22:30
@sonney2k-bias float64 1.51117933327755822:30
@sonney2k+bias float64 1.51117933327756222:30
@sonney2kgsomix, btw please don't do 2*buffer size - use some configurable upper limit for a line (say 10MB)22:32
@sonney2kvan51, hmm the diff of the transfer_multitask_l12_logistic_regression* is weird22:33
@sonney2kseems like it is empty or bug?22:34
van51sonney2k: it seems empty22:34
van51and in other files too22:34
shogun-buildbotbuild #1155 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/1155  blamelist: Soeren Sonnenburg <sonne@debian.org>22:46
hushellsonney2k: I am in UTC -7, now is 13:5222:53
hushellIf the meeting is UTC 11 am, seems would be 4 am for me :D22:53
@sonney2khushell, argh23:01
hushellsonney2k: could you make it a bit eariler or late few hours? But I can also stay until 4am23:01
hushellI am available from UTC 14:00 to UTC 09:0023:02
@sonney2kdifficult!23:02
hushellhaha it's hard to figure out the right time23:03
@sonney2kvan51, I suggest to blacklist again for now23:03
van51sonney2k: probably.. I've been looking at it23:03
van51but nothing..23:03
van51sonney2k: could it be a compiler thing?23:03
@sonney2khushell, think of UTC+10 in australia23:03
@sonney2kvan51, it could already be a different version of eigen/lapack/blas etc23:04
@sonney2kand compiler too yes23:04
@sonney2kvan51, maybe try with clang...23:04
van51sonney2k: i just compiled wih that23:04
van51and ran just tester.py with some failing examples23:04
van51and they passed..23:05
hushellWell, I can make the meeting, but not everytime, that could be difficult :)23:05
van51sonney2k:w823:05
hushellMaybe I should change a bit my schedule in summer23:05
@lisitsynhushell: we are going to have just a few meetings I think23:06
@lisitsynthat's not day to day I mean :)23:06
hushell:D once a week is fine for me23:07
hushelland you know in summer always hot in daytime23:07
@sonney2khushell, about once a month23:07
hushellsounds great! no problem!23:08
hushellsonney2k: what the day would be the first meeting?23:10
-!- dvalcarce [5b757556@gateway/web/freenode/ip.91.117.117.86] has joined #shogun23:11
dvalcarcehi all23:11
van51sonney2k: classifier_conjugateindex_modular.py is failing for me too now23:16
van51and it's a big diff23:17
van51the others worked with either compiler23:17
@sonney2khushell, no idea yet23:20
@sonney2kbut post official google announcement :D23:20
gsomixsonney2k, how about 30+ line functions? >:323:27
hushellI'll have a nap that after dinner :)23:31
-!- sanyam [uid10602@gateway/web/irccloud.com/x-oldqzgtrfytyuyka] has joined #shogun23:44
--- Log closed Thu May 23 00:00:13 2013

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!